Loading

JSM Biotechnology and Biomedical Engineering

Image Processing Applied to Doppler Vascular Ultrasonography - Assistance to Carotid Examination Procedures

Original Research | Open Access | Volume 8 | Issue 1

  • 1. Electronics Engineering, Instituto Mauá de Tecnologia, Praça Mauá, 01, São Caetano do Sul, SP, Brazil
  • 2. Vascular Surgery and Sonography, Faculdade de Medicina do ABC, Santo André, SP, Brazil
  • 3. Vascular Surgery and Sonography, Faculdade de Ciências Médicas da Santa Casa de São Paulo, São Paulo, SP, Brazil
+ Show More - Show Less
Corresponding Authors
Wânderson de Oliveira Assis, Praça Mauá, 01, Bairro Mauá – 09580-900 – São Caetano do Sul – SP, Brazil, Tel: +55-11-97633-2365
ABSTRACT

This work proposes to integrate engineering and medicine, seeking to assist in color-Doppler vascular ultrasonography, to determine the carotid occlusion percentual (carotid stenosis). The project consists in the development of software which aims to assist the examiner during or after the procedures, employing artificial neural network and image processing resources, such as filtering, contours detection, and character recognizing to extract the relevant data, obtain the diagnosis and be able to automatically generate a medical report with the results. The software acts in diagnosis failures prevention, assisting to make the exam more accurate and less exposed to human mistakes that may invalidate the exam results.

KEYWORDS

• Doppler vascular ultrasonography

• Image processing

• Neural networks

• Carotid stenosis

CITATION

de Oliveira Assis W, dos Santos JM, Palauro PH, Flores Cisneros Filho CA, Pirutti Silva DA, et al. (2022) Image Processing Applied to Doppler Vascular Ultrasonography - Assistance to Carotid Examination Procedures. JSM Biotechnol Bioeng 8(1): 1091

ABBREVIATIONS

[CNES - Cadastro Nacional de Estabelecimentos de Saúde - National Register of Health Establishments; PRF - Pulse Rate Frequency; OpenCV - Open Source Computer Vision Library); ROI - Region of interest; OCR - Optical Character Recognition; VPS – Velocidade de Pico Systólica - systolic peak speed; VDF – Velocidade Diastólica Final - diastolic end speed; HSV - Hue, Saturation and Value; ACCD - Artéria Carótida Comum Direita - right common carotid artery, ACID - Artéria Carótida Interna Direita - right internal carotid artery; ACED - Artéria Carótida Externa Direita - right external carotid artery; ACCE - Artéria Carótida Comum Esquerda - left common carotid artery; ACIE - Artéria Carótida Interna Esquerda - left internal carotid artery; ACEE - Artéria Carótida Externa Esquerda - left external carotid artery; AVD - Artéria Vertebral Direita - right vertebral artery; AVE - Artéria Vertebral Esquerda - left vertebral artery; % EAT - Estenose Anatômica Distal - Distal anatomical stenosis; VPS - Velocidade de Pico Sistólica - systolic peak speed; VDF - Velocidade diastólica final - final diastolic speed; CC - artéria Carótida Comum - common carotid artery; CI - Carótida Interna - internal carotid; AE – Artérias esquerdas - left arteries; and AD – Artérias Direitas - right arteries.

INTRODUCTION

Advances in technology impact all areas of knowledge, especially bringing many health benefits. A significant advance in medicine would be impossible, if it were not directly allied with the best that technology can offer.

One of the health fields most dependent on the use of technologies is the diagnostic medicine. In Brazil, the National Register of Health Establishments (CNES) estimates that there are approximately 21 thousand institutions dedicated to diagnostic tests, corresponding to an annual investment of few billions of dollars [1].

In this sense, this work presents the use of technologies to assist medical professionals in order to improve the performance of ultrasound procedures, more precisely focused on the diagnosis based on images in carotid examinations. It is proposed to use image processing algorithms and artificial neural networks in order to facilitate the diagnosis of stenosis as well as assist professionals to perform the exam with greater assertiveness and effectiveness. Several studies show the importance of the results of non-invasive Doppler exams, as a diagnostic tool for moderate or severe carotid stenosis [2]. The publication [3] shows that the diagnosis can be made by monitoring the speed and frequency of the carotid flow. In addition, real-time spectrum analysis of direct carotid Doppler signals substantially improves the diagnostic accuracy of non-invasive identification of operable carotid artery disease [4-6].

As a carotid exam is relatively easy and quick to be done, many clinics in Brazil prioritize quantity over quality, often hiring unprepared professionals in order to minimize their costs, making the data obtained unreal or inconclusive, causing rework to perform a new exam, thus spending more time and resources. In the worst situation, such errors can lead to a wrong diagnosis of the patient’s condition, thus subjecting him to unnecessary additional medical diagnostic procedures and even surgeries.

The works [6,7] show the development of image processing algorithms for the detection and automatic generation of curves of the variations in the thickness and diameter of the carotid arteries in sonographic images. The proposal is to compare the results obtained with the application developed with those obtained in commercial ultrasound systems.

In this work, the objectives are similar, however presenting the following differentials in relation to [6,7]:

a) development of a system using Open-Source programming tools that allows the application of the algorithms in real time, in order to assist the examiner during or after the exam, contributing to minimize the incidence of human errors in vascular ultrasound exams with Doppler in the carotid arteries; a system that guarantees the effectiveness and assertiveness of the procedure performed will raise the acceptable quality standards for Doppler exams.

b) development of an algorithm based on image processing and an artificial neural networks application in order to assist the physician in the identification of carotid stenosis with automatic report generation providing a more efficient examination.

MATERIALS AND METHODS

For the development of the work, the concepts of ultrasound applied in vascular Doppler ultrasonography were initially studied. The main difficulties and the most common mistakes in performing the carotid artery doppler exam and in the manipulation of the transducer were investigated.

For the development, Python-based image processing tools were used, which were chosen by taking into account factors such as practicality of use, availability of information and easy access to documentation from software libraries, in addition to the preference for the use of open source tools, making the proposal a low-cost solution.

All research and development steps and the tools used in image processing algorithms are described in the next sections.

IMAGES FOR RETROSPECTIVE STUDY

All images used in the retrospective study for clinical diagnostic purposes were obtained through examinations performed at Clínica Fluxo - Vascular Surgery Clinic. However, the identification of patients was suppressed, so that the data used are anonymous.

ULTRASOUND AN DOPPLER EFFECT

For humans, the audible frequency range is 20 Hz to 20,000 Hz, but each individual has a narrower range that decreases over the course of life. This characteristic of the sound frequency refers to its wave nature in propagation.

The term ultrasound in physics is used to define the frequency range above 20,000 hertz. When a wave interacts with the medium (material) such as a wall or human tissue for example, the following interactions occur: the wave may attenuate during the course and reduce its amplitude; direction change can occur when an oblique beam passing between two materials of different wave velocity (refraction); the wave can disperse in random However, in the medical ultrasound device, it is the waves refraction that define the distances from human tissues to the device.

Having information on the intensity of the wave returned in comparison with the one sent, in addition to the properties of the propagation medium, it is possible to calculate the distance. In Feldman et al. (2009) [8], (Table 1)

Table 1: Density and speed of ultrasound.

Material

Density (kg/m³)

Speed (m/s)

Air

1,2

330

Greasy

924

1450

Soft Tissue

1050

1540

Bones

1912

4080

is presented, which exemplifies density and speed for different media.

Scattering effect obtained by random reflections in biologic tissues provides the ability to generate texture in the ultrasound image.

Doppler effect received its name from the work of the Austrian physicist Christian Doppler when describing that the relationship between the frequency of light and sound waves is conditioned by the relative movement between source and receiver. In medicine, the devices use the same principle to analyse blood flow. The so-called “doppler frequency” is used to refer to the difference between the frequency sent and received being given by the following relation, according to [9]:

fd=\left ( f_{r} -f_{o}\right )=\frac{2.f_{o. }\upsilon.cos\theta }{c}                                                    (1)

where:

fd: Doppler shift frequency or Doppler frequency; fr: ultrasound frequency; f0: emitted frequency; v: blood flow speed; θ: angle between pulse direction and blood flow (depends on the position of the device); and c: speed in soft tissue (1540 m / s).

Therefore:

\upsilon =\frac{c.f_{d}}{2.f_{o}.cos\theta }                                                                                        (2)

We can separate the ultrasound equipment into two main parts: the transducer and the scanner.

The transducer (or probe) is the part that comes into contact with the patient. Inside it is a synthetic piezoelectric ceramic (usually lead zirconate titanate) which when subjected to a voltage (or pressure) generates a proportional electric field. In pulsed wave Doppler systems. This material works as both a sender and a receiver. The device applies a voltage oscillating with high frequency on it, generating a sound wave of the same frequency directed at the patient’s tissues. There is an interval between these pulses emitted, and in these intervals the waves reflected in the tissue generate a pressure on the ceramic, causing a change in the electric field that is used for the formation of the image.

There are many main types of transducers, but in vascular systems the most used are linear and curvilinear. Linear transducers are mostly used for superficial examinations, such as thyroid and carotid, operating at frequencies between 3 to 16 MHz. Curvilinear transducers are mostly used for deeper organs and vascular vessels, with frequencies usually varying between 3 and 6 MHz.

If the frequency is higher, the resolution of the image will also be higher, but will be smaller the depth of the field of view. The sonographic scanner is responsible for reading and interpreting the signals received by the probe. With each echo received, it is possible to obtain information; the different strength of echoes provides texture, while time between pulse and echo determines the distance among diverse organs and body structures. By the Doppler effect, is possible to obtain information about flow direction and velocity.

Carotid Artery Doppler and Most Common Mistakes

The carotid arteries that carry blood to head region are divided between common, internal and external carotid arteries. The right carotid arises from the brachiocephalic arterial trunk of the aortic arch.

According to Miranda & Couto (2018) [10], external carotid arteries are responsible for blood supply to the face, scalp, skull and part of the throat located behind the mouth (oropharynx); the internal carotid arteries are larger in diameter than the external carotid and are topographically divided into four segments: cervical, petrous, cavernous and cerebral branches. (Figure 1)

Graphical representation of carotid artery branches (Netter,  2000)

Figure 1 Graphical representation of carotid artery branches (Netter, 2000)

shows an illustration of how these vessels are arranged in our body.

The paper “Standardization of equipment and techniques for performing vascular ultrasound exams”, written by members of the Department of Cardiovascular Image of the Brazilian Society of Cardiology (Belém et al., 2004) [11] establishes concepts and protocols accepted and used in medicine to perform ultrasound exams Doppler in several parts of the body, including the region of study in this work, the carotid arteries.

First, the examination begins by analysing the artery in a transversal and longitudinal way, as shown in (Figure 2),

Cross-sectional image of the left internal carotid artery, with  measurement of 50-59% stenosis caused by a carotid plaque; “ACI  Esquerda” stands for left internal carotid artery.

Figure 2 Cross-sectional image of the left internal carotid artery, with measurement of 50-59% stenosis caused by a carotid plaque; “ACI Esquerda” stands for left internal carotid artery.

looking for plaques and irregularities of the vessels and also measuring the maximum intima-media thickness of the common carotid artery (the thicker, the higher cardiovascular risk). Special attention should be paid to the carotid bifurcation between the portion that divides the blood flow to the face and brain, as it is the most common place for plaque formation, due to turbulence in the region. A cross-sectional analysis may quantify the degree of obstruction, the shape of the plaques and whether they are located on the anterior, posterior or lateral wall of the vessel.

Following, the analysis is made in a longitudinal way, presented in (Figure 3),

 Longitudinal image of the carotid artery, with the flow  displayed through the color scale and the spectral speed; “ACC Direita”  stands for right common carotid artery

Figure 3 Longitudinal image of the carotid artery, with the flow displayed through the color scale and the spectral speed; “ACC Direita” stands for right common carotid artery.

where it is possible to check more adequately the extension of the plaques, if any.

The Doppler cursor is not fully aligned to the artery axis but enough aligned to the flow axis. This limit of cursor angulation is due to the equipment characteristics which limit the angulation at that much. Then color Doppler is used, showing the direction of blood flow and areas with greater turbulence through a color scale. With an adequate flow display, the pulsed Doppler is used, which must be positioned as parallel as possible in relation to the flow direction (avoiding going over an angle of sixty degrees in relation to doppler axis) and must not be leaning against the vessel walls, to avoid detecting false turbulences, obtaining the maximum and minimum speeds along the cardiac cycle in the vessel through the spectral graph.

In longitudinal analysis, errors occur when obtaining data, as it is where the operator captures the images and shows the measurements made. The most common errors are:

a) Failure to properly adjust the scale (Pulse Rate Frequency – PRF) when detecting blood flow, leaving the equipment with a scanning speed higher or lower than the blood.

b) Do not use the best possible angle to achieve parallelism during pulsed Doppler, limited to an angle of 60 degrees.

c) Do not adjust the scale of the spectral speed display, generating an illegible graph.

d) Failure to correctly position the box, where the Doppler effect occurs in color image, that defines the area to be analyzed, resulting in incorrect flow detection.

Figure 4

 Example of poorly adjusted scales in doppler ultrasonography

Figure 4 Example of poorly adjusted scales in doppler ultrasonography.

shows how harmful scaling errors can be to understanding a doppler exam 

Image Processing Applied to Carotid Artery Ultrasonography with Doppler

For the development, Python-based image processing tools were used, which were chosen taking in account factors such as practicality of use, availability of information and easy access to documentation from software libraries, in addition to the preference for the use of open source tools, making the proposal a low-cost solution 

In addition to the native libraries, the main library adopted in this project, specifically used in image and video processing, is the OpenCV (Open Source Computer Vision Library), widely used for filtering, object recognition, contour detection and, among other applications, including the definition of regions of interest (ROI - Region of interest) where it is associated with the PyTesseract Library through a tool called OCR (Optical Character Recognition), used to extract characters from images..

The integration between the processing software and the operator interface is possible through the PyQt5 library, which allows the internal variables of the software to be associated with the objects contained in the graphical interface and vice versa.

The graphical interface for operating the system was developed using the QtDesigner software, where the saved program is executed at start of application. Despite being a relatively simple and intuitive tool, it is possible to develop advanced interfaces using the available widgets, as well as to create a widget composed of others (when there is a high degree of repeatability in the use of a set of widgets), for these reasons the QtDesigner proved to be the best solution among the others evaluated.

The interface was developed in such a way that the operator is able to select the mode of operation, adjust the filters as needed, being able to monitor in real time the impact of the parameters on the images under analysis.

All processes related to the treatment of images, such as filtering, displaying objects and extracting data applied to the project, must necessarily depend on at least one region of interest (ROI - Region of interest). When an image is selected for processing, initially its entire length is defined as the region of interest, where other regions can be defined for carrying out different analyses, as shown in (Figure 5)

 Example of selecting regions of interest at Doppler  measurement for the right common carotid artery

Figure 5 Example of selecting regions of interest at Doppler measurement for the right common carotid artery.

Considering the objectives of the application, six regions of interest are needed, each with a different functionality. These regions of interest are defined for the Doppler equipment to be used, and the algorithm can be used to determine measurements from exam images collected or at the time of image collection. OCR tools are used to recognize the characters associated with each measurement allowing a comparison with the results determined from the images.

Blood Flow Angle Detection Region

Figure 6

Region of Interest for Detecting the Insonation Angle; “ACID”  is the right internal carotid artery

Figure 6 Region of Interest for Detecting the Insonation Angle; “ACID” is the right internal carotid artery.

shows the region used to detect the blood flow angle through the vessel, in addition to the automatic estimation and display of the insonation angle. This region must be defined in such a way as to involve the image obtained by the device, where the operator uses the color resource on which filters have been applied that allow estimating the correct angle for the acquisition of the systolic peak speed (VPS) and diastolic end speed (VDF).

Speed Spectrum Region

After the cursor is correctly fixed, it is possible to obtain the blood flow velocity curve (Figure 7).

 Speed spectrum for data and scale extraction.

Figure 7 Speed spectrum for data and scale extraction.

Thus, this region is used to extract the speeds of interest after obtaining local maximum and minimum points on a curve defined by cycles, either manually or automatically, acting directly in conjunction with the scale detection region.

For the detection of speeds to be done correctly, it is necessary to correlate the coordinates of the points obtained in the speed spectrum region with the speed scale. For this, the same vertical dimension is adopted for the two regions, making it possible for both regions to collect data in the same order of magnitudes. The scale region is responsible for identifying the values contained therein, and then determining its vertical coordinates. Thus, it is possible to determine the speeds through the correlation between the y coordinates of the values identified in the scale (data in pixels), the values obtained in it (data in cm / s) and the coordinates of the points selected in the speed spectrum.

Thus, a mathematical expression capable of converting a given point y (pixel) to its equivalent value in speed (cm / s) was deduced:

V(P)=(\Delta _{y}-P).f_{e}                                                               (3)

where:

P: Pixel vertical coordinate of the point to be converted (Pixel);

Δy: Vertical dimension of the region of interest (Pixel);

: Full scale, in which its value indicates how much each unit in Pixel represents after conversion to the speed scale (cm/ (s.Pixel)).

The full scale can be calculated using the following expression:

f_{e}=\frac{\left | \upsilon _{A} -\upsilon _{B}\right |}{\left | y_{A}-y_{B} \right |}                                                                  (4)

where:

\upsilonA: Highest speed contained in the scale (cm/s);

\upsilonB: Lowest speed contained in the scale (cm/s);

yA: Pixel coordinate associated with the speed value \upsilon A(Pixel);

yB: Pixel coordinate associated with the speed value \upsilonB(Pixel).

Blood Vessel Identification Region: Among all the defined regions, the blood vessel identification region has the largest area. Considering that the equipment operators must label the images with the name or abbreviation of the vessel to which they refer, it is common to have disagreements as to the most appropriate location for the insertion of the text. Thus, this region must be able to locate the text anywhere on the image, even the most inconvenient ones. Its dimensions are usually slightly smaller than the dimensions of the image, where the filtering should be less sensitive to the presence of other texts that do not present relevant information.

Speed Collection Region

Region defined only for the collection of the intimal-media distance (not considered in all exams).

Image Filtering

The implemented filters allow you to convert the color system of the original image using OpenCV. Among the systems, there are the gray scale, the HSV system formed by the hue, saturation and value components respectively, in addition to the binary system in which a threshold is defined, where values above or below this threshold are considered black or white. These filters, exemplified in (Figure 8),

Application of color filters. (a) Original image; (b) Gray  image; (c) HSV image; “ACCD” stands for right common carotid artery.

Figure 8 Application of color filters. (a) Original image; (b) Gray image; (c) HSV image; “ACCD” stands for right common carotid artery.

are extremely important for detecting certain colors of interest contained in the images, in addition to extracting contour points from the images obtained by the transition between one color and another. This transition is observed when the parameters of any of these filters are changed.

Using the convenient filters (Gonzales & Woods, 2010) [12], it is possible to display the contours in the image, so that the operator is able to find the best adjustment of the HSV parameters in such a way that the points are in fact surrounding the object of interest in the image, where it process can be called filters calibration.

Figure 9

 Example of calibrating contour display and convex outline  in OpenCV filters

Figure 9 Example of calibrating contour display and convex outline in OpenCV filters.

illustrates an example of filtering using the algorithms available in OpenCV to obtain the image outline (in blue) and determine dimensions from the convex outline (in yellow).

Using the filtering and contour detection features, it is possible to detach the walls of the carotid artery within the colored box, and to adjust as centrally as possible a rectangle or an ellipse that surrounds the entire highlighted region (Figure 10),

 Comparison between elliptical and rectangular adjustments.

Figure 10 Comparison between elliptical and rectangular adjustments.

where lines of the horizontal axes of these adjusted geometries bring with them the approximate direction of blood flow that travels the vessel in a very satisfactory way, coinciding with the point and angle at which the examiner must position the cursor to extract the speed spectrum (Figure 11),

 Comparison between the positioning of the cursor during  the exam (on the left) and the automatic adjustment (on the right)

Figure 11 Comparison between the positioning of the cursor during the exam (on the left) and the automatic adjustment (on the right).

therefore serving as a guide and reducing the likelihood of errors.

A third type of contour was developed specifically for graphical analysis of the speed spectra. Since the background of the original figure (Figure 12)

Contour points on the speed curve

Figure 12 Contour points on the speed curve.

is dominated by black pixels, and the speed spectrum displayed in shades of gray, a logic has been developed that verifies strategic points contained in the asymptotic lines that intersect all the contour points, in order to ensure that the plot of the new points corresponded to the upper contour.

DIAGNOSIS BY IMAGE PROCESSING

For determine the percentage of the patient’s stenosis, it is necessary to gather all the data obtained in a set of ten images, where these data are subjected to a series of mathematical calculations and the results are evaluated according to a table of values and criteria. Therefore, the system must be able to extract the numerical values from these images, as well as correctly associate them with the vessel from which the speeds were obtained.

Applying the character identification algorithm to welldefined and properly filtered regions of interest, the velocity values are collected at the same time as the blood vessel identification. At the end of this cycle, the data is associated so that the process is repeated for the other images.

After scanning all the images that make up the exam, a report is generated using an algorithm that performs all the calculations and crosses of data to determine the patient’s stenosis percentage (Figure 13),

 Example of results obtained after collecting data and  performing calculations

Figure 13 Example of results obtained after collecting data and performing calculations.

avoiding possible human errors in the process of data entry and report preparation, where: ACCD - right common carotid artery, ACID - right internal carotid artery; ACED - right external carotid artery; ACCE - left common carotid artery, ACIE - left internal carotid artery; ACEE - left external carotid artery; AVD - right vertebral artery and AVE - left vertebral artery. Table 2

Table 2: Classification of groups associated to stenosis percentages.

Group

% Stenosis

1

< 50%

2

50 – 59%

3

60 – 69%

4

70 – 79%

5

80 – 89%

6

> 90%

defines the groups associated with the percentage of stenosis used to define the diagnosis.

Table 3

Table 3: Criteria for classification of percentage of stenosis.

%EAT

VPS

(cm/s)

VDF

(cm/s)

VPS CI/ VPS CC

VPS CI/ VDF CC

VDF CI/ VDF CC

< 50%

< 140

< 40

< 2,0

< 8

< 2,6

50 - 59%

140 - 230

40 - 69

2,0 - 3,1

8 – 10

2,6 - 5,5

60 - 69%

 

70 - 100

3,2 - 4,0

11 – 13

 

70 - 79%

>230

> 100

> 4,0

14 – 21

 

80 - 89%

 

> 140

 

22 – 29

> 5,5

> 90%

> 400

 

> 5,0

> 30

 

Abbreviations: % EAT - Estenose Anatômica Distal - Distal anatomical stenosis; VPS - Velocidade de Pico Sistólica - systolic peak speed; VDF

- Velocidade diastólica final - final diastolic speed; CC - artéria Carótida Comum - common carotid artery; CI - Carótida Interna - internal

carotid

defines the criteria for classification associated with the percentage of stenosis based on the results of the exam (Freire et al., 2015) [13] where: % EAT: Distal anatomical stenosis; VPS: systolic peak speed; VDF: Final diastolic speed; CC: Common carotid artery; CI: Internal carotid.

The columns in the table correspond to the different evaluation criteria and their respective relevance for the final diagnosis, using the collected systolic and diastolic velocities, and some relationships between them. The lines correspond to the percentage of occlusion of the carotid arteries, that is, the set of values obtained from the velocities will result in a certain degree of stenosis.

AUTOMATIC DIAGNOSIS BY ARTIFICIAL NEURAL NETWORKS

A possible approach for obtaining the diagnosis could be the direct analysis of the data obtained in the exam and using Table 3. The main benefits of employing an artificial neural network algorithm to identify the degree of stenosis in patients are:

a) identification when the patient has worrying levels, allowing special attention from the professional who is performing the exam, including when due to inaccuracies or errors in the measurements, the data tend to present inconclusive results;

b) real-time identification when a measurement is a threshold between two percentage ranges of EAT presented in Table 3;again, the performance of the professional will allow to obtain more precise values; additionally, the results in this case will allow indicating the degree of relevance within the diagnostic ranges (for example, diagnosis between groups 2 and 3).

For the creation of the artificial neural network algorithm in order to obtaining a diagnosis, different networks were evaluated, which were trained using a set of data obtained in examinations of several patients, which were not identified to preserve privacy. The data used were peak systolic and final diastolic speeds for the internal and common, right and left carotid arteries, with independent diagnoses for the right and left carotid arteries, being considered as outputs with value 1 for patients who presented stenosis less than 50%, value 2 for patients with stenosis between 50 and 59%, value 3 if between 60 and 69%, value 4 if between 70 and 79%, value 5 if between 80 and 89% and finally value 6 if stenosis is above 90%.

Unfortunately, the number of samples used in training was relatively low due to the number of exams available. Using the Neural Networks toolbox of the Matlab software, a Feed-forward Backpropagation network was created, consisting of two layers, the first consisting of ten neurons and using the LogSig (Log-sigmoid transfer function) activation function, while the second layer uses only a neuron and TanSig activation function (Hyperbolic tangent sigmoid transfer function). The implemented configuration is shown in (Figure 14).

Construction of the neural network, with output classified from the data of four continuous input variables

Figure 14 Construction of the neural network, with output classified from the data of four continuous input variables.

This was the configuration that presented the best results.

In the network, the input variables E1, E2, E3 and E4 represent, respectively, peak systolic speed of the internal carotid, final diastolic speed of the internal carotid, systolic peak speed of the common carotid and final diastolic speed of the common carotid. After training the network, the parameters responsible for producing an output state (classification) associated with the set of input data are generated, namely:

(n,i): Input Weights, where n is the neuron index and is the input index;

(1): Input Weights for output neuron (multiply the output of the 1st layer neurons), where is the index of the supplying neuron;

(n): Bias, where N is the layer number.

RESULTS AND DISCUSSION

The system was used as a tool to facilitate the examination and the data obtained were validated, obtaining the results summarized below:

a) Angle of insonation - the accuracy of the automatic determination of angles of blood flow and insonation is strongly dependent on the parameters adjusted by the HSV filter, since it is possible to distinguish the colors of interest (predominantly blue and red tones) and to remove the rest. Given the variation in color tone for each image, a standardized value was reached for the HSV parameters in order to contemplate the largest possible number of images, but it is worth noting that several improvements can be made for each specific equipment, making the parameterization self-adjusting, resulting in a more viable operational interface for future system operators. (Figure 15)

 Angle of insonation - Example of results obtained after  collecting data and performing calculations.

Figure 15 Angle of insonation - Example of results obtained after collecting data and performing calculations.

demonstrates the proximity of the resulting automatic angulation, when the parameters are properly adjusted.

b) Speed scale - The validation process of automatic scales consists, first, of manually positioning the speed lines on the y coordinate corresponding to the number extracted from the scale shown in the original figure (Figure 16), and comparing the error between these values and those obtained through the lines. The algorithm analyzes a complete cycle and obtains the maximum peak within the cycle. Measurements are performed automatically by the image processing algorithm and can be validated because they are very close to the values obtained manually from the instruments. The errors present in the tables can be justified by the y dimension of the regions of interest referring to the scale and speed curves, where larger dimensions result in a lower scale value, contributing significantly to the increase of the scale accuracy. To illustrate, considering 08 exam images, the percentage errors presented for the measurements in the upper value of the scale had a maximum error of 0.58% and an average error value of 0.0073%. In the lower intermediate scale (half of the curve) there was a maximum error of 2.32% and an average error of 0.55%. Therefore, the percentage error between the value measured in the algorithm with automatic scale and the one obtained manually, by placing the cursor on the graph, proved to be quite small. Thus, the results obtained were considered reasonably accurate.

The maximum absolute error between the actual peak systolic and straight line speeds automatically adjusted in the algorithm was 7.50 and the average 3.109; the maximum absolute error between the actual final diastolic speeds and the adjusted straight lines in the algorithm was 5.92 and the average 3.448.

c) Automated diagnosis - The final diagnosis is obtained by means of a classifying algorithm, in which all the analysis criteria are inserted. The data extracted from the images are organized, and then they are submitted to the evaluation of the system, according to Table 3. In order to obtain the diagnosis, it is necessary that the system operator select the set of images obtained in the exam and fill in the fields contained in the “Examination data” area, where the option to enable the report must be checked, the file destination must be defined then click on the “Generate diagnosis” button. Therefore, the developed tool allows the operator easily produce the report related to the exam, but with the automatic diagnosis being defined by the algorithm. At the end of the process, the diagnostic table similar to that shown in (Figure13), being filled in automatically, with the abbreviated identifications of the arteries and their associated associated speeds. For the criteria in which it is necessary to calculate the relationship between speeds, partial results can be consulted in columns AE (Left arteries) and AD (Right arteries). The final result can be consulted directly on the application interface, and corresponds to the values of anatomical distal stenosis for the right and left arteries. The final report (Figure 18) is saved in the selected directory, in which will be a folder with the patient’s name containing a text file also identified with the patient’s name, in order to provide greater organization on the part of the user, in view of the large number of files you will be working with.

d) Automated diagnosis by artificial neural network - In order to validate the use of the artificial neural network algorithm, simulations were carried out with 34 exams (small number and in which it was necessary to include the training data, which is not a convenient practice). Table 4 shows the results associated with the percentage groups of stenosis comparing cases of real diagnoses and those obtained in the validation of the algorithm. It is observed that the classification obtained by the artificial neural network practically coincides with the results of the groups defined by the real diagnosis, assigned by professionals in the medical field, presenting correctness in all diagnostic results if we consider that the values obtained at the output of the neural network have an error margin of ± 0.1 in the ranges allowed for each solution (values 1 to 6 expected at the output for each diagnostic range of stenosis).

CONCLUSION

Based on the results obtained, it is possible to affirm that the resources of analysis and image processing, despite being already largely incorporated into medicine, still represent a great potential for development. One of the main pillars of the significant progress achieved in the different areas of medicine is the development of dedicated equipment and instrumentation, increasingly modern technologies created from specific demands.

The developed application makes it possible to compare its independent results with the results collected by the operator of the ultrasound device, in order to avoid that there are significant discrepancies, to the point that later sets of illegible images are delivered for medical analysis, making it necessary to carry out further tests. The obtaining of the insonation angle limit is another critical point of analysis, serving as an excellent reference when used in real time mode, or simply as a post-examination tool, being able to indicate whether the collected data are valid and were collected correctly. This item can be used as a reference to indicate to the operator if the exam is being performed correctly or if a review is needed in the procedure.

And finally, the automated diagnostic tool, which processes the data in an impersonal manner and prevents errors of human nature from being made during the process, performing all the calculations and generating each report within approximately ten seconds, in a practical and organized manner.

The preliminary results obtained by the artificial neural network demonstrate that the method has potential for application in the classification of the percentage of stenosis, enabling convergence for a correct diagnosis, but the extreme accuracy expected to make its implementation feasible depends primarily on a large availability of data, so that they are separated into two sets, for training and validation.

ACKNOWLEDGMENTS

Sincere thanks to the team of professors from the Instituto Mauá de Tecnologia and doctors from Faculdade de Medicina do ABC and from Faculdade de Ciências Médicas da Santa Casa de São Paulo, who collaborated a lot in guiding and collecting data from the exams.

REFERENCES
  1. Campana, G A, Oplustil, C P, Faro, L B, Tendências em Medicina Laboratorial. Jornal Brasileiro de Patologia e Medicina Laboratorial, v. 47, no 4, Rio de Janeiro, Agosto, 2011.
  2. Santos SN, Monica Luiza de Alcantara, Claudia Freire, Armando Cantisano. Posicionamento de Ultrasonografia Vascular do Departamento de Imagem Cardiovascular da Sociedade Brasileira de Cardiologia – 2019. Arquivos Brasileiros de Cardiologia. 2019; 112.
  3. Hatle L, Angelsen B A, Tromsdal A. Non-invasive assessment of aortic stenosis by Doppler ultrasound. Br Heart J. 1980; 43: 284-292.
  4. Lee, W. General Principles of Carotid Doppler Ultrasonography. Ultrasonography.2014; 33: 11-17.
  5. Edward G Grant, Carol B Benson, Gregory L Moneta, Andrei V Alexandrov, J Dennis Baker, Edward I Bluth, et al. Carotid artery stenosis: gray-scale and Doppler US diagnosis--Society of Radiologists in Ultrasound Consensus Conference. Radiology. 2003; 229: 340-6.
  6. Higa M, Pilon P E, Lage S G, Gutierrez MA. A Computational Tool for Quantitative Assessment of Peripheral Arteries in Ultrasound Images. 36th Annual Computers in Cardiology Conference (CinC). Park City, UT, USA, 2009; 13-16.
  7. Higa M. A Métodos para Quantificação da Artéria Carótida em Imagens de Ultrassom Modo-B e Doppler. Electrical Engineering Masters Dissertation. Escola Politécnica da Universidade de São Paulo, São Paulo, SP, Brasil, 2009.
  8. Myra K Feldman, Sanjeev Katyal, Margaret S Blackwood. US Artifacts. Radiographics. 2009; 29: 1179-89.
  9. Andrew A Pellett, Edmund K Kerut. The Doppler Equation. Echocardiography. 2004; Feb;21: 197-8
  10. Miranda RB, Couto VAP. Doppler das Artérias: Carótidas e Vertebrais. São Paulo, SP, Brasil: Di Livros, 2018.
  11. Belém LHJ, Jorge Ilha Guimarães. Normatização dos Equipamentos e das Técnicas para a Realização de Exames de Ultrasonografia Vascular. Sociedade Brasileira de Cardiologia. Arq. Bras. Cardiol. 2004; 82.
  12. Gonzales RC, Woods RE. Processamento Digital de Imagens. São Paulo: Pearson Prentice Hall, 2010.
  13. Cláudia Maria Vilas Freire, Monica Luiza de Alcantara, Simone Nascimento dos Santos, Salomon Israel do Amaral, Orlando Veloso, Carmen Lucia Lascasas Porto et. al. Recomendação para quantificação pelo ultrassom da doença aterosclerótica das artérias carótidas e vertebrais. Grupo de trabalho do Departamento de Imagem Cardiovascular da Sociedade Brasileira de Cardiologia – DIC – SBC. Arq Bras Cardiol: Imagem cardiovasc. 2015; 28: e1-e64.

de Oliveira Assis W, dos Santos JM, Palauro PH, Flores Cisneros Filho CA, Pirutti Silva DA, et al. (2022) Image Processing Applied to Doppler Vascular Ultrasonography - Assistance to Carotid Examination Procedures. JSM Biotechnol Bioeng 8(1): 1091

Received : 03 Nov 2022
Accepted : 16 Dec 2022
Published : 18 Dec 2022
Journals
Annals of Otolaryngology and Rhinology
ISSN : 2379-948X
Launched : 2014
JSM Schizophrenia
Launched : 2016
Journal of Nausea
Launched : 2020
JSM Internal Medicine
Launched : 2016
JSM Hepatitis
Launched : 2016
JSM Oro Facial Surgeries
ISSN : 2578-3211
Launched : 2016
Journal of Human Nutrition and Food Science
ISSN : 2333-6706
Launched : 2013
JSM Regenerative Medicine and Bioengineering
ISSN : 2379-0490
Launched : 2013
JSM Spine
ISSN : 2578-3181
Launched : 2016
Archives of Palliative Care
ISSN : 2573-1165
Launched : 2016
JSM Nutritional Disorders
ISSN : 2578-3203
Launched : 2017
Annals of Neurodegenerative Disorders
ISSN : 2476-2032
Launched : 2016
Journal of Fever
ISSN : 2641-7782
Launched : 2017
JSM Bone Marrow Research
ISSN : 2578-3351
Launched : 2016
JSM Mathematics and Statistics
ISSN : 2578-3173
Launched : 2014
Journal of Autoimmunity and Research
ISSN : 2573-1173
Launched : 2014
JSM Arthritis
ISSN : 2475-9155
Launched : 2016
JSM Head and Neck Cancer-Cases and Reviews
ISSN : 2573-1610
Launched : 2016
JSM General Surgery Cases and Images
ISSN : 2573-1564
Launched : 2016
JSM Anatomy and Physiology
ISSN : 2573-1262
Launched : 2016
JSM Dental Surgery
ISSN : 2573-1548
Launched : 2016
Annals of Emergency Surgery
ISSN : 2573-1017
Launched : 2016
Annals of Mens Health and Wellness
ISSN : 2641-7707
Launched : 2017
Journal of Preventive Medicine and Health Care
ISSN : 2576-0084
Launched : 2018
Journal of Chronic Diseases and Management
ISSN : 2573-1300
Launched : 2016
Annals of Vaccines and Immunization
ISSN : 2378-9379
Launched : 2014
JSM Heart Surgery Cases and Images
ISSN : 2578-3157
Launched : 2016
Annals of Reproductive Medicine and Treatment
ISSN : 2573-1092
Launched : 2016
JSM Brain Science
ISSN : 2573-1289
Launched : 2016
JSM Biomarkers
ISSN : 2578-3815
Launched : 2014
JSM Biology
ISSN : 2475-9392
Launched : 2016
Archives of Stem Cell and Research
ISSN : 2578-3580
Launched : 2014
Annals of Clinical and Medical Microbiology
ISSN : 2578-3629
Launched : 2014
JSM Pediatric Surgery
ISSN : 2578-3149
Launched : 2017
Journal of Memory Disorder and Rehabilitation
ISSN : 2578-319X
Launched : 2016
JSM Tropical Medicine and Research
ISSN : 2578-3165
Launched : 2016
JSM Head and Face Medicine
ISSN : 2578-3793
Launched : 2016
JSM Cardiothoracic Surgery
ISSN : 2573-1297
Launched : 2016
JSM Bone and Joint Diseases
ISSN : 2578-3351
Launched : 2017
JSM Bioavailability and Bioequivalence
ISSN : 2641-7812
Launched : 2017
JSM Atherosclerosis
ISSN : 2573-1270
Launched : 2016
Journal of Genitourinary Disorders
ISSN : 2641-7790
Launched : 2017
Journal of Fractures and Sprains
ISSN : 2578-3831
Launched : 2016
Journal of Autism and Epilepsy
ISSN : 2641-7774
Launched : 2016
Annals of Marine Biology and Research
ISSN : 2573-105X
Launched : 2014
JSM Health Education & Primary Health Care
ISSN : 2578-3777
Launched : 2016
JSM Communication Disorders
ISSN : 2578-3807
Launched : 2016
Annals of Musculoskeletal Disorders
ISSN : 2578-3599
Launched : 2016
Annals of Virology and Research
ISSN : 2573-1122
Launched : 2014
JSM Renal Medicine
ISSN : 2573-1637
Launched : 2016
Journal of Muscle Health
ISSN : 2578-3823
Launched : 2016
JSM Genetics and Genomics
ISSN : 2334-1823
Launched : 2013
JSM Anxiety and Depression
ISSN : 2475-9139
Launched : 2016
Clinical Journal of Heart Diseases
ISSN : 2641-7766
Launched : 2016
Annals of Medicinal Chemistry and Research
ISSN : 2378-9336
Launched : 2014
JSM Pain and Management
ISSN : 2578-3378
Launched : 2016
JSM Women's Health
ISSN : 2578-3696
Launched : 2016
Clinical Research in HIV or AIDS
ISSN : 2374-0094
Launched : 2013
Journal of Endocrinology, Diabetes and Obesity
ISSN : 2333-6692
Launched : 2013
Journal of Substance Abuse and Alcoholism
ISSN : 2373-9363
Launched : 2013
JSM Neurosurgery and Spine
ISSN : 2373-9479
Launched : 2013
Journal of Liver and Clinical Research
ISSN : 2379-0830
Launched : 2014
Journal of Drug Design and Research
ISSN : 2379-089X
Launched : 2014
JSM Clinical Oncology and Research
ISSN : 2373-938X
Launched : 2013
JSM Bioinformatics, Genomics and Proteomics
ISSN : 2576-1102
Launched : 2014
JSM Chemistry
ISSN : 2334-1831
Launched : 2013
Journal of Trauma and Care
ISSN : 2573-1246
Launched : 2014
JSM Surgical Oncology and Research
ISSN : 2578-3688
Launched : 2016
Annals of Food Processing and Preservation
ISSN : 2573-1033
Launched : 2016
Journal of Radiology and Radiation Therapy
ISSN : 2333-7095
Launched : 2013
JSM Physical Medicine and Rehabilitation
ISSN : 2578-3572
Launched : 2016
Annals of Clinical Pathology
ISSN : 2373-9282
Launched : 2013
Annals of Cardiovascular Diseases
ISSN : 2641-7731
Launched : 2016
Journal of Behavior
ISSN : 2576-0076
Launched : 2016
Annals of Clinical and Experimental Metabolism
ISSN : 2572-2492
Launched : 2016
Clinical Research in Infectious Diseases
ISSN : 2379-0636
Launched : 2013
JSM Microbiology
ISSN : 2333-6455
Launched : 2013
Journal of Urology and Research
ISSN : 2379-951X
Launched : 2014
Journal of Family Medicine and Community Health
ISSN : 2379-0547
Launched : 2013
Annals of Pregnancy and Care
ISSN : 2578-336X
Launched : 2017
JSM Cell and Developmental Biology
ISSN : 2379-061X
Launched : 2013
Annals of Aquaculture and Research
ISSN : 2379-0881
Launched : 2014
Clinical Research in Pulmonology
ISSN : 2333-6625
Launched : 2013
Journal of Immunology and Clinical Research
ISSN : 2333-6714
Launched : 2013
Annals of Forensic Research and Analysis
ISSN : 2378-9476
Launched : 2014
JSM Biochemistry and Molecular Biology
ISSN : 2333-7109
Launched : 2013
Annals of Breast Cancer Research
ISSN : 2641-7685
Launched : 2016
Annals of Gerontology and Geriatric Research
ISSN : 2378-9409
Launched : 2014
Journal of Sleep Medicine and Disorders
ISSN : 2379-0822
Launched : 2014
JSM Burns and Trauma
ISSN : 2475-9406
Launched : 2016
Chemical Engineering and Process Techniques
ISSN : 2333-6633
Launched : 2013
Annals of Clinical Cytology and Pathology
ISSN : 2475-9430
Launched : 2014
JSM Allergy and Asthma
ISSN : 2573-1254
Launched : 2016
Journal of Neurological Disorders and Stroke
ISSN : 2334-2307
Launched : 2013
Annals of Sports Medicine and Research
ISSN : 2379-0571
Launched : 2014
JSM Sexual Medicine
ISSN : 2578-3718
Launched : 2016
Annals of Vascular Medicine and Research
ISSN : 2378-9344
Launched : 2014
Journal of Hematology and Transfusion
ISSN : 2333-6684
Launched : 2013
JSM Environmental Science and Ecology
ISSN : 2333-7141
Launched : 2013
Journal of Cardiology and Clinical Research
ISSN : 2333-6676
Launched : 2013
JSM Nanotechnology and Nanomedicine
ISSN : 2334-1815
Launched : 2013
Journal of Ear, Nose and Throat Disorders
ISSN : 2475-9473
Launched : 2016
JSM Ophthalmology
ISSN : 2333-6447
Launched : 2013
Journal of Pharmacology and Clinical Toxicology
ISSN : 2333-7079
Launched : 2013
Annals of Psychiatry and Mental Health
ISSN : 2374-0124
Launched : 2013
Medical Journal of Obstetrics and Gynecology
ISSN : 2333-6439
Launched : 2013
Annals of Pediatrics and Child Health
ISSN : 2373-9312
Launched : 2013
JSM Clinical Pharmaceutics
ISSN : 2379-9498
Launched : 2014
JSM Foot and Ankle
ISSN : 2475-9112
Launched : 2016
JSM Alzheimer's Disease and Related Dementia
ISSN : 2378-9565
Launched : 2014
Journal of Addiction Medicine and Therapy
ISSN : 2333-665X
Launched : 2013
Journal of Veterinary Medicine and Research
ISSN : 2378-931X
Launched : 2013
Annals of Public Health and Research
ISSN : 2378-9328
Launched : 2014
Annals of Orthopedics and Rheumatology
ISSN : 2373-9290
Launched : 2013
Journal of Clinical Nephrology and Research
ISSN : 2379-0652
Launched : 2014
Annals of Community Medicine and Practice
ISSN : 2475-9465
Launched : 2014
Annals of Biometrics and Biostatistics
ISSN : 2374-0116
Launched : 2013
JSM Clinical Case Reports
ISSN : 2373-9819
Launched : 2013
Journal of Cancer Biology and Research
ISSN : 2373-9436
Launched : 2013
Journal of Surgery and Transplantation Science
ISSN : 2379-0911
Launched : 2013
Journal of Dermatology and Clinical Research
ISSN : 2373-9371
Launched : 2013
JSM Gastroenterology and Hepatology
ISSN : 2373-9487
Launched : 2013
Annals of Nursing and Practice
ISSN : 2379-9501
Launched : 2014
JSM Dentistry
ISSN : 2333-7133
Launched : 2013
Author Information X