Today we used the audio extracted from the video in a post below. It was taken by a Logitech 270 webcam which was pressed against my finger, hence the strange red pulsating color.
The audio was truncated as in the beginning the camera was moved a bit harshly and at the end the boiler used by my other self was creating an increasing white noise.
We just used Hjerte 0.3 (available on this Hackaday page and on Github) to classify the heart sound. It recognizes my heart beat quite well, and seems to find convincing S1 and S2 sounds.
What are the take home points?
– There is no need for a ultrasound Doppler to record heart sounds. Hence the “passive” in the title. It is important as some people dislike the idea of using ultrasounds in mass market devices.
– Heart sounds can be recorded on a finger!
– The Hjerte algorithm works even in weird conditions (ordinary microphone, lot of noise).
Now we have to use the video component in the file, and use it in conjunction with the audio part. An obvious use would be to have a reliable heart beat detection, before starting the segmentation.
We are dreaming of multiple webcams recording heart and lung sounds and integrating all those information!
So, since one year we did develop a heart failure detector. For a proof of concept, it works quite well and it is open source.
The making of was documented on Hackaday:
We invite you to review this work, adapt it, and sell it in the format that fits the best your goals and capabilities. If you need help just ask us with the contact form:
Now is the time to plan our next steps.
First we observe that technology is often a bit arrogant when it comes to medicine.
It is not because a heart is detected as having some problem at some time that the patient problem is solved. What is detected could be the sign of many disorders and thus doesn’t tell what is wrong. This heart problem may be transient or linked to another condition. It may not exist at all. It is the role of the family doctor to capture the full picture and prioritize issues and define treatments.
What we envision is a kind of tooling for family doctors that is coupled to a physiology model. It is actually an extension of what doctors use today, it is not a revolution. Today doctors can browse conditions and remedies on their computer according to parameters they define.
What are missing are the data sources, that for now are provided through medical diagnosis that is the realm of specialists.
Ideally, no new software should be installed on the doctor’s computer, she would securely access the physiology modeling tool through her browser. And this physiology modeling tool would access her data sources securely without the doctor’s IT service having to install them.