Difference between revisions of "Cochlear Implants"

From biophysics
Jump to navigation Jump to search
 
(150 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
==Introduction==
 
==Introduction==
 
A hearing aid with a cochlear implants translates incoming sound into electrical signals that are directly stimulating the nerves in the cochlea. The process of converting the sound waves into electrical current is done by a sound processor outside of the ear. The steps are the following:
 
A hearing aid with a cochlear implants translates incoming sound into electrical signals that are directly stimulating the nerves in the cochlea. The process of converting the sound waves into electrical current is done by a sound processor outside of the ear. The steps are the following:
[[File:CI_signal_processing_scheme.png|400 px|thumb|CI signal processing scheme]]
 
 
*Microphone picks up sound
 
*Microphone picks up sound
 
*ADC converts analog signal to digital signal
 
*ADC converts analog signal to digital signal
Line 7: Line 6:
 
*Automatic Gain Control (AGC) is applied
 
*Automatic Gain Control (AGC) is applied
 
*Signal is split into frequency bands by a filter bank
 
*Signal is split into frequency bands by a filter bank
*Hilbert Envelopes (amplitudes) are calculated per band
+
*Envelopes are calculated per band
 
*Signal amplitudes per band are mapped to current amplitudes
 
*Signal amplitudes per band are mapped to current amplitudes
 
*Current amplitudes per band are convoluted with spiking patterns  
 
*Current amplitudes per band are convoluted with spiking patterns  
 
*Current steering distributes the current of a single band over multiple electrodes
 
*Current steering distributes the current of a single band over multiple electrodes
 
*The resulting signals sent to the electrodes
 
*The resulting signals sent to the electrodes
 +
 +
==Microphone==
 +
% todo
 +
sensitivity
 +
spectral response
 +
 +
==Analog to digital conversion==
 +
% todo
 +
Sampling rate
 +
ADC bit depth
 +
Signal representation
  
 
==Pre-emphasis filter==
 
==Pre-emphasis filter==
[[file:Pre_emphasis_filter.png|thumb|an example of a pre-emphasis filter by Advanced Bionics]]
 
 
 
The pre-emphasis filter is designed to enhance speech recognition by attenuating lower frequencies in sound, which are less critical for understanding speech. This attenuation helps emphasize higher frequencies, where important speech information, like consonant sounds, is more prominent.  
 
The pre-emphasis filter is designed to enhance speech recognition by attenuating lower frequencies in sound, which are less critical for understanding speech. This attenuation helps emphasize higher frequencies, where important speech information, like consonant sounds, is more prominent.  
  
Line 23: Line 31:
  
 
==Automatic Gain Control==
 
==Automatic Gain Control==
[[file: Compression_function.png|300px|thumb|An example of a compression function (by Advanced Bionics)]]
 
 
Automatic Gain Control (AGC) in cochlear implants serves two primary purposes:
 
Automatic Gain Control (AGC) in cochlear implants serves two primary purposes:
  
Line 29: Line 36:
 
*It rapidly reduces the gain when very loud sounds are detected to prevent discomfort.
 
*It rapidly reduces the gain when very loud sounds are detected to prevent discomfort.
  
The AGC achieves these goals through two systems:
+
The AGC achieves these goals through two processes:
  
*Averagers (fast and slow): These use buffers to average sound levels over specific time windows. Fast averagers respond quickly to sudden changes in sound level, while slow averagers handle more gradual changes. When the average level exceeds a predetermined threshold, the averagers calculate the excess loudness, triggering the compression system.
+
*Averagers (fast and slow): These use buffers to average sound levels over specific time windows. The fast averager responds quickly to sudden changes in sound level, while the slow averager handles more gradual changes. When the average level exceeds a predetermined threshold, often called the kneepoint, the averagers calculate the excess loudness and triggers the compression system.
 
*Compression: When excess loudness is detected by the averagers, the compression system reduces the gain according to a pre-defined compression function. This function usually applies more compression to louder sounds, effectively narrowing the dynamic range in the output signal and ensuring that softer sounds remain audible while protecting the user from loud sounds.
 
*Compression: When excess loudness is detected by the averagers, the compression system reduces the gain according to a pre-defined compression function. This function usually applies more compression to louder sounds, effectively narrowing the dynamic range in the output signal and ensuring that softer sounds remain audible while protecting the user from loud sounds.
  
===Fast and Slow averagers===
+
See [https://en.wikipedia.org/wiki/Dynamic_range_compression Dynamic range compression (wikipedia)] for more background info on compression.
%todo
 
  
===Compression===
+
==Band filtering==
See [https://en.wikipedia.org/wiki/Dynamic_range_compression Dynamic_range_compression] on wikipedia for more background info.
+
After the emphasis filtering and gain control, the signal is split into several frequency bands. The middle of each band corresponds roughly to the frequencies of the electrodes in the cochlea. When 16 electrodes are use, there will be 16 frequency bands.
%todo
 
  
==Band filtering==
+
==Envelopes==
%todo
+
After the signal is split into frequency bands, for each band an envelope function is calculated. [https://en.wikipedia.org/wiki/Envelope_(waves) See: Envelopes (Wikipedia)]
  
==Hilbert Envelopes==
+
Methods for calculating envelopes:
%todo
 
  
==Spike patterns==
+
*Moving window rms.
%todo
+
*Rectification and Smoothing.
 +
*Hilbert Transform. [https://en.wikipedia.org/wiki/Hilbert_transform See: Hilbert transform (Wikipedia)]
  
 
==The mapping function==
 
==The mapping function==
 +
The mapping function (also called map law) translates the envelope amplitudes for each channel to electrical signal amplitudes.
 +
===Types of mapping functions===
 +
Al CI mapping functions can be written in the form I = K * Y(X) + C1
 +
*I is the electrical output in current units.
 +
*X is the envelope signal
 +
*K is a proportionality factor or slope (sometimes incorrectly called 'gain').
 +
*Y(X) is some function of X that determines the mapping type. Different manufacturers use different functions for Y(X), see table below.
 +
*C1 is a constant and determines the offset on the vertical axis.
  
[[file:Mapping_function.png|400px|thumb|The mapping function (according to Advanced Bionics)]]
 
 
The mapping function translates the Hilbert Envelope Amplitudes for each channel to electrical signal amplitudes.
 
 
Different manufactorers use different mapping functions:
 
 
{| class="wikitable"
 
{| class="wikitable"
! Type of Mapping !! Formula !! Manufacturer
+
! Manufacturer !! Type of Mapping !! Y(X)
 
|-
 
|-
| Logarithmic Mapping || I = K * log(L-C1) + C2 || Advanced Bionics
+
| Advanced Bionics || Logarithmic Function || Y(X) = log(X)
 
|-
 
|-
| Power Law Mapping || I = K * (L-C1)^α + C2 || Cochlear
+
| Cochlear || Power Law Function || Y(X) = X<sup>α</sup>
 
|-
 
|-
| Linear Mapping || I = K * (L-C1) + C2 || MED-EL
+
| MED-EL || Normalized Logarithmic Scaling Function || Y(X) = log(1 + C * X)/log(1 + C)
 
|}
 
|}
  
*K is a proportionality factor or slope (sometimes incorrectly called 'gain').
+
In the Normalized Logarithmic Scaling Function (NLSF) C is a scaling parameter that determines the curvature of the Y function.
*C1, C2 are some constants.
+
*In the limit of C is zero it simplifies into a linear relationship: Y(X) = X and thus I = K * X + C1.
*I is the electrical output in current units.
+
*In the limit of C is infinite it simplifies into Y(X) = 1 and thus I = K + C1 which is constant and not very useful.
*L is the signal (Hilbert Envelope) amplitude.
+
*When C is large but finite it simplifies into Y(X) = 1 + log(Signal)/log(C) and by absorbing 1 * K in C1 and ln(C) in K we get I = K * log(Signal) + C1 which is just a logarithmic mapping function. In practice high values for C are used, in which case the NLSF is very close to the logarithmic mapping type.
 +
 
 +
In case of the Power Law Function:
 +
*For small values of alpha (0<alpha<<1) the Power Law Function can be very close to the Logarithmic Function.
 +
*For alpha is one the function becomes a linear function I = K * X + C1.
 +
*In the limit of alpha is zero it simplifies to a constant value: I = K + C1. Which again is not useful.
  
 
Sometimes different constants are used below and above the kneepoint.
 
Sometimes different constants are used below and above the kneepoint.
  
===Advanced Bionics Mapping Function===
+
It is useful to replace the formula I = K * Y(X) + C1 by I = K * (Y(X) + C2) + C3, by substituting C1 = K * C2 + C3 , because in practice C2 and C3 are determined by different parameters with different units. E.g:
Following Advanced Bionics we can fill in some details of their mapping function:
+
<pre>
 
+
I = (M-T)/IDR * (Y(X) - M + IDR + GAIN) + T
*K = (M-T)/IDR
+
</pre>
*C1 = KNEE - IDR - GAIN
+
where K is replaced by (M-T)/IDR, C2 is by - M + IDR + GAIN and C3 by T
*C2 = T
+
*IDR is the input dynamic range,
 
+
*M is the most comfortable level,
resulting in:  
+
*T is the threshold level,  
 
+
*GAIN is the gain of the individual channel.
*I = ((M-T)/IDR) * (L - KNEE + IDR + GAIN) + T
 
 
 
where
 
 
 
* M is the most comfortable level in current units (CU)
 
* T is the threshold level in current units (CU)
 
* KNEE is the kneepoint of the compression function in dB SPL
 
* IDR is the input dynamic range in dB SPL
 
* GAIN is the channel gain in dB SPL
 
 
 
N.B. Current units (CU) is defined differently by different manufacturers.
 
 
 
It follows from the equation that when L = KNEE - GAIN result in I = M, so the electrical output I is right at the M-Level. Since the GAIN is set to zero in most cases, the output is at the M-level when L = KNEE.
 
  
 
===Terminology of Critical Points in the Mapping Function===
 
===Terminology of Critical Points in the Mapping Function===
  
In scientific literature, three key levels are recognized: 1. hearing threshold, 2. comfortable level, and 3. pain threshold, each denoted in various ways.
+
In scientific literature, three key levels are recognized: 1. hearing threshold, 2. (most) comfortable level, and 3. pain threshold, each denoted in various ways.
  
 
The following abbreviations are commonly used to describe specific levels of electrical stimulation:
 
The following abbreviations are commonly used to describe specific levels of electrical stimulation:
Line 118: Line 118:
  
 
The term "Maximum Comfortable Level" is less commonly used and can sometimes refer to the highest level that is still comfortable, just below the pain threshold. This usage can be confusing and should be avoided where possible.
 
The term "Maximum Comfortable Level" is less commonly used and can sometimes refer to the highest level that is still comfortable, just below the pain threshold. This usage can be confusing and should be avoided where possible.
 +
 +
==Spike patterns==
 +
%todo
  
 
==Current Steering==
 
==Current Steering==
 
%todo
 
%todo

Latest revision as of 13:01, 19 August 2024

Introduction

A hearing aid with a cochlear implants translates incoming sound into electrical signals that are directly stimulating the nerves in the cochlea. The process of converting the sound waves into electrical current is done by a sound processor outside of the ear. The steps are the following:

  • Microphone picks up sound
  • ADC converts analog signal to digital signal
  • Pre-filtering is applied for speech emphasis
  • Automatic Gain Control (AGC) is applied
  • Signal is split into frequency bands by a filter bank
  • Envelopes are calculated per band
  • Signal amplitudes per band are mapped to current amplitudes
  • Current amplitudes per band are convoluted with spiking patterns
  • Current steering distributes the current of a single band over multiple electrodes
  • The resulting signals sent to the electrodes

Microphone

% todo sensitivity spectral response

Analog to digital conversion

% todo Sampling rate ADC bit depth Signal representation

Pre-emphasis filter

The pre-emphasis filter is designed to enhance speech recognition by attenuating lower frequencies in sound, which are less critical for understanding speech. This attenuation helps emphasize higher frequencies, where important speech information, like consonant sounds, is more prominent.

As a consequence, the overall loudness of the sound, measured in decibels (dB), is typically reduced after filtering. The degree of loudness reduction depends on both the filter's characteristics and the spectral content of the input sound.

For example, when pink noise is processed through the pre-emphasis filter, as applied in Advanced Bionics (AB) devices, the loudness is reduced by approximately 10 dB. However, when speech is processed, the reduction in loudness is less pronounced due to the different spectral content of speech, which has more energy in the higher frequency bands where the filter has less impact.

Automatic Gain Control

Automatic Gain Control (AGC) in cochlear implants serves two primary purposes:

  • It maintains speech levels near the most comfortable listening level for the CI user.
  • It rapidly reduces the gain when very loud sounds are detected to prevent discomfort.

The AGC achieves these goals through two processes:

  • Averagers (fast and slow): These use buffers to average sound levels over specific time windows. The fast averager responds quickly to sudden changes in sound level, while the slow averager handles more gradual changes. When the average level exceeds a predetermined threshold, often called the kneepoint, the averagers calculate the excess loudness and triggers the compression system.
  • Compression: When excess loudness is detected by the averagers, the compression system reduces the gain according to a pre-defined compression function. This function usually applies more compression to louder sounds, effectively narrowing the dynamic range in the output signal and ensuring that softer sounds remain audible while protecting the user from loud sounds.

See Dynamic range compression (wikipedia) for more background info on compression.

Band filtering

After the emphasis filtering and gain control, the signal is split into several frequency bands. The middle of each band corresponds roughly to the frequencies of the electrodes in the cochlea. When 16 electrodes are use, there will be 16 frequency bands.

Envelopes

After the signal is split into frequency bands, for each band an envelope function is calculated. See: Envelopes (Wikipedia)

Methods for calculating envelopes:

The mapping function

The mapping function (also called map law) translates the envelope amplitudes for each channel to electrical signal amplitudes.

Types of mapping functions

Al CI mapping functions can be written in the form I = K * Y(X) + C1

  • I is the electrical output in current units.
  • X is the envelope signal
  • K is a proportionality factor or slope (sometimes incorrectly called 'gain').
  • Y(X) is some function of X that determines the mapping type. Different manufacturers use different functions for Y(X), see table below.
  • C1 is a constant and determines the offset on the vertical axis.
Manufacturer Type of Mapping Y(X)
Advanced Bionics Logarithmic Function Y(X) = log(X)
Cochlear Power Law Function Y(X) = Xα
MED-EL Normalized Logarithmic Scaling Function Y(X) = log(1 + C * X)/log(1 + C)

In the Normalized Logarithmic Scaling Function (NLSF) C is a scaling parameter that determines the curvature of the Y function.

  • In the limit of C is zero it simplifies into a linear relationship: Y(X) = X and thus I = K * X + C1.
  • In the limit of C is infinite it simplifies into Y(X) = 1 and thus I = K + C1 which is constant and not very useful.
  • When C is large but finite it simplifies into Y(X) = 1 + log(Signal)/log(C) and by absorbing 1 * K in C1 and ln(C) in K we get I = K * log(Signal) + C1 which is just a logarithmic mapping function. In practice high values for C are used, in which case the NLSF is very close to the logarithmic mapping type.

In case of the Power Law Function:

  • For small values of alpha (0<alpha<<1) the Power Law Function can be very close to the Logarithmic Function.
  • For alpha is one the function becomes a linear function I = K * X + C1.
  • In the limit of alpha is zero it simplifies to a constant value: I = K + C1. Which again is not useful.

Sometimes different constants are used below and above the kneepoint.

It is useful to replace the formula I = K * Y(X) + C1 by I = K * (Y(X) + C2) + C3, by substituting C1 = K * C2 + C3 , because in practice C2 and C3 are determined by different parameters with different units. E.g:

I  = (M-T)/IDR * (Y(X) - M + IDR + GAIN) + T

where K is replaced by (M-T)/IDR, C2 is by - M + IDR + GAIN and C3 by T

  • IDR is the input dynamic range,
  • M is the most comfortable level,
  • T is the threshold level,
  • GAIN is the gain of the individual channel.

Terminology of Critical Points in the Mapping Function

In scientific literature, three key levels are recognized: 1. hearing threshold, 2. (most) comfortable level, and 3. pain threshold, each denoted in various ways.

The following abbreviations are commonly used to describe specific levels of electrical stimulation:

  • T, THR, or THL: These stand for Threshold Level, or Threshold Hearing Level. This is the lowest level of electrical stimulation that the user can perceive.
  • M, MCL, or C: These abbreviations stand for Most Comfortable Level, Maximum Comfortable Level, or Comfortable Level. This level refers to the point at which sounds are comfortably perceived—neither too loud nor too soft.
  • USL, MSL, UCL, or LDL: These stand for Upper Stimulus Level, Maximum Stimulation Level, Uncomfortable Loudness Level, or Loudness Discomfort Level. This level indicates the point at which sound becomes painful or uncomfortable for the user.

The terminology can vary depending on the manufacturer. For example, for the comfort level in clinical software:

  • Advanced Bionics uses 'M-level',
  • Cochlear uses 'C-level',
  • Med-El uses 'MCL'.

There can also be some variation in the precise definitions of these terms.

The term "Maximum Comfortable Level" is less commonly used and can sometimes refer to the highest level that is still comfortable, just below the pain threshold. This usage can be confusing and should be avoided where possible.

Spike patterns

%todo

Current Steering

%todo