Low Frequency-based Non-uniform Sampling Strategy to Improve Chinese Recognition in Cochlear Implant_Journal of Biomedical Engineering

Authors：

NISaihua ¹ , SUNWenye ¹ , SUNBaoyin ¹ , ZHOUQiang ¹ , WANGZhenming ² , GUJihua ¹ ,  TAOZhi ¹

1. College of Physical Science and Technology, Soochow University, Suzhou 215006, China;
2. Jie Mei Biomedical Engineering Laboratory, Soochow University, Suzhou 215006, China;

Corresponding author：

TAOZhi, Email: taoz@suda.edu.cn

Keywords：

fine structure; zero-crossing; low frequency; Chinese recognition; cochlear implant

DOI：

10.7507/1001-5515.20140097

Video：

Export PDF Favorites Scan Get Citation

Abstract Full text Figures/Tables Video References Cited by

To enhance speech recognition, as well as Mandarin tone recognition in noice, we proposed a speech coding strategy called zero-crossing of fine structure in low frequency (LFFS) for cochlear implant based on low frequency non-uniform sampling (LFFS for short). In the range of frequency perceived boundary of human ear, we used zero-crossing time of the fine structure to generate the stimulus pulse sequences based on the frequency selection rule. Acoustic simulation results showed that although on quiet background the performance of LFFS was similar to continuous interleaved sampling (CIS), on the noise background the performance of LFFS in Chinese tones, words and sentences were significantly better than CIS. In addition to this, we also got better Mandarin recognition factors distribution by using the improved index distribution model. LFFS contains more tonal information which was able to effectively improve Mandarin recognition of the cochlear implant.

Citation： NISaihua, SUNWenye, SUNBaoyin, ZHOUQiang, WANGZhenming, GUJihua, TAOZhi. Low Frequency-based Non-uniform Sampling Strategy to Improve Chinese Recognition in Cochlear Implant. Journal of Biomedical Engineering, 2014, 31(3): 520-526. doi: 10.7507/1001-5515.20140097 Copy

1.	WILSON B S, FINLEY C C, LAWSON D T, et al. Design and evaluation of a continuous interleaved sampling (CIS) processing strategy for multichannel cochlear implants[J]. J Rehabil Res Dev, 1993, 30(1):110-116.
2.	WEI C G, CAO K, ZENG F G. Mandarin tone recognition in cochlear-implant subjects[J]. Hear Res, 2004, 197(1-2):87-95.
3.	CIOCCA V, FRANCIS A L, AISHA R, et al. The perception of Cantonese lexical tones by early-deafened cochlear implantees[J]. J Acoust Soc Am, 2002, 111(5 Pt 1):2250-2256.
4.	KONG Y Y, CRUZ R, JONES J A, et al. Music perception with temporal cues in acoustic and electric hearing[J]. Ear Hear, 2004, 25(2):173-185.
5.	VONGPHOE M, ZENG F G. Speaker recognition with temporal cues in acoustic and electric hearing[J]. J Acoust Soc Am, 2005, 118(2):1055-1061.
6.	NIE K B, STICKNEY G, ZENG F G. Encoding frequency modulation to improve cochlear implant performance in noise[J]. IEEE Trans Biomed Eng, 2005, 52(1):64-73.
7.	CHEN F, ZHANG Y T. Zerocrossing-based nonuniform sampling to deliver low-frequency fine structure cue for cochlear implant[J]. Digit Signal Process, 2011, 21(3):427-432.
8.	SMITH Z M, DELGUTTE B, OXENHAM A J. Chimaeric sounds reveal dichotomies in auditory perception[J]. Nature, 2002, 416(6876):87-90.
9.	LOIZOU P C. Introduction to cochlear implants[J]. IEEE Eng Med Biol Mag, 1999, 18(1):32-42.
10.	CHEN F, ZHANG Y T. A novel temporal fine structure-based speech synthesis model for cochlear implant[J]. Signal Process., 2008, 88(11):2693-2699.
11.	HENG J, CANTARERO G, ELHILALI M, et al. Impaired perception of temporal fine structure and musical timbre in cochlear implant users[J]. Hear Res, 2011, 280(1-2):192-200.
12.	RUBINSTEIN J T, TURNER C. A novel acoustic simulation of cochlear implant hearing:Effects of temporal fine structure[C]. Proceedings of First International IEEE EMBS Conference on Neural Engineering. Capri Island, Italy:2003:142-145.
13.	LAN N, NIE K B, GAO S K, et al. A novel speech-processing strategy incorporating tonal information for cochlear implants[J]. IEEE Trans Biomed Eng, 2004, 51(5):752-760.
14.	WILSON B S, SCHATZER R, LOPEZ-POVEDA E A, et al. Two new directions in speech processor design for cochlear implants[J]. Ear Hear, 2005, 26(4 Suppl):73S-81S.
15.	GUAN T, GONG Q, YE D T. A novel speech processing algorithm for cochlear implant based on selective fundamental frequency control[C]//KING I, WANG J, CHAN L W, et al. ICONIP'06 Proceedings of the 13 International Conference on Neural Information Processing-Part I. Heidelberg:Springer-Verlag Berlin Heidelberg, 2006, 4232:272-279.
16.	WANG W D, LIU H Y, YUAN H, et al. A new speech coding strategy for cochlear implant[J]. J Med Biol Eng, 2010, 30(5):335-342.
17.	LIU H Y, WANG W D, LIU G R, et al. An improved speech coding strategy for cochlear implants[C]//20103rd International Conference on Biomedical Engineering and Informatics (BMEI). Yantai, China:2010, 4:1416-1419.
18.	CHEN F, ZHANG Y T. Zerocrossing-based fine structure representation to convey Mandarin tonal information:a study on the noise effect[C]//30th Annual International IEEE EMBS Conference. Vancouver, British Columbia, Canada:2008:20-24.
19.	SAIMAI N, TANTIBUNDHIT C, ONSUWAN C, et al. Speech synthesis algorithm for Thai cochlear implants[C]//The proceedings of 9th International Conference Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON). Hua Hin, Thailand:2012:1-4.
20.	POTAMIANOS A, MARAGOS P. Speech analysis and synthesis using an AM-FM modulation model[J]. Speech Commun, 1999, 28(3):195-209.
21.	VAKMAN D. On the analytic signal, the Teager-Kaiser energy algorithm, and other methods for defining amplitude and frequency[J]. IEEE Trans Signal Process, 1996, 44(4):791-797.
22.	GREENWOOD D D. A cochlear frequency-position function for several species——29 years later[J]. J Acoust Soc Am, 1990, 87(6):2592-2605.
23.	BOOTHROYD A, NITTROUER S. Mathematical treatment of context effects in phoneme and word recognition[J]. J Acoust Soc Am, 1988, 84(1):101-114.
24.	FU Q J, ZENG F G, SHANNON R V, et al. Importance of tonal envelope cues in Chinese speech recognition[J]. J Acoust Soc Am, 1998, 104(1):505-510.
25.	ROSEN S. Temporal information in speech:acoustic, auditory and linguistic aspects[J]. Philos Trans R Soc Lond B Biol Sci, 1992, 336(1278):367-373.

1. WILSON B S, FINLEY C C, LAWSON D T, et al. Design and evaluation of a continuous interleaved sampling (CIS) processing strategy for multichannel cochlear implants[J]. J Rehabil Res Dev, 1993, 30(1):110-116.
2. WEI C G, CAO K, ZENG F G. Mandarin tone recognition in cochlear-implant subjects[J]. Hear Res, 2004, 197(1-2):87-95.
3. CIOCCA V, FRANCIS A L, AISHA R, et al. The perception of Cantonese lexical tones by early-deafened cochlear implantees[J]. J Acoust Soc Am, 2002, 111(5 Pt 1):2250-2256.
4. KONG Y Y, CRUZ R, JONES J A, et al. Music perception with temporal cues in acoustic and electric hearing[J]. Ear Hear, 2004, 25(2):173-185.
5. VONGPHOE M, ZENG F G. Speaker recognition with temporal cues in acoustic and electric hearing[J]. J Acoust Soc Am, 2005, 118(2):1055-1061.
6. NIE K B, STICKNEY G, ZENG F G. Encoding frequency modulation to improve cochlear implant performance in noise[J]. IEEE Trans Biomed Eng, 2005, 52(1):64-73.
7. CHEN F, ZHANG Y T. Zerocrossing-based nonuniform sampling to deliver low-frequency fine structure cue for cochlear implant[J]. Digit Signal Process, 2011, 21(3):427-432.
8. SMITH Z M, DELGUTTE B, OXENHAM A J. Chimaeric sounds reveal dichotomies in auditory perception[J]. Nature, 2002, 416(6876):87-90.
9. LOIZOU P C. Introduction to cochlear implants[J]. IEEE Eng Med Biol Mag, 1999, 18(1):32-42.
10. CHEN F, ZHANG Y T. A novel temporal fine structure-based speech synthesis model for cochlear implant[J]. Signal Process., 2008, 88(11):2693-2699.
11. HENG J, CANTARERO G, ELHILALI M, et al. Impaired perception of temporal fine structure and musical timbre in cochlear implant users[J]. Hear Res, 2011, 280(1-2):192-200.
12. RUBINSTEIN J T, TURNER C. A novel acoustic simulation of cochlear implant hearing:Effects of temporal fine structure[C]. Proceedings of First International IEEE EMBS Conference on Neural Engineering. Capri Island, Italy:2003:142-145.
13. LAN N, NIE K B, GAO S K, et al. A novel speech-processing strategy incorporating tonal information for cochlear implants[J]. IEEE Trans Biomed Eng, 2004, 51(5):752-760.
14. WILSON B S, SCHATZER R, LOPEZ-POVEDA E A, et al. Two new directions in speech processor design for cochlear implants[J]. Ear Hear, 2005, 26(4 Suppl):73S-81S.
15. GUAN T, GONG Q, YE D T. A novel speech processing algorithm for cochlear implant based on selective fundamental frequency control[C]//KING I, WANG J, CHAN L W, et al. ICONIP'06 Proceedings of the 13 International Conference on Neural Information Processing-Part I. Heidelberg:Springer-Verlag Berlin Heidelberg, 2006, 4232:272-279.
16. WANG W D, LIU H Y, YUAN H, et al. A new speech coding strategy for cochlear implant[J]. J Med Biol Eng, 2010, 30(5):335-342.
17. LIU H Y, WANG W D, LIU G R, et al. An improved speech coding strategy for cochlear implants[C]//20103rd International Conference on Biomedical Engineering and Informatics (BMEI). Yantai, China:2010, 4:1416-1419.
18. CHEN F, ZHANG Y T. Zerocrossing-based fine structure representation to convey Mandarin tonal information:a study on the noise effect[C]//30th Annual International IEEE EMBS Conference. Vancouver, British Columbia, Canada:2008:20-24.
19. SAIMAI N, TANTIBUNDHIT C, ONSUWAN C, et al. Speech synthesis algorithm for Thai cochlear implants[C]//The proceedings of 9th International Conference Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON). Hua Hin, Thailand:2012:1-4.
20. POTAMIANOS A, MARAGOS P. Speech analysis and synthesis using an AM-FM modulation model[J]. Speech Commun, 1999, 28(3):195-209.
21. VAKMAN D. On the analytic signal, the Teager-Kaiser energy algorithm, and other methods for defining amplitude and frequency[J]. IEEE Trans Signal Process, 1996, 44(4):791-797.
22. GREENWOOD D D. A cochlear frequency-position function for several species——29 years later[J]. J Acoust Soc Am, 1990, 87(6):2592-2605.
23. BOOTHROYD A, NITTROUER S. Mathematical treatment of context effects in phoneme and word recognition[J]. J Acoust Soc Am, 1988, 84(1):101-114.
24. FU Q J, ZENG F G, SHANNON R V, et al. Importance of tonal envelope cues in Chinese speech recognition[J]. J Acoust Soc Am, 1998, 104(1):505-510.
25. ROSEN S. Temporal information in speech:acoustic, auditory and linguistic aspects[J]. Philos Trans R Soc Lond B Biol Sci, 1992, 336(1278):367-373.

Previous Article
A Fitted Formula for Calculating Electron Beams Mean Energy in the Homogeneous Water Phantom
Next Article
Study on Complex Impedance Properties of Human Lung Tissue

Journal of Biomedical Engineering

Low Frequency-based Non-uniform Sampling Strategy to Improve Chinese Recognition in Cochlear Implant

Abstract Full text Figures/Tables Video References Cited by

Previous Article

Next Article

Format

Content