Damien LOLIVE

PhD, Associate professor, HDR

Head of Computer Science department at Enssat


ENSSAT (Univ Rennes), CNRS, IRISA (Team Expression)
FirstName . LastName w/o accents [at] irisa [dot] fr

Research Interests

  • Speech synthesis
  • Voice conversion
  • Prosody modelling and generation
  • Natural language processing
  • Written and spoken resources development

Short bio

I obtained a master of engineering in computer science at Enssat and a master of research in computer science from Université de Rennes 1 in 2005. Then I had defended my PhD in computer science in November, 2008 as a member of the Cordial team at the Irisa laboratory in the domain of intonation transformation for speech synthesis and voice transformation. In 2008-2009, I held an ATER research position at Enssat. I am now associate professor at Enssat since 2009 and I am part of the Expression research team from IRISA lab. Lastly, in 2017, I obtained the HDR degree (accreditation to supervise research) from the university of Rennes 1.

My research interests are focused on text-to-speech synthesis, natural language processing and more generally language and speech processing.

Teaching

  • XML (M.Sc. level)
  • Object-oriented programming (M.Sc. level)
  • Formal languages (M.Sc. level)
  • Compilers architecture (M.Sc. level)
  • Automatic Speech and Language Processing (M.Sc. level)
  • Pattern recognition (M.Sc. level)

Projects

Publications

A nice year-sorted list is available on HAL with this link

Thesis

  1. Damien Lolive. Transformation de l'intonation : application à la synthèse de la parole et à la transformation de voix. PhD thesis, Université de Rennes 1, 2008. PDF
  2. Damien Lolive. Vers plus de contrôle pour la synthèse de parole expressive. Habilitation à Diriger des Recherches, Université de Rennes 1, 2017. PDFSlides

International journal

  1. Damien Lolive, Nelly Barbot, and Olivier Boeffard. B-Spline Model Order Selection With Optimal MDL Criterion Applied to Speech Fundamental Frequency Stylization, IEEE Journal of Selected Topics in Signal Processing, vol. 4, no. 3, pp. 571–581, 2010. URL
  2. Marie Tahon, Gwénolé Lecorvé and Damien Lolive. Can we Generate Emotional Pronunciations for Expressive Speech Synthesis?, IEEE Journal of Affective Computing, 2018 (accepted).

National journal

  1. Hyion Yoo, Elisabeth Delais-Roussarie, Damien Lolive and Nelly Barbot. Le rythme en lecture oralisée (parole synthétique et parole naturelle), Revue Française de Linguistique Appliquée, vol. 20, no. 2, pp. 63–77, 2015. URL

International conferences

  1. Nelly Barbot, Olivier Boeffard, and Damien Lolive. F0 stylisation with a free-knot b-spline model and simulated-annealing opti- mization, In Proceedings of the 9th European Conference on Speech Communication and Technology (Eurospeech), pages 325–328, Lisboa, Portugal, 2005.
  2. Damien Lolive, Nelly Barbot, and Olivier Boeffard. Comparing b-spline and spline models for f0 modelling, In Lecture Notes in Artificial Intelligence - Proceedings of the 9th International Conference on Text, Speech and Dialogue, pages 423–430, Brno, Czech Republic, 2006. PDF
  3. Damien Lolive, Nelly Barbot, and Olivier Boeffard. Melodic contour estimation with b-spline models using a MDL criterion, In Proceedings of the 11th International Conference on Speech and Computer (SPECOM), pages 333–338, Saint Petersburg, Russia, 2006. PDF
  4. Damien Lolive, Nelly Barbot, and Olivier Boeffard. Unsupervised HMM classification of f0 curves, In Proceedings of Inter- speech’2007, pages 478–481, Antwerp, Belgium, 2007. PDF
  5. Damien Lolive, Nelly Barbot, and Olivier Boeffard. Clustering algorithm for f0 curves based on hidden markov models, In Proceedings of the 6th ISCA Tutorial and Research Workshop on Speech Synthesis (SSW6), pages 85–89, 2007. PDF
  6. Damien Lolive, Nelly Barbot, and Olivier Boeffard. Pitch and duration transformation with non-parallel data, In Proceedings of the Speech Prosody Workshop, Campinas, Brazil, 2008. PDF
  7. Pierre Alain, Nelly Barbot, Vincent Barreaud, Laurent Blin, Olivier Boeffard, Laure Charonnat, Ali Choumane, Arnaud Delhay, Sébastien Le Maguer, Damien Lolive, Thierry Moudenc, and Gaëlle Vidal. A multi-agent platform for multimodal pervasive applications, In Proceedings of the Conference on the Networked and Electronic Media (Nem), 2009.
  8. Damien Lolive, Nelly Barbot, and Olivier Boeffard. An evaluation methodology for prosody transformation systems based on chirp signals, In Proceedings of the 10th Annual Conference of the International Speech Communication Association (Interspeech 2009), 2009, pp. 2635–2638. PDF
  9. Nelly Barbot, Vincent Barreaud, Olivier Boeffard, Laure Charonnat, Arnaud Delhay, Sébastien Le Maguer, and Damien Lolive. Towards a Versatile Multi-Layered Description of Speech Corpora Using Algebraic Relations, In Proceedings of the International Conference on Speech Communication and Technology (Interspeech), 2011, pp. 1501-1504. PDF
  10. Olivier Boeffard, Laure Charonnat, Sébastien Le Maguer, and Damien Lolive. Towards fully automatic annotation of audio books for TTS, In Proceedings of the international conference on Language Resources and Evaluation (LREC), 2012. PDF
  11. Jonathan Chevelu, Gwénolé Lecorvé, and Damien Lolive. ROOTS: a toolkit for easy, fast and consistent processing of large sequential annotated data collections, In Proceedings of the international conference on Language Resources and Evaluation (LREC), 2014.
  12. Sébastien Le Maguer, Elisabeth Delais-Roussarie, Nelly Barbot, Mathieu Avanzi, Olivier Rosec and Damien Lolive. Prosodic chunking algorithm for dictation with the use of speech synthesis, In Speech Prosody 2014, 2014.
  13. David Guennec and Damien Lolive. Unit selection cost function exploration using an A* based Text-to-Speech system, In Proceedings of the international conference on Text, Speech and Dialogue (TSD) 2014, 2014.
  14. Elisabeth Delais-Roussarie, Damien Lolive, Hiyon Yoo, Nelly Barbot and Olivier Rosec. Adapting prosodic chunking algorithm and synthesis system to specific style: the case of dictation, In Proceedings of the International Conference on Speech Communication and Technology (Interspeech), 2014.
  15. Mathieu Avanzi, George Christodoulides, Damien Lolive, Elisabeth Delais-Roussarie and Nelly Barbot. Towards the Adaptation of Prosodic Models for Expressive Text-To-Speech Synthesis, In Proceedings of the International Conference on Speech Communication and Technology (Interspeech), 2014.
  16. Gwénolé Lecorvé and Damien Lolive. Adaptative statistical utterance phonetization for french, In Proceedings of the International Conference on Audio, Signal and Speech Processing, 2015.
  17. David Guennec, Jonathan Chevelu and Damien Lolive. Defining a Global Adaptive Duration Target Cost for Unit Selection Speech Synthesis, In Proceedings of the international conference on Text, Speech and Dialogue (TSD) 2015, 2015.
  18. Jonathan Chevelu, Damien Lolive, Sébastien Le Maguer and David Guennec. How to Compare TTS Systems: A New Subjective Evaluation Methodology Focused on Differences, In Proceedings of the International Conference on Speech Communication and Technology (Interspeech), 2015.
  19. Jonathan Chevelu and Damien Lolive. Do not build your TTS training corpus randomly, In Proceedings of the European Signal Processing Conference (EUSIPCO), 2015.
  20. Raheel Qader, Gwénolé Lecorvé, Damien Lolive and Pascale Sébillot. Probabilistic Speaker Pronunciation Adaptation for Spontaneous Speech Synthesis Using Linguistic Features, In Proceedings of the International Conference on Statistical Language and Speech Processing (SLSP), 2015.
  21. Pierre Alain, Jonathan Chevelu, David Guennec, Gwénolé Lecorvé, Damien Lolive. The IRISA Text-To-Speech System for the Blizzard Challenge 2015. In Blizzard Challenge 2015 Workshop, Sep 2015, Berlin, Germany.
  22. Elisabeth Delais-Roussarie, Damien Lolive, Hiyon Yoo and David Guennec. Rhythmic Patterns and Literary Genres in Synthesized Speech, In Speech Prosody 2016, 2016. PDF
  23. David Guennec and Damien Lolive. On the suitability of vocalic sandwiches in a corpus-based TTS engine, In Proceedings of the International Conference on Speech Communication and Technology (Interspeech), 2016. PDF
  24. Marie Tahon, Raheel Qader, Gwénolé Lecorvé and Damien Lolive. Improving TTS with corpus-specific pronunciation adaptation, In Proceedings of the International Conference on Speech Communication and Technology (Interspeech), 2016.
  25. Marie Tahon, Raheel Qader, Gwénolé Lecorvé and Damien Lolive. Optimal feature set and minimal training size for pronunciation adaptation in TTS , In Proceedings of the International Conference on Statistical Language and Speech Processing (SLSP), 2016.
  26. Pierre Alain, Jonathan Chevelu, David Guennec, Gwénolé Lecorvé, Damien Lolive. The IRISA Text-To-Speech System for the Blizzard Challenge 2016. In Blizzard Challenge 2016 Workshop, Sep 2016, Cupertino, USA. PDF
  27. Cédric Fayet, Arnaud Delhay, Damien Lolive, Pierre-François Marteau. First Experiments to Detect Anomaly Using Personality Traits vs. Prosodic Features, In Proceedings of the Specom Conference, 2017.
  28. Cédric Fayet, Arnaud Delhay, Damien Lolive, Pierre-François Marteau. Big Five vs. Prosodic Features as Cues to Detect Abnormality in SSPNET-Personality Corpus, In Proceedings of the International Conference on Speech Communication and Technology (Interspeech), 2017.
  29. Raheel Qader, Gwénolé Lecorvé, Damien Lolive, Marie Tahon, Pascale Sébillot. Statistical Pronunciation Adaptation for Spontaneous Speech Synthesis. In Proc. of Text, Speech and Dialogue (TSD), Prague, Czech Republic, 2017.
  30. Marie Tahon, Gwénolé Lecorvé, Damien Lolive, Raheel Qader. Perception of expressivity in TTS: linguistics, phonetics or prosody?, In Proc. of the International Conference on Statistical Language and Speech Processing (SLSP), Le Mans, France, 2017.
  31. Cedric Fayet, Arnaud Delhay, Damien Lolive and Pierre-François Marteau. Unsupervised Classification of Speaker Profiles as a Point Anomaly Detection Task. In Proc of the 1st International Workshop on Learning with Imbalanced Domains: Theory and Applications, Co-located with ECML/PKDD, Skopje, Macedonia, 2017.
  32. Pierre Alain, Nelly Barbot, Jonathan Chevelu, Gwénolé Lecorvé, Damien Lolive, Claude Simon, Marie Tahon. The IRISA Text-To-Speech System for the Blizzard Challenge 2017. In Blizzard Challenge 2017 Workshop, Aug 2017, Stockholm, Sweden. PDF
  33. Cédric Fayet, Arnaud Delhay, Damien Lolive, Pierre-François Marteau. EMO&LY (EMOtion and AnomaLY) : A New Corpus for Anomaly Detection in an Audiovisual Stream with Emotional Context. In Proc. of LREC, Miyazaki, Japan, 2018. (accepted)
  34. Aghilas Sini, Damien Lolive, Gaëlle Vidal, Marie Tahon and Élisabeth Delais-Roussarie. SynPaFlex-Corpus: An Expressive French Audiobooks Corpus Dedicated to Expressive Speech Synthesis, In Proc. of LREC, Miyazaki, Japan, 2018. (accepted)
  35. Marie Tahon and Damien Lolive. Discourse phrases classification: direct vs. narrative audio speech, In Proc. of Speech Prosody, Poznań, Poland, 2018. (accepted)

French-speaking conferences

  1. Damien Lolive, Nelly Barbot, and Olivier Boeffard. Proposition d'un critère MDL pour l'estimation de courbes ouvertes modélisées par des b-splines, In Actes de la 8ème Conférence Francophone sur l'Apprentissage Automatique, pages 219--234, Trégastel, France, 2006.
  2. Damien Lolive, Nelly Barbot, and Olivier Boeffard. Modélisation b-spline de contours mélodiques avec estimation du nombre de paramètres libres par un critère MDL, In Actes des XXVIèmes Journées d'Etudes sur la Parole, pages 499--502, Dinard, France, 2006. PDF
  3. Damien Lolive, Nelly Barbot, and Olivier Boeffard. Transformation de la prosodie par adaptation MLLR de GMM, In Actes des XXVIIèmes Journées d'Etudes sur la Parole, Avignon, France, 2008. PDF
  4. Olivier Boeffard, Laure Charonnat, Sébastien Le Maguer, Damien Lolive, and Gaëlle Vidal. Vers une annotation automatique de corpus audio pour la synthèse de parole, In Actes de la conférence conjointe JEP-TALN-RECITAL 2012, 2012, pp. 731–738. PDF
  5. Hiyon Yoo, Sébastien Le Maguer, Elisabeth Delais Roussarie, Nelly Barbot and Damien Lolive. Evaluation d'un algorithme de chunking appliqué à la dictée, In Actes de la conférence JEP 2014, 2014.
  6. Sébastien Le Maguer, Elisabeth Delais-Roussarie, Nelly Barbot, Mathieu Avanzi, Olivier Rosec and Damien Lolive. Algorithme de découpage en groupes prosodiques pour la dictée par l'usage de synthèse vocale, In Actes de la conférence JEP 2014, 2014.
  7. David Guennec and Damien Lolive. Utilisation d'un algorithme A* pour l'analyse de la sélection d'unité en synthèse de la parole, In Actes de la conférence JEP 2014, 2014.
  8. Jonathan Chevelu, Gwénolé Lecorvé and Damien Lolive. Roots : un outil pour manipuler facilement, efficacement et avec cohérence des corpus annotés de séquences, In Actes de la conférence JEP 2014, 2014.
  9. Elisabeth Delais-Roussarie, Damien Lolive, Hiyon Yoo and David Guennec. Patrons Rythmiques et Genres Littéraires en Synthèse de la Parole, In Actes de la conférence JEP 2016, 2016. PDF
  10. Gwénolé Lecorvé and Damien Lolive. Phonétisation statistique adaptable d'énoncés pour le français, In Actes de la conférence JEP 2016, 2016.
  11. Raheel Qader, Gwénolé Lecorvé, Damien Lolive and Pascale Sébillot. Adaptation de la prononciation pour la synthèse de la parole spontanée en utilisant des informations linguistiques, In Actes de la conférence JEP 2016, 2016.
  12. Jonathan Chevelu, Damien Lolive, Sébastien Le Maguer and David Guennec. Se concentrer sur les différences : une méthode d'évaluation subjective efficace pour la comparaison de systèmes de synthèse, In Actes de la conférence JEP 2016, 2016. PDF
  13. David Guennec and Damien Lolive. Une pénalité floue fondée phonologiquement pour améliorer la Sélection d'Unité, In Actes de la conférence JEP 2016, 2016.
  14. Sébastien Le Maguer, Bernd Moebius, Ingmar Steiner and Damien Lolive. De l'utilisation de descripteurs issus de la linguistique computationnelle dans le cadre de la synthèse par HMM, In Actes de la conférence JEP 2016, 2016.
  15. Raheel Qader, Gwénolé Lecorvé, Damien Lolive, Pascale Sébillot. Ajout automatique de disfluences pour la synthèse de la parole spontanée : formalisation et preuve de concept. Actes des Traitement Automatique du Langage Naturel (TALN), long paper, 2017. Best Paper Award PDF

Research reports

  1. Raheel Qader, Gwénolé Lecorvé, Damien Lolive and Pascale Sébillot. Phonology Modelling for Expressive Speech Synthesis: a Review, Research Report PI-2020, 2014.

Software

Roots
Open source toolkit dedicated to annotated sequential data generation, management and processing. Cite as follows:
Jonathan Chevelu, Gwénolé Lecorvé, and Damien Lolive. ROOTS: a toolkit for easy, fast and consistent processing of large sequential annotated data collections. Language Resources and Evaluation Conference (LREC), May 2014, Reykjavik, Iceland.

> More on Bitbucket
> More on INRIA GForge