TRAINING AND READS

Training and educational materials

MENHIR is a Research and Innovation Staff Exchange (RISE) project. The RISE programme represents a unique opportunity for individuals to expand their horizons, enlarge their networks, receive innovative research training and develop new career opportunities.

Thus, one of the main dimensions of MENHIR is training doctoral researchers, post-doctoral fellows as well as technicians, managerial and administrative staff in the multiple disciplines involved, which include information and communication technologies, psychology and cognitive science, conversational systems, user and conversation modelling, knowledge representation, storage and annotation, and cross-modal analysis.

The training materials developed within MENHIR are shared here openly for anybody who is interested in these topics.

Conversational systems for mental e-health

The materials presented in this section have been generated for the MENHIR 2020 Summer Doctoral School. You can find all the details in the Doctoral School website.

Icon

MENHIR Doctoral School: Intro and conversational technology for mental e-health

1 file(s) 4.83 MB
Download

Icon

MENHIR Doctoral Studies: Hands on voice user experience design

1 file(s) 118.53 KB
Download

https://youtu.be/mheapFTw6lM

Icon

MENHIR Doctoral School - Intro to conversational systems

1 file(s) 2.22 MB
Download

Icon

MENHIR Doctoral School - Anxiety and mood disorders

1 file(s) 1.49 MB
Download

Icon

MENHIR Doctoral School - Ethical issues in digital technologies and mental health

1 file(s) 625.85 KB
Download

Icon

MENHIR Doctoral School - Natural language processing machine learning for social computing

1 file(s) 1.64 MB
Download

Icon

MENHIR Doctoral School - A review of identified needs for mental health applications

1 file(s) 12.70 MB
Download

Icon

MENHIR Doctoral School - Building a chatbot with Amazon Alexa

1 file(s) 86.46 KB
Download

https://youtu.be/O3JV6QSzQso

Icon

MENHIR Doctoral School - Technology and social media in suicidal behaviour

1 file(s) 2.07 MB
Download

Icon

MENHIR Doctoral School - Timing in speech perception

1 file(s) 2.51 MB
Download

Icon

MENHIR Doctoral School - Data science for health applications

1 file(s) 19.99 MB
Download

Icon

MENHIR Doctoral School - Physiopsychological feedback and neurofeedback

1 file(s) 5.38 MB
Download

Icon

MENHIR Doctoral School - Using physiological sensors for automatic emotion recognition

1 file(s) 4.07 MB
Download

Icon

MENHIR Doctoral School - Eye tracking and attention detection

1 file(s) 21.63 MB
Download

Icon

MENHIR Doctoral School - Measuring human behaviour by sensing everyday mobile interactions

1 file(s) 3.01 MB
Download

Icon

MENHIR Doctoral School - Social-affective interaction with virtual agents

1 file(s) 2.12 MB
Download

Open Educational resources

Icon

Open educational resources - Licences and repositories

1 file(s) 1.76 MB
Download

Icon

Open Educational Resources - Licences and repositories (slides)

1 file(s) 5.13 MB
Download

MENHIR Scientific publications, videos and slides

You can find our scientific publications in the dissemination section, and videos and slides at the end of the downloads section.

Training events organized by MENHIR

Internacional Doctoral Summer School in Conversational Systems

Registration is now open for the Internacional Doctoral Summer School in Conversational Systems for Health Applications that will take place in the beutiful Carmen de la Victoria (Granada, Spain) from 31st August to 3rd September 2022. The school provides a platform for getting to know and discuss current approaches and research streams in the field …

Internacional Doctoral Summer School in Conversational Systems Read More »

MENHIR International Doctoral Summer School in Conversational Systems for Mental e-health

Dates: 5-9 October 2020 Web: https://menhir-project.eu/index.php/summer-school-home/ The summer school on Conversational Systems for Mental e-health aims to provide innovative training for early stage researchers ​ (ESR) ​ in the application of conversational systems to the e-health and wellbeing domains​ . The school is mainly targeting postgraduate students (PhD and master), but it is also open …

MENHIR International Doctoral Summer School in Conversational Systems for Mental e-health Read More »

Training on Open Educational Resources

Zoraida Callejas has participated as lecturer in the course “Digital Educational Resources in the Universitary Context”, as part of the Plan for Teacher Training and Innovation of the University of Granada. She has described Creative Common (CC) licences, explained how to search for CC multimedia resources, and how to use them. She has also introduced …

Training on Open Educational Resources Read More »

Fería de las ingenierías

MENHIR inspiring scientific and technological vocations

Our colleague David Griol from University of Granada (UGR) has participated today in the event Feria de las Ingenierías, organized by UGR to develop scientific and technological vocations in middle and high school students. The students have visited different schools at UGR related to science and technology studies, where they have been engaged in different …

MENHIR inspiring scientific and technological vocations Read More »

RTTHSS2019: Summer School on Speech Technologies

María Inés Torres (UPV) will give a lecture on VoiceBots in the RTTH Summer School 2019 (RTTHSS2019). The school is sponsored by the Spanish Red Temática en Tecnologías del Habla (RTTH) and organized by the Speech and Natural Language Technologies Department of Vicomtech. The RTTHSS2019 will take place in Donostia-San Sebastián (Spain), from July 2nd to July 5th …

RTTHSS2019: Summer School on Speech Technologies Read More »

Reading list

We have a Zotero group to share interesting papers, books, and web pages related to MENHIR topics. The contents of the group are public and listed below. You can also check them here.

If you want to know about the publications produced within MENHIR, please check the dissemination section or subscribe to our newsletter.

de Velasco, M., Justo, R., López Zorrilla, A., & Torres, M. I. (2023). Analysis of Deep Learning-Based Decision-Making in an Emotional Spontaneous Speech Task. Applied Sciences, 13(2), 980. https://doi.org/10.3390/app13020980
Batliner, A., Neumann, M., Burkhardt, F., Baird, A., Meyer, S., Vu, N. T., & Schuller, B. W. (2022). Ethical Awareness in Paralinguistics: A Taxonomy of Applications. International Journal of Human–Computer Interaction, 0(0), 1–18. https://doi.org/10.1080/10447318.2022.2140385
Greco, C., Esposito, A., Cordasco, G., & Matarazzo, O. (2022). Reciprocity versus Self-Interest in a Competitive Interaction Context: An Experimental Study. Psychological Reports, 00332941221129137. https://doi.org/10.1177/00332941221129137
Oetzmann, C., White, K. M., Ivan, A., Julie, J., Leightley, D., Lavelle, G., Lamers, F., Siddi, S., Annas, P., Garcia, S. A., Haro, J. M., Mohr, D. C., Penninx, B. W. J. H., Simblett, S. K., Wykes, T., Narayan, V. A., Hotopf, M., & Matcham, F. (2022). Lessons learned from recruiting into a longitudinal remote measurement study in major depressive disorder. Npj Digital Medicine, 5(1), 1–8. https://doi.org/10.1038/s41746-022-00680-z
Raimo, G., Conson, M., Amorese, T., Cuciniello, M., Greco, C., Cordasco, G., Carrión, Z. C., Glackin, C., & Esposito, A. (2022). The Role of Language in Building Automatic Models for Depression Detection. 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), 1–6. https://doi.org/10.1109/DASC/PiCom/CBDCom/Cy55231.2022.9927925
Shrestha, R., Glackin, C., Wall, J., Cannings, N., Rajwadi, M., Kada, S., Laird, J., Laird, T., & Woodruff, C. (2022). Speaker Recognition using Multiple X-Vector Speaker Representations with Two-Stage Clustering and Outlier Detection Refinement. 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), 1–6. https://doi.org/10.1109/DASC/PiCom/CBDCom/Cy55231.2022.9927875
Griol, D., Callejas, Z., Fernández-Martínez, F., & Esposito, A. (2022). An application of conversational systems to promote healthy lifestyle habits. 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), 1–6. https://doi.org/10.1109/DASC/PiCom/CBDCom/Cy55231.2022.9927835
Cuciniello, M., Amorese, T., Greco, C., Raimo, G., Cordasco, G., Kornes, M. S., Torp Johansen, A., Gjellesvik, K. B., Fernandez, A., Kyslitska, D., González-Fraile, E., Fernández-Ruanova, B., Tenorio-Laranga, J., Torres, M. I., & Esposito, A. (2022). A cross-cultural survey to identify Seniors’ preferences towards the Empathic Virtual Coach. 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech), 1–6. https://doi.org/10.1109/DASC/PiCom/CBDCom/Cy55231.2022.9927961
Esposito, A., Amorese, T., Cuciniello, M., Riviello, M. T., & Cordasco, G. (2022). Age and gender effects on the human’s ability to decode posed and naturalistic emotional faces. Pattern Analysis and Applications, 25(3), 589–617. https://doi.org/10.1007/s10044-021-01049-w
Matcham, F., Carr, E., White, K. M., Leightley, D., Lamers, F., Siddi, S., Annas, P., de Girolamo, G., Haro, J. M., Horsfall, M., Ivan, A., Lavelle, G., Li, Q., Lombardini, F., Mohr, D. C., Narayan, V. A., Penninx, B. W. H. J., Oetzmann, C., Coromina, M., … Hotopf, M. (2022). Predictors of engagement with remote sensing technologies for symptom measurement in Major Depressive Disorder. Journal of Affective Disorders, 310, 106–115. https://doi.org/10.1016/j.jad.2022.05.005
Greco, C., Amorese, T., Cuciniello, M., Cordasco, G., & Esposito, A. (2022). Android Robots vs Virtual Agents: which system differently aged users prefer? 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), 1–7. https://doi.org/10.1109/RO-MAN53752.2022.9900850
Koulouri, T., Macredie, R. D., & Olakitan, D. (2022). Chatbots to Support Young Adults’ Mental Health: An Exploratory Study of Acceptability. ACM Transactions on Interactive Intelligent Systems, 12(2), 11:1-11:39. https://doi.org/10.1145/3485874
Eagle, T., Blau, C., Bales, S., Desai, N., Li, V., & Whittaker, S. (2022). “I don’t know what you mean by `I am anxious’”: A New Method for Evaluating Conversational Agent Responses to Standardized Mental Health Inputs for Anxiety and Depression. ACM Transactions on Interactive Intelligent Systems, 12(2), 12:1-12:23. https://doi.org/10.1145/3488057 Download
Nossier, S. A., Wall, J., Moniri, M., Glackin, C., & Cannings, N. (2022). Two-Stage Deep Learning Approach for Speech Enhancement and Reconstruction in The Frequency and Time Domains. 2022 International Joint Conference on Neural Networks (IJCNN), 1–10. https://doi.org/10.1109/IJCNN55064.2022.9892355
Iyer, S., Glackin, C., Cannings, N., Veneziano, V., & Sun, Y. (2022). A Comparison Between Convolutional and Transformer Architectures for Speech Emotion Recognition. 2022 International Joint Conference on Neural Networks (IJCNN), 1–8. https://doi.org/10.1109/IJCNN55064.2022.9891882
Amorese, T., Cuciniello, M., Vinciarelli, A., Cordasco, G., & Esposito, A. (2022). Synthetic vs Human Emotional Faces: What Changes in Humans’ Decoding Accuracy. IEEE Transactions on Human-Machine Systems, 52(3), 390–399. https://doi.org/10.1109/THMS.2021.3129714
Zhang, T., Schoene, A. M., Ji, S., & Ananiadou, S. (2022). Natural language processing applied to mental illness detection: a narrative review. Npj Digital Medicine, 5(1), 1–13. https://doi.org/10.1038/s41746-022-00589-7 Download
Esposito, A., Cuciniello, M., Amorese, T., Vinciarelli, A., & Cordasco, G. (2022). Humanoid and android robots in the imaginary of adolescents, young adults and seniors. Journal of Ambient Intelligence and Humanized Computing. https://doi.org/10.1007/s12652-022-03806-z
Ahmad, R., Siemon, D., Gnewuch, U., & Robra-Bissantz, S. (2022). Designing Personality-Adaptive Conversational Agents for Mental Health Care. Information Systems Frontiers. https://doi.org/10.1007/s10796-022-10254-9
Alqahtani, F., Orji, R., Riper, H., Mccleary, N., Witteman, H., & Mcgrath, P. (2022). Motivation-based approach for tailoring persuasive mental health applications. Behaviour & Information Technology, 0(0), 1–27. https://doi.org/10.1080/0144929X.2022.2031296
Fernández-Martínez, F., Luna-Jiménez, C., Kleinlein, R., Griol, D., Callejas, Z., & Montero, J. M. (2022). Fine-Tuning BERT Models for Intent Recognition Using a Frequency Cut-Off Strategy for Domain-Specific Vocabulary Extension. Applied Sciences, 12(3), 1610. https://doi.org/10.3390/app12031610
Luna-Jiménez, C., Kleinlein, R., Griol, D., Callejas, Z., Montero, J. M., & Fernández-Martínez, F. (2022). A Proposal for Multimodal Emotion Recognition Using Aural Transformers and Action Units on RAVDESS Dataset. Applied Sciences, 12(1), 327. https://doi.org/10.3390/app12010327
Luna-Jiménez, C., Kleinlein, R., Griol, D., Callejas, Z., Montero, J. M., & Fernández-Martínez, F. (2022). A Proposal for Multimodal Emotion Recognition Using Aural Transformers and Action Units on RAVDESS Dataset. Applied Sciences, 12(1), 327. https://doi.org/10.3390/app12010327
Shevleva, O., Cordasco, G., Vogel, C., & Esposito, A. (2022). On Features and Measures of Psychological Wellbeing. Journal of Health Science Studies, 2(1). http://www.annexpublishers.com/articles/JHSS/2101-On-Features-and-Measures-of-Psychological-Wellbeing.pdf
Shrestha, R., Glackin, C., Wall, J., & Cannings, N. (2022). Intelligent Voice Speaker Recognition and Diarization System for IberSpeech 2022 Albayzin Evaluations Speaker Diarization and Identity Assignment Challenge. Proc. IberSPEECH 2022, 281–283.
Zubiaga, I., & Justo, R. (2022). Multimodal Feature Evaluation and Fusion for Emotional Well-Being Monitorization. In A. J. Pinho, P. Georgieva, L. F. Teixeira, & J. A. Sánchez (Eds.), Pattern Recognition and Image Analysis (pp. 242–254). Springer International Publishing. https://doi.org/10.1007/978-3-031-04881-4_20
Esposito, A., Amorese, T., Cuciniello, M., Cavallo, F., Vinciarelli, A., & Cordasco, G. (2022). Comparing Middle-Aged and Seniors’ Preferences Toward Virtual Agents and Android Robots: Is There a Generational Shift in Assistive Technologies’ Preferences? In A. Bettelli, A. Monteriù, & L. Gamberini (Eds.), Ambient Assisted Living (pp. 85–101). Springer International Publishing. https://doi.org/10.1007/978-3-031-08838-4_6
Cañas, P., Griol, D., & Callejas, Z. (2022). A Proposal for Developing and Deploying Statistical Dialog Management in Commercial Conversational Platforms. In P. García Bringas, H. Pérez García, F. J. Martínez de Pisón, J. R. Villar Flecha, A. Troncoso Lora, E. A. de la Cal, Á. Herrero, F. Martínez Álvarez, G. Psaila, H. Quintián, & E. Corchado (Eds.), Hybrid Artificial Intelligent Systems (pp. 405–416). Springer International Publishing. https://doi.org/10.1007/978-3-031-15471-3_35
Griol, D., & Callejas, Z. (2022). A Comparison of Learning Approaches to Dialogue Management in Conversational Systems. In H. Sanjurjo González, I. Pastor López, P. García Bringas, H. Quintián, & E. Corchado (Eds.), 16th International Conference on Soft Computing Models in Industrial and Environmental Applications (SOCO 2021) (pp. 68–77). Springer International Publishing. https://doi.org/10.1007/978-3-030-87869-6_7
Esposito, A., Vinciarelli, A., & Cordasco, G. (2022). A Research Agenda for Dementia Care: Prevention, Risk Mitigation and Personalized Interventions. In G. A. Tsihrintzis, M. Virvou, A. Esposito, & L. C. Jain (Eds.), Advances in Assistive Technologies: Selected Papers in Honour of Professor Nikolaos G. Bourbakis – Vol. 3 (pp. 33–42). Springer International Publishing. https://doi.org/10.1007/978-3-030-87132-1_3
Lidholm, L. (2022). Wearing Your Heart on Your Sleeve? EmoWri: A Wearable Tool to Start Sensitive Conversations : A Case Study with Parents and their Teenage Children. http://urn.kb.se/resolve?urn=urn:nbn:se:sh:diva-49317
Guidelines 02/2021 on Virtual Voice Assistants | European Data Protection Board. (2022). https://edpb.europa.eu/our-work-tools/documents/public-consultations/2021/guidelines-022021-virtual-voice-assistants_en
Bayerl, S. P., Tammewar, A., Riedhammer, K., & Riccardi, G. (2021). Detecting Emotion Carriers by Combining Acoustic and Lexical Representations. ArXiv:2112.06603 [Cs, Eess]. http://arxiv.org/abs/2112.06603
Cañas, P., Griol, D., & Callejas, Z. (2021). Towards versatile conversations with data-driven dialog management and its integration in commercial platforms. Journal of Computational Science, 55, 101443. https://doi.org/10.1016/j.jocs.2021.101443
Cañas, P., Griol, D., & Callejas, Z. (2021). Towards versatile conversations with data-driven dialog management and its integration in commercial platforms. Journal of Computational Science, 55, 101443. https://doi.org/10.1016/j.jocs.2021.101443
Greco, C., Buono, C., Buch-Cardona, P., Cordasco, G., Escalera, S., Esposito, A., Fernandez, A., Kyslitska, D., Kornes, M. S., Palmero, C., Laranga, J. T., Johansen, A. T., & Torres, M. I. (2021). Emotional Features of Interactions with Empathic Agents. 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), 2168–2176. https://doi.org/10.1109/ICCVW54120.2021.00246
Potts, C., Ennis, E., Bond, R. B., Maurice, M. D., McTear, M. F., Boyd, K., Broderick, T., Malcolm, M., Kuosmanen, L., Nieminen, H., Vartiainen, A. K., Kostenius, C., Cahill, B., Vakaloudis, A., McConvey, G., & O’Neill, S. (2021). Chatbots to Support Mental Wellbeing of People Living in Rural Areas: Can User Groups Contribute to Co-design? Journal of Technology in Behavioral Science. https://doi.org/10.1007/s41347-021-00222-6
Sweeney, C., Potts, C., Ennis, E., Bond, R., Mulvenna, M. D., O’neill, S., Malcolm, M., Kuosmanen, L., Kostenius, C., Vakaloudis, A., Mcconvey, G., Turkington, R., Hanna, D., Nieminen, H., Vartiainen, A.-K., Robertson, A., & Mctear, M. F. (2021). Can Chatbots Help Support a Person’s Mental Health? Perceptions and Views from Mental Healthcare Professionals and Experts. ACM Transactions on Computing for Healthcare, 2(3), 25:1-25:15. https://doi.org/10.1145/3453175
Artola, A., Callejas, Z., & Griol, D. (2021). A Modular Architecture for Multi-Purpose Conversational System Development. In E. Bashir & M. Luštrek (Eds.), Ambient Intelligence and Smart Environments. IOS Press. https://doi.org/10.3233/AISE210077
Matějů, L., Griol, D., Callejas, Z., Molina, J. M., & Sanchis, A. (2021). An empirical assessment of deep learning approaches to task-oriented dialog management. Neurocomputing, 439, 327–339. https://doi.org/10.1016/j.neucom.2020.01.126
Lutz, C., & Newlands, G. (2021). Privacy and smart speakers: A multi-dimensional approach. The Information Society, 37(3), 147–162. https://doi.org/10.1080/01972243.2021.1897914
Vaidyam, A. N., Linggonegoro, D., & Torous, J. (2021). Changes to the Psychiatric Chatbot Landscape: A Systematic Review of Conversational Agents in Serious Mental Illness: Changements du paysage psychiatrique des chatbots: une revue systématique des agents conversationnels dans la maladie mentale sérieuse. The Canadian Journal of Psychiatry, 66(4), 339–348. https://doi.org/10.1177/0706743720966429
Callejas, Z., Griol, D., Benghazi, K., Noguera, M., Torres, M. I., Justo, R., Esposito, A., Cordasco, G., Bond, R., Mulvenna, M., Ennis, E., O’Neill, S., Zheng, H., Kraus, M., Wagner, N., Minker, W., McConvey, G., Hemmje, M., Fuchs, M., … Chollet, G. (2021). Towards conversational technology to promote, monitor and protect mental health. IberSPEECH 2021, 148–150. https://doi.org/10.21437/IberSPEECH.2021-32
Móstoles, R., Griol, D., Callejas, Z., & Fernández-Martínez, F. (2021). A proposal for emotion recognition using speech features, transfer learning and convolutional neural networks. IberSPEECH 2021, 56–60. https://doi.org/10.21437/IberSPEECH.2021-12
Yang, S., Lee, J., Sezgin, E., Bridge, J., & Lin, S. (2021). Clinical Advice by Voice Assistants on Postpartum Depression: Cross-Sectional Investigation Using Apple Siri, Amazon Alexa, Google Assistant, and Microsoft Cortana. JMIR MHealth and UHealth, 9(1), e24045. https://doi.org/10.2196/24045
Luna-Jiménez, C., Griol, D., Callejas, Z., Kleinlein, R., Montero, J. M., & Fernández-Martínez, F. (2021). Multimodal Emotion Recognition on RAVDESS Dataset Using Transfer Learning. Sensors, 21(22), 7665. https://doi.org/10.3390/s21227665
Luna-Jiménez, C., Griol, D., Callejas, Z., Kleinlein, R., Montero, J. M., & Fernández-Martínez, F. (2021). Multimodal Emotion Recognition on RAVDESS Dataset Using Transfer Learning. Sensors, 21(22), 7665. https://doi.org/10.3390/s21227665
Kraus, M., Seldschopf, P., & Minker, W. (2021). Towards the Development of a Trustworthy Chatbot for Mental Health Applications. In J. Lokoč, T. Skopal, K. Schoeffmann, V. Mezaris, X. Li, S. Vrochidis, & I. Patras (Eds.), MultiMedia Modeling (pp. 354–366). Springer International Publishing. https://doi.org/10.1007/978-3-030-67835-7_30
Esposito, A., Faundez-Zanuy, M., Morabito, F. C., & Pasero, E. (2021). Towards Socially and Emotionally Believable ICT Interfaces. In A. Esposito, M. Faundez-Zanuy, F. C. Morabito, & E. Pasero (Eds.), Progresses in Artificial Intelligence and Neural Systems (pp. 3–7). Springer. https://doi.org/10.1007/978-981-15-5093-5_1
Kraus, M., Wagner, N., Callejas, Z., & Minker, W. (2021). The Role of Trust in Proactive Conversational Assistants. IEEE Access, 9, 112821–112836. https://doi.org/10.1109/ACCESS.2021.3103893
X