publications
My Academic Thesis Work
2016 PhD Modeling Affection Mechanisms using Deep and Self-Organizing Neural Networks Universität Hamburg, Hamburg, Germany
2013 MSc Um Sistema Para Reconhecimento e Previsão de Gestos ( in Portuguese) Universidade de Pernambuco, Recife, Brazil
2011 BSc Projeto PaMDA - um framework semântico para geração de sistemas ( in Portuguese) Universidade Federal Rural de Pernambuco, Serra Talhada, Brazil
My Publications
2025
- Toward a positive emotion-elicitation human–robot interaction: positive emotion recognition with multimodal inputsIn Digital Technology in Public Health and Rehabilitation Care, 2025
2024
- The use of reinforcement learning algorithms in object tracking: A systematic literature reviewNeurocomputing, 2024
2023
- Incorporating rivalry in reinforcement learning for a competitive gameNeural Computing and Applications, 2023
- Human-aligned reinforcement learning for autonomous agents and robotsNeural Computing and Applications, 2023
2022
- Affect-driven learning of robot behaviour for collaborative human-robot interactionsFrontiers in Robotics and AI, 2022
- All by myself: learning individualized competitive behavior with a contrastive reinforcement learning optimizationNeural Networks, 2022
- OneFall-GAN: A one-class GAN framework applied to fall detectionEngineering Science and Technology, an International Journal, 2022
- Ciao! a contrastive adaptation mechanism for non-universal facial expression recognitionIn 2022 10th International Conference on Affective Computing and Intelligent Interaction (ACII), 2022
- Affective shared perception2022
- Across the universe: biasing facial representations toward non-universal emotions with the face-STNIEEE Access, 2022
- I am Only Happy When There is Light: The Impact of Environmental Changes on Affective Facial Expressions RecognitionarXiv preprint arXiv:2210.17421, 2022
2021
- A sub-layered hierarchical pyramidal neural architecture for facial expression recognitionarXiv preprint arXiv:2103.12362, 2021
- Learning from learners: Adapting reinforcement learning agents to be competitive in a card gameIn 2020 25th International Conference on Pattern Recognition (ICPR), 2021
- Do i have a personality? endowing care robots with context-dependent personality traitsInternational Journal of Social Robotics, 2021
- A multimodal approach using deep learning for fall detectionExpert Systems with Applications, 2021
- It’s food fight! Designing the chef’s hat card game for affective-aware HRIIn Companion of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, 2021
- I only have eyes for you: The impact of masks on convolutional-based facial expression recognitionIn Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021
- A framework for anomaly identification applied on fall detectionIEEE Access, 2021
- You were always on my mind: introducing chef’s hat and copper for personalized reinforcement learningFrontiers in Robotics and AI, 2021
- Affect-aware learning for social robotsIn Adjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization, 2021
- Special Issue on Automated Perception of Human Affect from Longitudinal Behavioral DataIEEE Transactions on Affective Computing, 2021
- How can AI recognize pain and express empathyarXiv preprint, 2021
2020
- iCub: learning emotion expressions using human rewardarXiv preprint arXiv:2003.13483, 2020
- Understanding auditory representations of emotional expressions with neural networksNeural Computing and Applications, 2020
- What can computational models learn from human selective attention? A review from an audiovisual unimodal and crossmodal perspectiveFrontiers in integrative neuroscience, 2020
- The Chef’s Hat Simulation Environment for Reinforcement-Learning-Based AgentsarXiv preprint arXiv:2003.05861, 2020
- Improving emotional expression recognition of robots using regions of interest from human dataIn Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020
- Cnn encoder to reduce the dimensionality of data image for motion planningarXiv preprint arXiv:2004.05077, 2020
- The facechannel: a fast and furious deep neural network for facial expression recognitionSN Computer Science, 2020
- Adapting the interplay between personalized and generalized affect recognition based on an unsupervised neural frameworkIEEE Transactions on Affective Computing, 2020
- Moody learners-explaining competitive behaviour of reinforcement learning agentsIn 2020 Joint IEEE 10th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), 2020
- Performance Improvement of Path Planning algorithms with Deep Learning Encoder ModelIn 2020 Joint IEEE 10th International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), 2020
- Analysis of Social Robotic Navigation approaches: CNN Encoder and Incremental Learning as an alternative to Deep Reinforcement LearningarXiv preprint arXiv:2008.07965, 2020
- The facechannels: Strike of the sequences for the affwild 2 challengearXiv preprint arXiv:2010.01557, 2020
- Sensing the partner: Toward effective robot tutoring in motor skill learningIn Social Robotics: 12th International Conference, ICSR 2020, Golden, CO, USA, November 14–18, 2020, Proceedings 12, 2020
- Analysis of Professional Skills Using Growing Hierarchical Self-Organizing MapIn 2020 IEEE Congreso Bienal de Argentina (ARGENCON), 2020
- Multimodal Integration for Empathy RecognitionUniversität Hamburg, 2020
- Affect-driven modelling of robot personality for collaborative human-robot interactionsarXiv preprint arXiv:2010.07221, 2020
2019
- Towards real-time ball localization using cnnsIn RoboCup 2018: Robot World Cup XXII 22, 2019
- A personalized affective memory neural model for improving emotion recognitionarXiv preprint arXiv:1904.12632, 2019
- A personalized affective memory model for improving emotion recognitionIn International Conference on Machine Learning, 2019
- A Neurorobotic Experiment for Crossmodal Conflict ResolutionIn Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2019
- Facial expression editing with continuous emotion labelsIn 2019 14th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2019), 2019
- Towards Learning How to Properly Play UNO with the iCub RobotarXiv preprint arXiv:1908.00744, 2019
- The omg-empathy dataset: Evaluating the impact of affective behavior in storytellingIn 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII), 2019
- The conditional boundary equilibrium generative adversarial network and its application to facial attributesIn 2019 International Joint Conference on Neural Networks (IJCNN), 2019
- Expectation learning for stimulus prediction across modalities improves unisensory classificationFrontiers in Robotics and AI, 2019
- Exploring Low-level and High-level Transfer Learning for Multi-task Facial Recognition with a Semi-supervised Neural NetworkIn 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019
- What can computational models learn from human selective attention? A review from an audiovisual crossmodal perspectivearXiv preprint arXiv:1909.05654, 2019
- The interplay of knowledge representation with various fields of artificial intelligence in medicineYearbook of medical informatics, 2019
2018
- A neurorobotic experiment for crossmodal conflict resolution in complex environmentsIn 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018
- The OMG-emotion behavior datasetIn 2018 International Joint Conference on Neural Networks (IJCNN), 2018
- Towards Modeling the Interaction of Spatial-Associative Neural Network Representations for Multisensory PerceptionarXiv preprint arXiv:1807.05222, 2018
- Learning empathy-driven emotion expressions using affective modulationsIn 2018 International joint conference on neural networks (IJCNN), 2018
- An Affective Robot Companion for Assisting the Elderly in a Cognitive Game ScenarioarXiv preprint arXiv:1807.09825, 2018
- A deep neural model of emotion appraisalarXiv preprint arXiv:1808.00252, 2018
- Semi-supervised model for emotion recognition in speechIn Artificial Neural Networks and Machine Learning–ICANN 2018: 27th International Conference on Artificial Neural Networks, Rhodes, Greece, October 4-7, 2018, Proceedings, Part I 27, 2018
- De-noise-GAN: De-noising Images to Improve RoboCup Soccer Ball DetectionIn Artificial Neural Networks and Machine Learning–ICANN 2018: 27th International Conference on Artificial Neural Networks, Rhodes, Greece, October 4-7, 2018, Proceedings, Part III 27, 2018
- Expectation learning and crossmodal modulation with a deep adversarial networkIn 2018 International Joint Conference on Neural Networks (IJCNN), 2018
- Assessing the contribution of semantic congruency to multisensory integration and conflict resolutionarXiv preprint arXiv:1810.06748, 2018
- An ensemble with shared representations based on convolutional networks for continually learning facial expressionsIn 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018
- Disambiguating affective stimulus associations for robot perception and dialogueIn 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids), 2018
- Epilepsy Surgery in Antibody-Associated Autoimmune Encephalitis and Epilepsies: Review of LiteratureJournal of Pediatric Epilepsy, 2018
2017
- Ball localization for robocup soccer using convolutional neural networksIn RoboCup 2016: Robot World Cup XX 20, 2017
- Emotion-modulated attention improves expression recognition: A deep learning modelNeurocomputing, 2017
- A Deep Neural Model for Emotion-Driven Multimodal AttentionIn 2017 AAAI Spring Symposium Series, 2017
- A dynamic gesture recognition and prediction system using the convexity approachComputer Vision and Image Understanding, 2017
- An analysis of convolutional long short-term memory recurrent neural networks for gesture recognitionNeurocomputing, 2017
- Teaching emotion expressions to a human companion robot using deep neural architecturesIn 2017 international joint conference on neural networks (IJCNN), 2017
- A self-organizing model for affective memoryIn 2017 International Joint Conference on Neural Networks (IJCNN), 2017
- Emotion recognition from body expressions with a neural network architectureIn Proceedings of the 5th international conference on human agent interaction, 2017
- Expectation Learning for Adaptive Crossmodal Stimuli AssociationIn EUCog Meeting, 2017
- Extreme learning machine autoencoder for data augmentationIn 2017 IEEE Latin American Conference on Computational Intelligence (LA-CCI), 2017
- Human action recognition with 3D convolutional neural networkIn 2017 IEEE Latin American Conference on Computational Intelligence (LA-CCI), 2017
- A computational model of crossmodal processing for conflict resolutionIn 2017 joint ieee international conference on development and learning and epigenetic robotics (icdl-epirob), 2017
2016
- Developing crossmodal expression recognition based on a deep neural modelAdaptive behavior, 2016
- Understanding how deep neural networks learn face expressionsIn 2016 International Joint Conference on Neural Networks (IJCNN), 2016
- Gesture Recognition with a Convolutional Long Short-Term Memory Recurrent Neural Network.In ESANN, 2016
- Learning auditory neural representations for emotion recognitionIn 2016 International Joint Conference on Neural Networks (IJCNN), 2016
- The effects of regularization on learning facial expressions with convolutional neural networksIn Artificial Neural Networks and Machine Learning–ICANN 2016: 25th International Conference on Artificial Neural Networks, Barcelona, Spain, September 6-9, 2016, Proceedings, Part II 25, 2016
- Modeling affection mechanisms using deep and self-organizing neural networksStaats-und Universitätsbibliothek Hamburg Carl von Ossietzky, 2016
2015
- Multimodal emotional state recognition using sequence-dependent deep hierarchical featuresNeural Networks, 2015
- Emotional expression recognition with a cross-channel convolutional neural network for human-robot interactionIn 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), 2015
- Face expression recognition with a 2-channel convolutional neural networkIn 2015 international joint conference on neural networks (IJCNN), 2015
- Learning objects from RGB-D sensors using point cloud-based neural networks.In ESANN, 2015
- Dynamic gesture recognition using Echo State Networks.In ESANN, 2015
- Recognizing complex mental states with deep hierarchical features for Human-Robot InteractionIn 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2015
- Humanoidly speaking–learning about the world and language with a humanoid friendly robotIn International Joint Conference on Artificial Intelligence Video competition, 2015
- Humanoidly Speaking-How the Nao humanoid robot can learn the name of objects and interact with them through common speechIn International Joint Conference on Artificial Neural Networks–IJCAI, Video Competition, 2015
2014
- Real-time gesture recognition using a humanoid robot with a deep neural architectureIn 2014 IEEE-RAS International Conference on Humanoid Robots, 2014
- A multichannel convolutional neural network for hand posture recognitionIn Artificial Neural Networks and Machine Learning–ICANN 2014: 24th International Conference on Artificial Neural Networks, Hamburg, Germany, September 15-19, 2014. Proceedings 24, 2014
- FINGeR: Framework for interactive neural-based gesture recognition.In ESANN, 2014
- Learning objects from rgb-d sensors for cleaning tasks using a team of cooperative humanoid robotsAdvances in Autonomous Robotics Systems, 2014
- Real-time gesture recognition using a humanoid robot with a deep neural architecture. In 2014 IEEE-RAS International Conference on Humanoid Robots2014
2013
- Convexity local contour sequences for gesture recognitionIn Proceedings of the 28th Annual ACM Symposium on Applied Computing, 2013
- An effective dynamic gesture recognition system based on the feature vector reduction for SURF and LCSIn Artificial Neural Networks and Machine Learning–ICANN 2013: 23rd International Conference on Artificial Neural Networks Sofia, Bulgaria, September 10-13, 2013. Proceedings 23, 2013
- A dynamic gesture prediction system based on the clcs feature extractionIn 2013 BRICS Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence, 2013
2012
- Desenvolvendo soluções com interface baseada em vozSociedade Brasileira de Computação, 2012
- Tutoriais do XI Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais2012