Prof. Dr. Ricardo Usbeck left SDA. The profile below reflects the status at the point of his departure and is no longer updated.

Lead Research Engineer
Enterprise Information System
Fraunhofer IAIS Dresden
Room 4.34.3
Zwickauer Str. 46, 01069 Dresden, Germany
Short CV
Prof. Dr. Ricardo Usbeck is a Lead Research Engineer at the Enterprise Information System of the Fraunhofer IAIS Dresden.
Research Interests
- Question Answering
- Natural Language Processing
- Semantic Web
- Machine Learning
- Dialog Systems
Projects
Publications
2022
RoMe: A Robust Metric for Evaluating Natural Language Generation Proceedings Article
In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22-27, 2022, pp. 5645–5657, Association for Computational Linguistics, 2022.
Measuring Gender Bias in German Language Generation Proceedings Article
In: 52. Jahrestagung der Gesellschaft für Informatik, INFORMATIK 2022, Informatik in den Naturwissenschaften, 26. - 30. September 2022, Hamburg, pp. 1257–1274, Gesellschaft für Informatik, Bonn, 2022.
The Lifecycle of "Facts": A Survey of Social Bias in Knowledge Graphs Proceedings Article
In: Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, AACL/IJCNLP 2022 - Volume 1: Long Papers, Online Only, November 20-23, 2022, pp. 639–652, Association for Computational Linguistics, 2022.
Knowledge Graph Question Answering Leaderboard: A Community Resource to Prevent a Replication Crisis Proceedings Article
In: Proceedings of the Thirteenth Language Resources and Evaluation Conference, LREC 2022, Marseille, France, 20-25 June 2022, pp. 2998–3007, European Language Resources Association, 2022.
DialoKG: Knowledge-Structure Aware Task-Oriented Dialogue Generation Proceedings Article
In: Findings of the Association for Computational Linguistics: NAACL 2022, Seattle, WA, United States, July 10-15, 2022, pp. 2557–2571, Association for Computational Linguistics, 2022.
QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia and Wikidata Translated by Native Speakers Proceedings Article
In: 16th IEEE International Conference on Semantic Computing, ICSC 2022, Laguna Hills, CA, USA, January 26-28, 2022, pp. 229–234, IEEE, 2022.
Modern Baselines for SPARQL Semantic Parsing Proceedings Article
In: SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022, pp. 2260–2265, ACM, 2022.
Knowledge Graph Question Answering Datasets and Their Generalizability: Are They Enough for Future Research? Proceedings Article
In: SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022, pp. 3209–3218, ACM, 2022.
Tree-KGQA: An Unsupervised Approach for Question Answering Over Knowledge Graphs Journal Article
In: IEEE Access, vol. 10, pp. 50467–50478, 2022.
Survey on English Entity Linking on Wikidata: Datasets and approaches Journal Article
In: Semantic Web, vol. 13, no. 6, pp. 925–966, 2022.
2021
Proxy Indicators for the Quality of Open-domain Dialogues Proceedings Article
In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021, pp. 7834–7855, Association for Computational Linguistics, 2021.
Knowledge Graph Question Answering Using Graph-Pattern Isomorphism Proceedings Article
In: Further with Knowledge Graphs - Proceedings of the 17th International Conference on Semantic Systems, SEMANTiCS 2017, Amsterdam, The Netherlands, September 6-9, 2021, pp. 103–117, IOS Press, 2021.
Template-based Question Answering using Recursive Neural Networks Proceedings Article
In: 15th IEEE International Conference on Semantic Computing, ICSC 2021, Laguna Hills, CA, USA, January 27-29, 2021, pp. 195–198, IEEE, 2021.
2020
Language Model Transformers as Evaluators for Open-domain Dialogues Proceedings Article
In: Proceedings of the 28th International Conference on Computational Linguistics, COLING 2020, Barcelona, Spain (Online), December 8-13, 2020, pp. 6797–6808, International Committee on Computational Linguistics, 2020.
Message Passing for Hyper-Relational Knowledge Graphs Proceedings Article
In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, EMNLP 2020, Online, November 16-20, 2020, pp. 7346–7359, Association for Computational Linguistics, 2020.
Treating Dialogue Quality Evaluation as an Anomaly Detection Problem Proceedings Article
In: Proceedings of The 12th Language Resources and Evaluation Conference, LREC 2020, Marseille, France, May 11-16, 2020, pp. 508–512, European Language Resources Association, 2020.
Towards an Interoperable Ecosystem of AI and LT Platforms: A Roadmap for the Implementation of Different Levels of Interoperability Proceedings Article
In: Proceedings of the 1st International Workshop on Language Technology Platforms, IWLTP@LREC 2020, Marseille, France, May 2020, pp. 96–107, European Language Resources Association, 2020.
2019
An Approach for Ex-Post-Facto Analysis of Knowledge Graph-Driven Chatbots - The DBpedia Chatbot Proceedings Article
In: Chatbot Research and Design - Third International Workshop, CONVERSATIONS 2019, Amsterdam, The Netherlands, November 19-20, 2019, Revised Selected Papers, pp. 19–33, Springer, 2019.
QUANT - Question Answering Benchmark Curator Proceedings Article
In: Semantic Systems. The Power of AI and Knowledge Graphs - 15th International Conference, SEMANTiCS 2019, Karlsruhe, Germany, September 9-12, 2019, Proceedings, pp. 343–358, Springer, 2019.
Offline Question Answering over Linked Data using Limited Resources Proceedings Article
In: Proceedings of the Posters and Demo Track of the 15th International Conference on Semantic Systems co-located with 15th International Conference on Semantic Systems (SEMANTiCS 2019), Karlsruhe, Germany, September 9th - to - 12th, 2019, CEUR-WS.org, 2019.
Preface: 3rd Workshop on Querying and Benchmarking the Web of Data Proceedings Article
In: Proceedings of the QuWeDa 2019: 3rd Workshop on Querying and Benchmarking the Web of Data co-located with 18th International Semantic Web Conference (ISWC 2019), Auckland, New Zealand, October 26-30, 2019, pp. 1–4, CEUR-WS.org, 2019.
Benchmarking question answering systems Journal Article
In: Semantic Web, vol. 10, no. 2, pp. 293–304, 2019.
2018
Entity Linking in 40 Languages Using MAG Proceedings Article
In: The Semantic Web: ESWC 2018 Satellite Events - ESWC 2018 Satellite Events, Heraklion, Crete, Greece, June 3-7, 2018, Revised Selected Papers, pp. 176–181, Springer, 2018.
The Scalable Question Answering Over Linked Data (SQA) Challenge 2018 Proceedings Article
In: Semantic Web Challenges - 5th SemWebEval Challenge at ESWC 2018, Heraklion, Greece, June 3-7, 2018, Revised Selected Papers, pp. 69–75, Springer, 2018.
BENGAL: An Automatic Benchmark Generator for Entity Recognition and Linking Proceedings Article
In: Proceedings of the 11th International Conference on Natural Language Generation, Tilburg University, The Netherlands, November 5-8, 2018, pp. 339–349, Association for Computational Linguistics, 2018.
9th Challenge on Question Answering over Linked Data (QALD-9) (invited paper) Proceedings Article
In: Joint proceedings of the 4th Workshop on Semantic Deep Learning (SemDeep-4) and NLIWoD4: Natural Language Interfaces for the Web of Data (NLIWOD-4) and 9th Question Answering over Linked Data challenge (QALD-9) co-located with 17th International Semantic Web Conference (ISWC 2018), Monterey, California, United States of America, October 8th - 9th, 2018, pp. 58–64, CEUR-WS.org, 2018.
8th Challenge on Question Answering over Linked Data (QALD-8) (invited paper) Proceedings Article
In: Joint proceedings of the 4th Workshop on Semantic Deep Learning (SemDeep-4) and NLIWoD4: Natural Language Interfaces for the Web of Data (NLIWOD-4) and 9th Question Answering over Linked Data challenge (QALD-9) co-located with 17th International Semantic Web Conference (ISWC 2018), Monterey, California, United States of America, October 8th - 9th, 2018, pp. 51–57, CEUR-WS.org, 2018.
DICE @ TREC-IS 2018: Combining Knowledge Graphs and Deep Learning to Identify Crisis-Relevant Tweets Proceedings Article
In: Proceedings of the Twenty-Seventh Text REtrieval Conference, TREC 2018, Gaithersburg, Maryland, USA, November 14-16, 2018, National Institute of Standards and Technology (NIST), 2018.
Enhancing Community Interactions with Data-Driven Chatbots-The DBpedia Chatbot Proceedings Article
In: Companion of the The Web Conference 2018 on The Web Conference 2018, WWW 2018, Lyon , France, April 23-27, 2018, pp. 143–146, ACM, 2018.
Question Answering Mediated by Visual Clues and Knowledge Graphs Proceedings Article
In: Companion of the The Web Conference 2018 on The Web Conference 2018, WWW 2018, Lyon , France, April 23-27, 2018, pp. 1937–1939, ACM, 2018.
Why Reinvent the Wheel: Let's Build Question Answering Systems Together Proceedings Article
In: Proceedings of the 2018 World Wide Web Conference on World Wide Web, WWW 2018, Lyon, France, April 23-27, 2018, pp. 1247–1256, ACM, 2018.
GERBIL - Benchmarking Named Entity Recognition and Linking consistently Journal Article
In: Semantic Web, vol. 9, no. 5, pp. 605–625, 2018.
2017
Survey on challenges of Question Answering in the Semantic Web Journal Article
In: Semantic Web, vol. 8, no. 6, pp. 895–920, 2017.
Holistic and scalable ranking of RDF data Proceedings Article
In: 2017 IEEE International Conference on Big Data (IEEE BigData 2017), Boston, MA, USA, December 11-14, 2017, pp. 746–755, IEEE Computer Society, 2017.
7th Open Challenge on Question Answering over Linked Data (QALD-7) Proceedings Article
In: Semantic Web Challenges - 4th SemWebEval Challenge at ESWC 2017, Portoroz, Slovenia, May 28 - June 1, 2017, Revised Selected Papers, pp. 59–69, Springer, 2017.
MAG: A Multilingual, Knowledge-base Agnostic and Deterministic Entity Linking Approach Proceedings Article
In: Proceedings of the Knowledge Capture Conference, K-CAP 2017, Austin, TX, USA, December 4-6, 2017, pp. 9:1–9:8, ACM, 2017.
Question Answering Over Linked Data: What is Difficult to Answer? What Affects the F scores? Proceedings Article
In: Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data co-located with 16th International Semantic Web Conference (ISWC 2017), Vienna, Austria, October 21st - to - 22nd, 2017, CEUR-WS.org, 2017.
OKBQA: an Open Collaboration Framework for Development of Natural Language Question-Answering over Knowledge Bases Proceedings Article
In: Proceedings of the ISWC 2017 Posters & Demonstrations and Industry Tracks co-located with 16th International Semantic Web Conference (ISWC 2017), Vienna, Austria, October 23rd - to - 25th, 2017, CEUR-WS.org, 2017.
GENESIS: a generic RDF data access interface Proceedings Article
In: Proceedings of the International Conference on Web Intelligence, Leipzig, Germany, August 23-26, 2017, pp. 125–131, ACM, 2017.
Knowledge Extraction for Hybrid Question Answering PhD Thesis
Leipzig University, Germany, 2017.
2016
CubeQA - Question Answering on RDF Data Cubes Proceedings Article
In: The Semantic Web - ISWC 2016 - 15th International Semantic Web Conference, Kobe, Japan, October 17-21, 2016, Proceedings, Part I, pp. 325–340, 2016.
DIESEL -- Distributed Search over Large Enterprise Data Proceedings Article
In: ESWC, EU networking session, 2016.
QAMEL -- Question Answering on Mobile Devices Proceedings Article
In: ESWC, EU networking session, 2016.
Requirements to Modern Semantic Search Engines Proceedings Article
In: KESW, 2016.
SPARQL Querying Benchmarks Proceedings Article
In: Tutorial at ISWC, 2016.
Scalable Approach for Computing Semantic Relatedness using Semantic Web Data Proceedings Article
In: Proceedings of the International Conference on Web Intelligence, Mining and Semantics, 2016.
Techreport for GERBIL 1.2.2 - V1 Technical Report
Leipzig University 2016.
Requirements to Modern Semantic Search Engine Proceedings Article
In: Knowledge Engineering and Semantic Web - 7th International Conference, KESW 2016, Prague, Czech Republic, September 21-23, 2016, Proceedings, pp. 328–343, Springer, 2016.
A Scalable Approach for Computing Semantic Relatedness using Semantic Web Data Proceedings Article
In: Proceedings of the 6th International Conference on Web Intelligence, Mining and Semantics, WIMS 2016, N^imes, France, June 13-15, 2016, pp. 20:1–20:9, ACM, 2016.
2015
HAWK@QALD5 - Trying to Answer Hybrid Questions with Various Simple Ranking Techniques Proceedings Article
In: Working Notes of CLEF 2015 - Conference and Labs of the Evaluation forum, Toulouse, France, September 8-11, 2015, CEUR-WS.org, 2015.