Industry Track @ The 2024 Conference on Empirical Methods in Natural Language Processing (EMNLP) Hyatt Regency Miami Hotel, Miami, Florida (United States) 12 - 14 November 2024 *Website:* https://2024.emnlp.org/calls/industry_track/ *Submission Link:* https://openreview.net/group?id=EMNLP/2024/Industry_Track *Submission Deadline*: 18 July 2024 ==== Goal ==== Language technologies and their applications are an integral and critical part of our daily lives. The development of many of these technologies trace their roots to academic and industrial research laboratories where researchers invented a plethora of algorithms, benchmarked them against shared datasets and perfected the performance of these algorithms to provide plausible solutions to real-world applications. The EMNLP 2024 Industry Track aims to highlight this mutual influence of language technology in academia and industry, which has significantly contributed to the proliferation of industrial applications. The track provides the opportunity for researchers, engineers, practitioners and users to meet and discuss the latest language technologies methods as deployed in a real-world setting and aims to be the premier forum for knowledge sharing across the boundary between academia and industry. We acknowledge the unique difficulties encountered when adapting language technologies for building novel and robust real-world applications as the journey from theoretical research to practical deployment is fraught with new challenges. These range from the technical aspects of system deployment and optimizing for efficiency, to making informed design choices or methodological considerations of incorporating human feedback and oversight. To provide a forum to address these multifaceted issues, we are seeking submissions that not only delve into research but also demonstrate the application of systems in real-world scenarios, irrespective of whether they involve proprietary data. Contributions are invited across all spectrums of language technologies and systems, with a special emphasis on innovations and implementations that hold relevance to real-world applications. We encourage submissions from both non-profit and for-profit sectors, with the understanding that the end-users of these systems extend beyond the NLP community. Please note that if submissions involve proprietary data, there is no requirement to make this data available. ============= Topics of Interest ============= The EMNLP 2024 Industry Track provides the opportunity to highlight the key insights and new research challenges that arise from the development and deployment of real-world applications using language technologies. Relevant areas include: **System design, efficiency, maintainability and scalability** of real-world applications, with topics in alphabetical order including, but not limited to: - Benchmarks and methods for improving the latency and efficiency of systems - Continuous maintenance and improvement of deployed systems - Efficient methods for training and inference - Enabling infrastructure for large-scale deployment - Human-in-the-Loop approaches to application development - Implementation at speed, scale or low-cost - System combination **Novel applications and use cases**, with topics in alphabetical order including, but not limited to: - Best practices, lessons learned or a vision on deploying real-world applications - Case studies, from design to deployment - Description of an application or system - Design of application-relevant datasets - Development of methods under system constraints (model or data size) - Novel NLP applications **Methods for deployed systems**, with topics in alphabetical order including, but not limited to: - Ethics, bias, fairness and harmlessness - Interpretability - Interactive systems - Offline and online system evaluation methodologies - Online learning - Robustness ============ Important Dates ============ Paper submission deadline: July 18, 2024 Notification: October 1, 2024 Camera-ready version of papers due: October 15, 2024 Main conference: 12 - 14 November 2024 Note: All deadlines are 11:59PM UTC-12:00 (“anywhere on Earth”). Following the ACL and ARR Policies for Review and Citation, updated in early 2024, there is no anonymity period requirement, e.g. one may upload the paper to arXiv at any time. ========== Submissions ========== Authors are invited to submit original papers that are not previously published, accepted to be published, or under consideration for publication in any other forum. Submissions will be reviewed in a double-blind manner and assessed based on their novelty, technical quality, potential impact, and clarity. Submissions to the EMNLP 2024 Industry Track should emphasize real-world implementations of natural language processing systems, the development of such systems, or provide insights based on real-world datasets with obvious industry impact. For papers that rely heavily on empirical evaluations, the experimental methods and results should be clear, well executed, and repeatable (though the data may be proprietary). Industry Track papers cannot exceed 6 pages in length; however, references do not count toward the page limit, nor do the following optional sections: acknowledgments (only in the final version), ethical considerations, and appendices. Visit https://2024.emnlp.org/calls/industry_track/ for more information. ================ Industry Track Chairs ================ Franck Dernoncourt (Adobe Research) Daniel Preoțiuc-Pietro (Bloomberg) Anastasia Shimorina (Orange) Contact: emnlp2024-industry-track@googlegroups.com