Machine learning

MultiCoNER Datasets

MultiCoNER 1 is a large multilingual dataset (11 languages) for Named Entity Recognition. It is designed to represent some of the contemporary challenges in NER, including low-context scenarios (short and uncased text), syntactically complex entities such as movie titles, and long-tail entity distributions. MultiCoNER 2 is a large multilingual dataset (12 languages) for fine grained Named Entity Recognition. Its fine-grained taxonomy contains 36 NE classes, representing real-world challenges for NER, where named entities, apart from the surface form, context represents a critical role in distinguishing between the different...

Listed for discovery. Access is provided by the original publisher under its terms.

Data coverage

MultiCoNER 1 is a large multilingual dataset (11 languages) for Named Entity Recognition. It is designed to represent some of the contemporary challenges in NER, including low-context scenarios (short and uncased text), syntactically complex entities such as movie titles, and long-tail entity distributions. MultiCoNER 2 is a large multilingual dataset (12 languages) for fine grained Named Entity Recognition. Its fine-grained taxonomy contains 36 NE classes, representing real-world challenges for NER, where named entities, apart from the surface form, context represents a critical role in distinguishing between the different fine-grained types (e.g. Scientist vs. Athlete). Furthermore, the test data of MultiCoNER 2 contains noisy instances, where the noise has been applied to both context tokens as well as the entity tokens. The noise includes typing errors at character level based on keyboard layouts in the the different languages.

Access & permitted use

Review the publisher’s documentation for availability, eligibility and permitted uses, including commercial analysis, model training and redistribution.

CC BY 4.0

Need help sourcing data?

Tell us your required fields, population, geography and time period. We can review suitable sources and licensing options.

Request sourcing help

Related data sources

Machine learningOpen corpus

Common Crawl Web Corpus

Publicly accessible historical web crawl archives containing WARC and related data, with periodic releases that support web-scale text analysis.

Common Crawl Foundation
Machine learningExternal source; review access terms

3DCoMPaT: Composition of Materials on Parts of 3D Things

3D CoMPaT is a richly annotated large-scale dataset of rendered compositions of Materials on Parts of thousands of unique 3D Models. This dataset primarily focuses on stylizing 3D shapes at part-level with compatible materials. Each object with the applied part-material compositions is rendered from four equally spaced views as well as four randomized views. We introduce a new task, called Grounded CoMPaT Recognition (GCR), to collectively recognize and ground compositions of materials on parts of 3D objects. We present two variations of this task and adapt state-of-art 2D/3D deep learning methods to solve the problem as...

Vision-CAIR, CEMSE, KAUST
Machine learningExternal source; review access terms

A2D2: Audi Autonomous Driving Dataset

An open multi-sensor dataset for autonomous driving research. This dataset comprises semantically segmented images, semantic point clouds, and 3D bounding boxes. In addition, it contains unlabelled 360 degree camera images, lidar, and bus data for three sequences. The dataset supports learning tasks such as semantic segmentation, 3D object detection, SLAM, and depth estimation. We hope this dataset will further facilitate active research and development in AI, computer vision, and robotics for autonomous driving.

Mentar Mahmudi, Jakob Geyer, Lorenz Hauswald