eval_ai's profile picture. Evaluating state-of-the-art in AI

EvalAI

@eval_ai

Evaluating state-of-the-art in AI

Pinned

Submissions now open on EvalAI for #AlexaPrize SimBot Challenge from @AmazonScience 🎉 Prizes worth $500K, $100K, and $50K for winners!

Today, the #AlexaPrize SimBot Public Benchmark Challenge starts! It's the first time Amazon has welcomed teams other than those sponsored by the company to take part in the challenge. Visit the @eval_ai website for more information, and how to participate: amzn.to/evalai-simbot

AmazonScience's tweet image. Today, the #AlexaPrize SimBot Public Benchmark Challenge starts! It's the first time Amazon has welcomed teams other than those sponsored by the company to take part in the challenge. Visit the @eval_ai website for more information, and how to participate: amzn.to/evalai-simbot


EvalAI reposted

Excited to share a look-back on the Ego4D challenges 2022! In spite of being a brand new dataset, we had strong uptake and healthy competition, leading to significant gains over our baselines (upto 300%!). Check out our analysis and join us in 2023 :) discuss.ego4d-data.org/t/ego4d-challe…


New milestone: EvalAI now hosts 100+ active challenges! From 1 challenge (VQA) in 2017 to here in 5 years: - 200+ challenges - 18k+ users - 180k+ submissions - 30+ organizations


EvalAI reposted

New year, new user @AmazonScience and new challenge on @eval_ai 🎉. Can't be a better start for 2022!

The #AlexaPrize SimBot Challenge is a competition to advance the development of next-gen virtual assistants that will help humans complete real-world tasks. Learn more about the public benchmark phase on @eval_ai, which starts Jan 10, and ends April 30: amzn.to/evalai-simbot

AmazonScience's tweet image. The #AlexaPrize SimBot Challenge is a competition to advance the development of next-gen virtual assistants that will help humans complete real-world tasks. Learn more about the public benchmark phase on @eval_ai, which starts Jan 10, and ends April 30: amzn.to/evalai-simbot


EvalAI reposted

EvalAI: :cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI Lang: Python ⭐️ 1290 #MachineLearning Author: @eval_ai github.com/Cloud-CV/EvalAI


EvalAI reposted

We provide datasets in the Neurodata Without Borders @NeurodataWB format, accessible via @DANDIarchive. We host benchmarks and leaderboards on the @eval_ai platform, with private held-out data for standardized model evaluation.

chethan's tweet image. We provide datasets in the Neurodata Without Borders @NeurodataWB format, accessible via @DANDIarchive. We host benchmarks and leaderboards on the @eval_ai platform, with private held-out data for standardized model evaluation.

Excited to host BEHAVIOR Challenge 2021. Visit eval.ai/web/challenges… to participate. 📈

eval.ai

EvalAI: Evaluating state of the art in AI

EvalAI is an open-source web platform for organizing and participating in challenges to push the state of the art on AI tasks.

Drum roll! We release BEHAVIOR, an embodied AI benchmark and challenge of 100 complex household activities that would pose significant difficulties to all of today’s state-of-the-art algorithms. Hope to see great participation to this challenge @ICCV_2021



EvalAI reposted

We are happy to announce that our #sceneunderstanding challenge for #CVPR21 has been extended until May 31st. Submissions accepted on @eval_ai eval.ai/web/challenges… @QUTRobotics


EvalAI reposted

TextVQA (textvqa.org/challenge) and TextCaps (textvqa.org/textcaps/chall…) 2021 Challenges are live now! Deadline: May 14th, 2021 Winners to be announced at #CVPR21 VQA Workshop (visualqa.org/workshop). 1/n


EvalAI reposted

It's that time of the year again :) The 2021 VQA Challenge is now live! It closes May 7th. Also note the TextVQA and TextCaps challenges that involve reading and reasoning about text in images.

VQA Challenge 2021 is live! Deadline: May 7. Link: visualqa.org/challenge. Winners to be announced at #CVPR21 VQA Workshop (visualqa.org/workshop). Other challenges @ workshop: TextVQA, TextCaps. (1/2)



EvalAI reposted

It’s been a long journey. Thanks for the support GSOC @GoogleOSS!

We are happy to announce that @project_cloudcv has been selected as a mentoring organization for @gsoc 2021. This is the 7th consecutive year and we are excited for the summer with #EvalAI project 🎉



EvalAI reposted

Leaderboards of Habitat Autonomous Navigation Challenge 2021 are live! Looking forward to your submission on PointNav w/o localization sensors (‘𝐺𝑜 5m 𝑛𝑜𝑟𝑡ℎ, 3m 𝑤𝑒𝑠𝑡’) and ObjectNav (‘𝑓𝑖𝑛𝑑 𝑎 𝑐ℎ𝑎𝑖𝑟’) tasks. eval.ai/web/challenges…

eval.ai

EvalAI: Evaluating state of the art in AI

EvalAI is an open-source web platform for organizing and participating in challenges to push the state of the art on AI tasks.


EvalAI reposted

We've released a centralized evaluation server on @eval_ai to track community-wide progress on discovering electrocatalysts using ML. eval.ai/web/challenges… opencatalystproject.org/leaderboard_is… (2/3)


EvalAI reposted

13 challenges. 6 workshop organizers. 42 challenge organizers. 17 scientific advisors. 21 organizations. 1 workshop: embodied-ai.org #CVPR2021

We're excited to launch the third Habitat Challenge at the Embodied AI workshop with 15 research & academic institutions. The 2021 Habitat Challenge invites AI experts from around the world to teach machines to navigate real-world environments. #CVPR2021 ai.facebook.com/blog/2021-habi…



Loading...

Something went wrong.


Something went wrong.