Click on the links below to obtain more information about each data challenge and assignments. The assignments were based
\non preferences submitted by participants. Most challenges are meant to take ~4 days, but in some cases participants might finish earlier and move on to another challenge after working for 2-3 days on their initial assignment.<\/p><\/div>\n\t\t\t<\/div>
Your content goes here. Edit or remove this text inline or in the module Content settings. You can also style every aspect of this content in the module Design settings and even apply custom CSS to this text in the module Advanced settings.<\/p><\/div>\n\t\t\t<\/div>
Co-organizers<\/strong>: Lukas Layer and Giles Strong<\/p>\n Assigned participants, with CMU grad students, faculty, and postdocs who can help with Zoom logistics marked with star<\/strong>: Manfred Paulini(*), Aaron Owens, Sofia Guglielmini, Tommaso Dorigo, Giles Strong, Mikael Kuusela(*), Lukas Layer, Dimitri Bourilkov, Tyler Smith<\/p>\n Material to be provided for participants<\/strong>: https:\/\/github.com\/llayer\/cmu_challenge<\/a><\/p>\n Brief description of challenge<\/strong>:<\/p>\n The muon is a subnuclear particle, a heavier replica of the electron. It is an important messenger in searches of new physics at present and future colliders. The muon is charged, and its energy can be measured from its curvature in a magnetic field, as E=0.3BR, with B in Tesla, R is the curvature radius of their trajectory in meters, and E is their energy in GeV (here we are assuming E>>m so energy and momentum coincide). <\/span>When muons are ultra-relativistic (e.g. E>1000 GeV) their energy measurement from curvature is made imprecise by the too large radius (e.g. in B=2 Tesla, the curvature for E=1000 GeV is R=1666 meters).<\/span><\/p>\n We want to see how well we can measure the muon energy from the small, stochastic deposits of energy they leave behind as they radiate soft photons in traversing a dense material. Hence we simulate a 2-meter-thick calorimeter, segmented into 50 layers of 4cm, and transversely segmented in 3-mm-wide cells in x,y. Each cell records the energy of photons and ionization left behind by the muon. The idea is that by using the pattern of energy deposits, rather than just the sum of deposited energy, we get a better handle to regress to the true muon energy.<\/span><\/p>\n A set of O(100,000) events will be provided, with energy in the range 50-8000 GeV. For each event the files contain a set of readouts of N calorimeter cells, given as x_i, y_i, z_i, E_i and then the true energy of the muon, which we want to regress to. A separate set of events used for testing should have the same info but the true energy set to 0. Participants will submit answers in the guise of a file with the predicted energies. The evaluation metric is explained in the slides provided with the material.<\/span><\/p>\n More information can be obtained in the article at the following article<\/a> . Slack channel for the challenge in \u201cQuarks to Cosmos workspace\u201d<\/strong>: #challenge-dorigo<\/p>\n Dedicated Zoom line to use for this challenge<\/strong>: https:\/\/cmu.zoom.us\/j\/92378379265<\/a> Co-organizers<\/strong>:<\/p>\n Assigned participants, with CMU grad students, faculty, and postdocs who can help with Zoom logistics marked with star<\/strong>: Marc Huertas-Company, Sam Ward, Junik Sengupta , Supranta, Sarma Boruah, Ilsang Yoon, Karthik Reddy Solipuram, Zhaozhou An(*), Dimitrios Tanoglidis, Vahid Nikoofard, Harold Erbin, Nesar Ramachandra, Dinesh Shetty, Renbo Tu(*), Husni Almoubayyed(*), Ce Sui, Tanazza Khanam, Kangning Diao, Liting Xiao, Sangeon Park, Luca Masserano(*), Eyan Noronha', Yurii Kvasiuk, Francois Lanusse<\/p>\n Brief description of challenge<\/strong>: The goal of this data challenge will be to explore differentiable forward models, generative modeling, and Variational Inference, to solve inverse problems arising on astronomical and cosmological data. A main\u201cguided challenge\u201d, will allow participants to learn about these methodologies on inpainting\/denoising\/deblending problems on galaxy images from the Subaru Telescope. While a more \u201copen challenge\u201d will task participants interested in going deeper with applying these methodologies in an open problem of reconstructing maps of Dark Matter from weak gravitational lensing data from the HSC Survey.<\/p>\n Material to be provided for participants<\/strong>: Slack channel for the challenge in \u201cQuarks to Cosmos workspace\u201d<\/strong>: #challenge-lanusse<\/p>\n Dedicated Zoom line to use for this challenge<\/strong>: https:\/\/cmu.zoom.us\/j\/94617600621<\/a> Co-organizers<\/strong>:<\/p>\n Assigned participants, with CMU grad students, faculty, and postdocs who can help with Zoom logistics marked with star<\/strong>: Mike Stanley(*), Siddharth Chaini, Giovanni Ferrami, Richard Camuccio, Andresa Rodrigues de Campos(*), Nitin Mishra', \"Matthew O'Callaghan\", Biprateep Dey, Ann Lee(*), Alex Malz, Matthew Ho (*)<\/p>\n Brief description of challenge<\/strong>:This data challenge poses and invites participants to investigate three open-ended aspects of how to quantify the accuracy of estimated posterior probabilities derived by AI\/ML methods: Material to be provided for participants<\/strong>: I\u2019ll present a tutorial going through an annotated jupyter notebook introducing the context and questions this data challenge investigates and providing starter code showing at least one way to address each question. Participants are invited to build on those examples, based on some included suggestions or in self-guided experiments, to explore these questions in more depth. The notebook contains all the commands necessary to acquire starter data and run the demo code.<\/p>\n Slack channel for the challenge in \u201cQuarks to Cosmos workspace\u201d<\/strong>: #challenge-malz<\/p>\n Dedicated Zoom line to use for this challenge<\/strong>: https:\/\/cmu.zoom.us\/j\/95386322609<\/a> Co-organizers<\/strong>: Thea Aarrestad, Katya Govorkova, Maurizio Pierini, Ema Puljak, Kinga Wozniak<\/p>\n Assigned participants, with CMU grad students, faculty, and postdocs who can help with Zoom logistics marked with star<\/strong>: Jieun Yoo, Juweria Sayed, Eugene Proskurins, Arul Prakash Sivagurunathan, Thea Sukianto(*), Vishal Ngairangbam, Deeparna Bhattacharyya , Sindhu Murthy(*), Rajat Gupta, Melinda Siciliano, Sanha Cheong, Lawrence Ng, Stephen Portillo, Thea Aarrestad<\/p>\n Brief description of challenge<\/strong>: The goal of the challenge is to develop an algorithm able to detect a general New Physics signature hidden in a cocktail of known Standard Model backgrounds. As the label of the signal is not known a priori, the participants will have to make use of unsupervised learning methods. Examples of such methods include autoencoders while not being the only option. The algorithm must take as input a particle-based representation of the event: four-vectors of the highest-momentum jets, electrons, and muons, together with the missing transverse energy. These inputs can be either plugged in directly in the algorithm or used to first build a higher-level representation of the event to generate new inputs if found more suitable. The participants are encouraged to do some research on the topic ahead of the event. Previous work in this direction include for instance https:\/\/arxiv.org\/abs\/1811.10276<\/a> .<\/p>\n Material to be provided for participants<\/strong>: TBD<\/p>\n Slack channel for the challenge in \u201cQuarks to Cosmos workspace\u201d<\/strong>: #challenge-ngadiuba<\/p>\n Dedicated Zoom line to use for this challenge<\/strong>: https:\/\/cmu.zoom.us\/j\/94741627183<\/a> Co-organizers<\/strong>: Chad Schafer<\/p>\n Assigned participants, with CMU grad students, faculty, and postdocs who can help with Zoom logistics marked with star<\/strong>: Brian Nord, Siddharth Mishra-Sharma, Hadi Papei, Juan Pablo Alfonzo , Christine Ye, Kamran Derakhshani, Sukhdeep Singh(*), Rachel Mandelbaum(*), David Zhao(*), Chad Schafer(*), Markus Michael Rau(*), Patrick LaChance(*)<\/p>\n Brief description of challenge<\/strong>: Definition of \u2018endemic deep learning uncertainties\u2019: uncertainties that are measured directly from deep neural networks --- e.g., monte carlo dropout, formal Bayesian neural networks.\u00a0<\/span><\/p>\n This data challenge gives an opportunity to ask the following questions:<\/span><\/p>\n We recommend the following projects for this data challenge:<\/span><\/p>\n NB: The authors of Deeply Uncertain consider items 4, 5, and 6 in the list above to be interesting components of a follow-up paper. We welcome collaboration on this!<\/span><\/p>\n Material to be provided for participants<\/strong>:<\/p>\n Slack channel for the challenge in \u201cQuarks to Cosmos workspace\u201d<\/strong>: #challenge-nord<\/p>\n Dedicated Zoom line to use for this challenge<\/strong>: https:\/\/cmu.zoom.us\/j\/96241442796<\/a> Co-organizers<\/strong>:<\/p>\n Assigned participants, with CMU grad students, faculty, and postdocs who can help with Zoom logistics marked with star<\/strong>: Arvind Balasubramanian, Jessica Howard, Sam Hori, Manish Agnihotri, Xiaosheng Zhao, Anthony Bao, Harrison Proper, Michael Andrews(*), Andrew Roberts(*)<\/p>\n Brief description of challenge<\/strong>: After a brief review of the relationship between loss functions and machine learning models, I review a few approaches, including Bayesian ones, for quantifying the uncertainty in the outputs of these models and I assess the degree to which these approaches succeed.<\/p>\n Material to be provided for participants<\/strong>: TBD<\/p>\n
<\/span><\/p>\n
(Password was shared with participants via email\/Slack. All Zoom sessions will have a CMU-based host and some alt hosts who are working on the challenge.)<\/p><\/div>\n\t\t\t<\/div>Francois Lanusse: Solving Deep Inverse Problems in Cosmology<\/h5>\n\t\t\t\t
- GitHub repo with code and notebooks: https:\/\/github.com\/EiffL\/Quarks2CosmosDataChallenge<\/a>
- Datasets will be hosted on Bridges-2
- Live tutorial\/introduction at the beginning of each day.<\/p>\n
(Password was shared with participants via email\/Slack. All Zoom sessions will have a CMU-based host and some alt hosts who are working on the challenge.)<\/p><\/div>\n\t\t\t<\/div>Alex Malz: Assessing the Accuracy of ML-based Uncertainties in the Context of Galaxy Photometric Redshifts<\/h5>\n\t\t\t\t
1. How do we generate \u201ctrue\u201d posteriors to compare with estimates?
2. How do we estimate posteriors using AI\/ML methods?
3. How do we assess the accuracy of estimated posteriors given true posteriors?
This data challenge addresses these questions in the context of photometric redshift estimation.<\/p>\n
(Password was shared with participants via email\/Slack. All Zoom sessions will have a CMU-based host and some alt hosts who are working on the challenge.)<\/p><\/div>\n\t\t\t<\/div>Jennifer Ngadiuba: Finding New Physics with Anomaly Detection at the LHC<\/h5>\n\t\t\t\t
(Password was shared with participants via email\/Slack. All Zoom sessions will have a CMU-based host and some alt hosts who are working on the challenge.)<\/p><\/div>\n\t\t\t<\/div>Brian Nord: Achieving Interpretable Error Bars with Deep Learning in Simple Scenarios<\/h5>\n\t\t\t\t
\n
\n
\n
\n
(Password was shared with participants via email\/Slack. All Zoom sessions will have a CMU-based host and some alt hosts who are working on the challenge.)<\/p><\/div>\n\t\t\t<\/div>Harrison Prosper: Deep Learning for Symbolic Mathematics<\/h5>\n\t\t\t\t