The “Simulation Challenge” (previously named the “Case Study Competition”) in Winter Simulation Conference (WSC) was initially launched in 2022, with the aim to delve into the significance of simulation and pave the way for increased collaboration between academia and industry. Through this initiative, we target to foster an environment of interdisciplinary cooperation that encourages innovation and fosters the creation of cutting-edge solutions to real-world problems.
With the theme “Simulation for Resilient Systems”, the Simulation Challenge in WSC2023 will continue to encourage participants to explore the latest advances in simulation technology and their application to next-generation industrial systems. Participants will be required to present case studies that demonstrate the use of simulation to design, optimize, and evaluate systems that are resilient, sustainable, and adaptable to changing circumstances. The competition will provide a unique opportunity to engage with leading experts in the field, gain recognition for their work, and potentially win prizes.
As we all know, the global semiconductor chip supply is facing severe challenges this year. For a society that is highly dependent on electronic equipment, the technological innovation of the chip industry and the reconstruction of the manufacturing system may deeply affect the digital lifestyle we are familiar with. As researchers and developers in the field of simulation, we eagerly hope to use simulation modeling and analysis tools to solve bottleneck problems in chip manufacturing and improve the efficiency and resilience of the systems. Therefore, we sincerely invited Micron Semiconductor (Asia) as a co-organizer and sponsor of this competition, and one issue of their concerns will be chosen to be the topic of the Simulation Challenge 2023. We strongly encourage all who are interested in simulation to join us and try your hand at the Simulation Challenge!
This competition will be co-organized by the ISEM Department of National University of Singapore, Engineering at the University of Exeter, ISE Department at KAIST, and Guanghua School of Management at Peking University. Stay tuned and keep a lookout on this page for more updates!
For any inquiries, please feel free to drop our Simulation Challenge Chair, Dr. Li Haobin and Co-Chair, Dr. Martino Luis.
Problem Description
Using the typical problem in the fabrication process as the case study for this competition, the organizers will build a basic simulation system model with discrete-event modeling methods and implement it in an open-source DES framework (O2DES.NET or o2despy). The organizers will also provide clear documentation to describe the model structure according to the rigorously defined modeling formalism.
The organizers will specify the data and source code according to the following three aspects of information:
- Variable scenario parameters, based on which the system shall operate, such as real-time demand and resource availability, etc.
- The key decisions and default rules involved in the operation of the system, such as production scheduling, task assignment, etc.
- Performance indicators to measure the efficiency and quality of the system operations.
Participants are required to:
- Rewrite and replace (B) in order to maximize the performance. indicators in (C) given various scenarios in (A).
- Generate logic rules in (B) through various ways, including but not limited to:
-Write rule-based scripts or heuristic algorithms embedded in decision events
-Embed simulation model into external optimization search algorithm
-Use the machine learning model to identify and conclude the best rule parameters and embed them in decision events - Provide only (B) of the program code in a dedicated folder. All other source code other than (B) will not be evaluated.
Assessment
- Once all participants have submitted their program code and data in (B), the organizers will embed them in the discrete-event simulation model prepared in advance, overwrite the corresponding original code, and compile and generate an executable simulation program.
- The pre-specified undisclosed scenarios as in (A) and random seeds will serve as the input. After which, the organizers will run the simulation program of each participant and generate the output of performance index values as in (C).
Documentation
- WSC Simulation Challenge 2023 – Brief: A document that introduces the simulation structure briefly.
- WSC Simulation Challenge 2023 Tech Document: A document that guides participants to participate in the competition and provides detailed illustrations of the simulation system.
Evaluation
- This competition is split into 4 rounds. As we progress through the competition, the weightage assigned to each round increases in proportion to the scenario’s difficulty.
- The first three rounds are split over the course of three months (August-October). For each of these rounds, a new scenario is released at the beginning of every month (see schedule). Participants can submit their work for each round at any point of time before the 23rd of each month. Resubmissions are allowed only before the deadline of each round. Throughout this period, there will be a leaderboard which ranks the performance of the submissions we receive. This ranking will be regularly updated as the submissions come in, after which the final ranking for the round will be released at the end of the month.
- For each round, teams will get some points. The top 10 teams will get 100, 95, 90, …, 55 points, respectively. Others with submissions will get 50 points.
- Weights are different for each round. To be more specific, the weights are 0.05, 0.15, 0.3, 0.5, respectively. The final rankings are counted by the total points.
- For example, if your rankings are 5th, 5th, 2nd, 1st. Your points are 80*0.05+80*0.15+95*0.3+100*0.5=94.5.
- Unlike previous rounds, the scenario for the final round will not be released. Should they choose to, participants can submit either an updated version of their work for this round, or they can simply re-submit their previous works. Participants have up till November 23 to submit their final work for the fourth round. The leaderboard will not be public for this round.
- The participants’ performance in every round will contribute towards their overall results. Results will be announced on November 30, of which, the Top 5 finalists will be informed to prepare a report presentation for WSC2023.
Timeline
The competition officially starts on August 1 with the start of Round 1.
Round 1
Start Date: August 1
- Registration opens
- Case study is announced
- First Scenario is released
- Submissions for Round 1 open
End Date: August 23
Submissions close for the Round 1.
Evaluation Period: August 24-30
Rankings Announcement: August 31
Round 2
Start Date: September 1
- New Scenario is released
- Submissions for Round 2 open
End Date: September 23
Submissions close for the Round 2.
Evaluation Period: September 24-29
Rankings Announcement: September 30
Round 3
Start Date: October 1
- New Scenario is released
- Submissions for Round 3 open
End Date: October 23
Submissions close for the Round 3.
Evaluation Period: October 24-30
Rankings Announcement: October 31
Hidden Round
Start Date: November 1
- Submissions for Hidden Round open
- No new scenario will be released
- Participants can either:
- submit an updated version of their work OR
- re-submit their previous works
End Date: November 23
Submissions close for the Hidden Round.
Evaluation Period: November 24-29
Rankings Announcement: November 30
Top 5 teams announced.
Rules & Registration
Eligibility
To be eligible to enter the competition, all participants must:
- Register for the competition with a valid and active email address which the organizer can use to communicate with the participants.
- Either be a single entrant or part of a team of up to a maximum of five (5) members only. Each participant can only join up to one team.
- Be solely responsible for creating the competition submission. Supervision or advice from the participants’ professors or post-doctoral researchers is permissible.
The competition is open to all except for members of the committee, including all staff members. However, the committee reserves the right to approve or disapprove participation according to its own considerations.
Please download the Registration Document, fill in the relevant content and rename the document to “Registration +Team Name”, and send it to wsc2023SimChallenge@gmail.com to complete the registration.
Submission
Please submit your code in .rar or .zip file. The file name is Round Number + Team Name, eg Round1_TeamN. Make sure you have tested the code in your local computer.
Email address for submission: wsc2023SimChallenge@gmail.com
Prizes
Total Prize Amount (USD): $10,000
- 1st place: $3,000
- 2nd & 3rd places: $2,000
- 4th & 5th places: $1,000
- 6th to 10th places: $200
Contact
For any enquiries, please feel free to drop our Case Competition Chair, Dr. Li Haobin, an email at li_haobin@nus.edu.sg and Co-Chair, Dr. Martino Luis, M.Luis@exeter.ac.uk
Terms & Conditions
- The competition committee reserves the right to disqualify any entrant from the competition if, in the competition committee’s sole discretion, it reasonably believes that the entrant has attempted to undermine the legitimate operation of the competition through cheating, deception, or other unfair playing practices.
- Submissions are void if they are in whole or part illegible, incomplete, damaged, altered, counterfeit, obtained through fraudulent means, or late. The competition committee reserves the right, in its sole discretion, to disqualify any entrant who makes a submission that does not adhere to all requirements.
- Officers, directors, employees, and advisory board members (and their immediate families and members of the same household) of the competition organizer and their respective affiliates are not eligible to participate in the competition.
- You agree to use reasonable and suitable measures to prevent persons who have not formally agreed to these rules from gaining access to the software and data provided by the competition organizer. You agree not to transmit, duplicate, publish, redistribute, or otherwise provide or make such software and data available to any party not participating in the competition. You agree to notify the competition organizer immediately upon learning of any possible unauthorized transmission or unauthorized access of such software and data and agree to work with the competition organizer to rectify any unauthorized transmission. You agree that participation in the competition shall not be construed as having or being granted a license (expressly, by implication, or otherwise) under, or any right of ownership in, any of the software and data.
- By downloading the software and data provided by the competition organizer you agree to the following terms:
- You will not distribute the software and data.
- You accept full responsibility for your use of the software and data and shall defend and indemnify the competition organizer, against any claims arising from your use of the software and data.
- By joining the competition, you affirm and acknowledge that you agree to comply with applicable laws and regulations, and you may not infringe upon any copyrights, intellectual property, or patent of another party for the software you develop in the course of the competition, and will not breach of any applicable laws and regulations related to export control and data privacy and protection.
- The competition committee reserves the right to verify eligibility and to adjudicate on any dispute at any time. If you provide any false information relating to the competition concerning your identity, residency, mailing address, telephone number, e-mail address, right of ownership, or information required for entering the competition, you may be immediately disqualified from the competition.
- The winner’s codes and documentation (collectively referred to as “program”) will be kept on the competition website after the competition. Unless otherwise indicated, all copyrights of the program belong to the winner. The program is licensed under MIT license. THIS PROGRAM IS PROVIDED ON AN “AS IS” BASIS, WITHOUT WARRANTIES OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO NON-INFRINGEMENT, MERCHANTABILITY OR FIT FOR A PARTICULAR PURPOSE.
- Prizes are subject to the competition committee’s review and verification of the entrant’s eligibility and compliance with these rules as well as the compliance of the winning submissions with the submission requirements.
- Competition prizes do not include tax payment. Any potential winner is solely responsible for all applicable taxes related to accepting the prize.
- The competition committee reserves the right at its sole discretion to terminate, modify, or suspend the competition, or disqualify the participants from the competition.
- For more information about personal data protection, please refer to the Privacy Policy.