Submission

How to submit

  • Box Links for submissions will be sent to team leaders’ submitted emails by July 1st July 10th, 2025.
  • Prediction results should be uploaded to the Box links sent to the Team Leaders. If you haven’t received a link, please let us know at takahiroyabe@nyu.edu.
  • You do not need to send submission emails or anything else — just upload your predictions!

Format of submission

  • The attached files should be named as {teamname}_{cityA,cityB,cityC,cityD}_humob25.csv.gz. For example, team name ‘dreamteam’ submitting their solutions for city B should submit their prediction as dreamteam_cityB_humob25.csv.gz.
  • The format of the submission should include the same 5 columns as the original dataset (user ID, day, timeslot, x, y). Separate the columns using commas (,) and include no redundant spaces, and save the file using the csv.gz format.
  • Only send the data for days 61 to 75 and only for the predicted users. In other words, for each city A, B, C, and D, submit only 3000 users' data. The corresponding user ID ranges are:
    • City A: 147001 - 150000
    • City B: 27001 - 30000
    • City C: 22001 - 25000
    • City D: 17001 - 20000
  • Please use the Validator toolkit (below) to make sure your submissions formats are correct!

Validator toolkit

  • To avoid mistakes in submission format, we implemented a submission file data format validation code at https://github.com/yahoojapan/geobleu.
  • You can check whether your submission files match the requirements with a standalone python program, validator.py. It takes city ID, the corresponding training data file path, and the submission file path as arguments and emits errors if it finds anything wrong regarding the number of columns, uid, and value ranges of d, t, x, and y. A submission file may begin with the header line “uid,d,t,x,y”, while omitting it is also acceptable.
  • For example, assuming city B's training data after decompression is at foo/city_B_challengedata.csv, and your submission file for city B before compression is at `bar/dreamteam_cityB_humob25.csv`, the command will be: 
    python3 validator.py b foo/city_B_challengedata.csv bar/dreamteam_cityB_humob25.csv
  • The line number in error messages is 0-indexed. If the tool doesn’t find anything, it will just say “Validation finished without errors!”. Please only submit files that have passed this validation step!

Other rules

  • Only 1 submission per team will be evaluated. The final submission before the deadline (11:59 pm AoE on Wednesday, September 10, 2025) will be considered as the final submission.
  • Cite the data descriptor document in your submissions and future work where the HuMob data is used:
    • Yabe, T., Tsubouchi, K., Shimizu, T., Sekimoto, Y., Sezaki, K., Moro, E., & Pentland, A. (2024). YJMob100K: City-scale and longitudinal dataset of anonymized human mobility trajectories. Scientific Data, 11(1), 397. https://www.nature.com/articles/s41597-024-03237-9

Midterm Evaluation (optional)

  • To provide some feedback on how well your team is doing, we will have a Midterm Evaluation period. This is a good opportunity to check whether your submission format is correct and whether your algorithm is performing well compared to your peers.

Rules for Midterm Evaluation submission

  • Predictions for only City A will be evaluated for the Midterm Evaluation.
  • Similar to the final submission, we will only accept 1 submission (final one before deadline) for the midterm evaluation.
  • The top 10 teams will be posted on the website. We will send you your scores individually via email.
  • You do not need to participate in the midterm evaluation to be considered for the final challenge. This is an optional activity to help you achieve higher scores.
  • Submission links (a link to a Box folder) will be sent to the team leaders within a few days. Please upload your solutions to the provided Box Folder.
    • Your submission file should be named {teamname}_{cityA,cityB,cityC,cityD}_humob25.csv.gz. For example, if the team name is “NYU”, the file should be named NYU_cityA_humob25.csv.gz.
    • If you have not submitted your team name, use the first name of the team lead as the team name.

Schedule for Midterm Evaluation

  • Midterm submissions are due on 11:59 pm AoE, July 30 (Wed), 2025.
  • Leaderboard will be posted online by August 20 (Wed), 2025.

Awards & Prizes

Similar to previous HuMob Challenge editions, submissions will be ranked with the GEOBLEU metric (not DTW), and the top 5 teams with the top scores will be invited as finalists. For more details on GEOBLEU, please see the following article:

Through a generous donation from W. Randolph Franklin, the top five (5) submissions to GISCUP 2025 will receive travel grants of $1,000. To receive the travel grants through GISCUP, individuals should submit a travel grant application through the travel grant application and highlight they are GISCup participants in appropriate questions.

Travel grant awardees will be contacted by the SIGSPATIAL travel grant committee after winners are determined. Awards will be distributed during the SIGSPATIAL conference in November.