AAPM Thoracic Auto-segmentation Challenge Forum

Go back to competition Back to thread list Post in this thread

> Off site test scoring

Hello all,

We are in the final stages of debugging the off-site test submission. As some of you have discovered, it is possible to submit results now - however the scores you are currently getting are not the final scores. All submitted results will be reprocessed once we have debugged. We will email out when it is fully working.

Thanks,

Mark

Posted by: MarkGooding @ July 11, 2017, 2:19 p.m.

Hi, can you tell me what's the error on my submission 'LCTSC-Test-Results.zip' as follows.

Traceback (most recent call last):
File "/tmp/codalab/tmplgTZsD/run/program/evaluate.py", line 179, in
main()
File "/tmp/codalab/tmplgTZsD/run/program/evaluate.py", line 122, in main
shutil.copy(submit_file_path, submit_dicom_dir_path)
File "/opt/conda/lib/python2.7/shutil.py", line 119, in copy
copyfile(src, dst)
File "/opt/conda/lib/python2.7/shutil.py", line 82, in copyfile
with open(src, 'rb') as fsrc:
IOError: [Errno 21] Is a directory: '/tmp/codalab/tmplgTZsD/run/input/res/LCTSC-Test-Results'

Posted by: jwu @ July 11, 2017, 3:26 p.m.

You appear to have the RTSS contained within a folder within the zip folder. The RTSS should be directly inside the zip file at the root level.

Posted by: MarkGooding @ July 11, 2017, 3:37 p.m.

Thanks for the work.
It seems my submission was successful but when I was trying to download and view the results using the "View detailed results" and
"Download evaluation output from scoring step" buttons, I cannot open the downloaded files. Every time I try to unzip them, a .cpgz file was generated. What is this problem?
PS I am using a Mac system.

Posted by: xuefeng @ July 11, 2017, 7:23 p.m.

Change the file extension to .html. It's an html file but mistakenly defaulted to .zip file. We will see if we can fix the problem.
Please note that the results are not correct at this moment. We are still debugging...

Posted by: yangjinzhong @ July 12, 2017, 2:26 p.m.
Post in this thread