feat(records): adding ATLAS dataset for the PUB note ATL_SOFT_PUB-2025-03

[floern1]

Hi,

recently the dataset that accompanies the ATLAS PUB note ATL-SOFT-PUB-2025-003 was approved and I would like to upload the corresponding files to the CERN opendata platform. The are located at /eos/atlas/atlascerngroupdisk/proj-simul/AF4/Development/FrozenShowerInputSamplesContinuousEnergy/PUB_note_DS/*

I was already in contact with Zach and created a record JSON skeleton that is the content of this merge request. I was told, that the file information can be added automatically, so I filled only the other entries. If you need more than that, please tell me so that I can add additional entries.

Cheers Florian

[zlmarshall]

Just a quick note that the files are now all available in the staging area:

$ lt /eos/opendata/atlas/upload/voxelization_3761
total 25G
-rw-r--r--. 1 zmarshal zp 3.7G Nov 14 10:28 default_dataset_full_val.hdf5
-rw-r--r--. 1 zmarshal zp 8.5G Nov 14 10:29 regular_dataset_full_val.hdf5
-rw-r--r--. 1 zmarshal zp 3.7G Nov 14 10:30 default_dataset_full_trn.hdf5
-rw-r--r--. 1 zmarshal zp 8.5G Nov 14 10:31 regular_dataset_full_trn.hdf5

[psaiz]

Hi Florian,
Thanks for applying the suggestions. We have to make sure that the pipelines are happy before we can merge this. Most of the pipelines worked. The only one that failed was the commitlint, which looks at the message of the commit.

Would you mind amending the commit, to something like feat(records): adding ATLAS dataset for the PUB note ATL_SOFT_PUB-2025-03 ?

[floern1]

No Problem, done

[psaiz]

Hi Florian,
Thanks for your reply.
I'm afraid that I wasn't clear, sorry about that. We don't need to change the title of the pull request. We need to change the commit messages. I hope that you don't mind that I have just done it, and push it to your branch. Let's see if the pipelines are happy now.

[psaiz]

Thanks @floern1 and @zlmarshall . The record looks good I've uploaded it to our qa instance. Would you mind confirming that it looks good to you as well?

The entry does not have a DOI. Should we create one, to make it easier to cite the data?

[zlmarshall]

Thanks @psaiz ! I'll look at the QA entry ASAP; meanwhile, yes please, this should have a DOI so that it can be cited.

Best,
Zach

[zlmarshall]

A couple quick things I noticed while looking at the QA record. Thanks again @floern1 for putting this together!

[psaiz]

Hi,
I've merged the commits again, so that the pipelines would be happy.

There is only one open discussion left, with the link to gitlab. @zlmarshall, once you are happy with that discussion as well, could you please approve the request? I will then deploy it again on dev and qa, and, if there are no issues, also on prod.

[zlmarshall]

Sounds good to me — thanks @psaiz !

[floern1]

Do you think this here works?

https://gitlab.cern.ch/fernst/datasetshowcase

[zlmarshall]

Thanks! Looks good to me.

[floern1]

Hi, next monday there is a meeting, where I wanted to present the dataset. It would be nice if it could be online until then. It should be only clicking the merge-button, right? Or is there anything from my side that you are waiting for?

Best
Florian