Data Collection EM

From RHPC wiki
Jump to navigation Jump to search

Data Transfer

From AMC

Upload data

Use Filesender to transfer the data.

Log in to Filesender with:

  • Username: nki\[yourusername]
  • Password: your NKI password (the one you use for Antonet, not the RHPC password)

Compress and upload the data, and send a link to your own email. Don't forget to logout.

Download data

  • For files < 1.5 Gb: simply click on the link in your email
  • For files > 1.5 Gb: The NKI email client has a built-in limit to the size of the downloadable files. Files bigger than 1.5 Gb will fail download without warning. Additionally, the client will obfuscate the link in the email, disallowing a simple copy paste of the link.
    • To solve this issue:
      • Login to your Filesender account in your browser
      • Go to the "My Transfers" section
      • Find the file in the Currently available transfers section
      • Click on the plus icon: a tab will expand.
      • Download the file by clicking the download icon at the bottom of the tab

Note: files are available through this route only for two weeks (unless their duration was specifically extended). Files in the Closed transfers section are unavailable for download.

From other facilities

Follow the facilities' instructions.

Data Backup

All data that are collected at any microscope are to be immediately backed up on:

/em-images/[username]/YYYYMMDD_Experiment

(where YYYYMMDD is e.g. 20180704, 4th July 2018)

An identical copy will be automatically and daily synchronized to

/em-images2/[username]/YYYYMMDD_Experiment''

Write permissions on /em-images and /em-images2 are 775 for user:xtal_users, meaning that - members of the xtal_users group can read and write data - everyone else (i.e. workstation-group users) can only read the data. This is intended to protect the raw data from unintentional deletion / corruption.

Members of xtal_users are:

Andrea
Robbert
Torben
Ismail
Tassos
Robbie.

Ask anyone of them to backup your data.