User Tools

Site Tools


hpc:storage_on_hpc

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
hpc:storage_on_hpc [2025/03/14 10:40] – [NASAC] Gaël Rossignolhpc:storage_on_hpc [2025/03/31 14:33] (current) – [Sometimes mount is not available but you can browse/copy/interract with gio commands] Gaël Rossignol
Line 230: Line 230:
  
 <code console> <code console>
-(baobab)-[sagon@login2 ~]$ beegfs-get-quota-home-scratch.sh+(baobab)-[sagon@login1 ~]$ beegfs-get-quota-home-scratch.sh
 home dir: /home/sagon home dir: /home/sagon
 scratch dir: /srv/beegfs/scratch/users/s/sagon scratch dir: /srv/beegfs/scratch/users/s/sagon
Line 336: Line 336:
 </code> </code>
  
-<note important>The data are only available on the login2 node.  +<note important>The data are only available where gio has been mounted.  
-If you need to access the data on the nodes, you need to mount them there as well in your sbatch script.</note>+If you need to access the on other nodes, you need to mount them there as well in your sbatch script.</note>
  
 If you need to script this, you can put your credentials in a file in your home directory. If you need to script this, you can put your credentials in a file in your home directory.
Line 380: Line 380:
  
 reference: (([[https://hpc-community.unige.ch/t/howto-access-external-storage-from-baobab/551|How to access external storage from Baobab]])) reference: (([[https://hpc-community.unige.ch/t/howto-access-external-storage-from-baobab/551|How to access external storage from Baobab]]))
 +
 +=== Sometimes mount is not available but you can browse/copy/interract with gio commands === 
 +
 +<code>
 +$ dbus-launch bash
 +
 +$ gio mount smb://nasac-evs2.unige.ch/hpc_exchange/backup
 +Authentication Required
 +Enter user and password for share “hpc_exchange” on “nasac-evs2.unige.ch”:
 +User [rossigng]: s-hpc-share
 +Domain [SAMBA]: ISIS
 +Password:
 +
 +$ gio mount -l
 +Drive(0): SAMSUNG MZ7L3480HBLT-00A07
 +  Type: GProxyDrive (GProxyVolumeMonitorUDisks2)
 +Drive(1): SAMSUNG MZ7L3480HBLT-00A07
 +  Type: GProxyDrive (GProxyVolumeMonitorUDisks2)
 +Mount(0): hpc_exchange on nasac-evs2.unige.ch -> smb://nasac-evs2.unige.ch/hpc_exchange/
 +  Type: GDaemonMount
 +
 +$ gio list smb://nasac-evs2.unige.ch/hpc_exchange/
 +backup
 +
 +$ gio list smb://nasac-evs2.unige.ch/hpc_exchange/backup
 +toto
 +titi
 +tata.txt
 +
 +$ gio cp smb://nasac-evs2.unige.ch/hpc_exchange/backup/tata /tmp
 +
 +...
 +</code>
 +
 ===== CVMFS ===== ===== CVMFS =====
 All the compute nodes of our clusters have CernVM-FS client installed. CernVM-FS, the CernVM File System (also known as CVMFS), is a file distribution service that is particularly well suited to distribute software installations across a large number of systems world-wide in an efficient way. All the compute nodes of our clusters have CernVM-FS client installed. CernVM-FS, the CernVM File System (also known as CVMFS), is a file distribution service that is particularly well suited to distribute software installations across a large number of systems world-wide in an efficient way.
hpc/storage_on_hpc.1741948848.txt.gz · Last modified: 2025/03/14 10:40 by Gaël Rossignol