Dcache on AGLT2
service distribution:
all the dcache services are physically distributed to 37 nodes.
tow of them are head nodes(head01.aglt2.org and head02.aglt2.org),
the other 35 nodes are acted as pool nodes of dcache which data
are physically stored on ..
services are distributed as follows:
head01:
lm domain (location manager)
dCache domain
admind domain
httpd domain
utility domain
infoProviderDomain
gPlazma domain
dcap domain
srm
gsidcap
gsiftp
head02:
pnfs server
replica Manager
dcap domain
dir domain
*pool node
dcap (there are 5 dcap doors running on each node :dcap-1 dcap-2 dcap-3 dcap-4 dcap-5)
gsidcap
gsiftp
pool
pool nodes list:
head02.aglt2.org
head01.aglt2.org
c-1-11.aglt2.org
c-1-15.aglt2.org
c-1-16.aglt2.org
c-1-17.aglt2.org
c-1-18.aglt2.org
c-1-19.aglt2.org
c-1-20.aglt2.org
c-1-21.aglt2.org
c-1-22.aglt2.org
c-1-23.aglt2.org
c-1-24.aglt2.org
c-1-28.aglt2.org
c-1-29.aglt2.org
c-1-30.aglt2.org
c-2-28.aglt2.org
c-2-29.aglt2.org
c-2-30.aglt2.org
c-2-31.aglt2.org
c-2-32.aglt2.org
c-2-34.aglt2.org
c-2-35.aglt2.org
c-2-36.aglt2.org
c-2-37.aglt2.org
c-2-38.aglt2.org
c-3-19.aglt2.org
c-3-20.aglt2.org
c-3-21.aglt2.org
c-3-22.aglt2.org
c-3-23.aglt2.org
c-3-24.aglt2.org
c-3-25.aglt2.org
c-3-26.aglt2.org
c-3-27.aglt2.org
c-3-28.aglt2.org
c-3-29.aglt2.org
more information about dcahce cell services ,please refer to the web monitor page
http://head01.aglt2.org:2288/cellInfo
PS : service function
lm domain (location manager) which is responsible for the communication of each different domain on different nodes
dCache domain
admind domain which provides an admin interface for administrators of dache system
httpd domain which provides a web-based monitor interface for the whole dcache system
utility domain which is resposible for space management and pin management
infoProviderDomain for information collector
gPlazma domain which is the authorization and anthentication module of dcache
dcap domain which is responsible for requests by dcap protocol from dcache clients
srm which is responsible for requests by srm protocol from dcache clients
gsidcap which is responsible for requests by gsidcap(gsi based dcap protocol) protocol from dcache clients
gsiftp which is responsible for requests by gsiftp protocol from dcache clietns
pnfs server :provides the metadata service for the whole system
replica Manager : manage the copies of resilient files in dcache
POOLs of dcache
There are totally 58 pools of our dcache system,its total capacity is about 37TB,(for more detailed information about
the pool space ,please refer to the web monitor page
http://head01.aglt2.org:2288/usageInfo). For some of pool nodes who have
more than one harddisk,there are more than one pools on each node.Generally ,each harddisk is corresponding to a pool.
These 58 pools are devided into 2 pool groups ,one is for resilient files which means there are at least 2 and at most
3 copies for these files,another is for unresilient file which means there is only one copy of these files in the storage pools.
28 pools are for resilient files,the other 30 pools are for unresilient files.
resilient pools:
c-3-22_1 (enabled=true;active=13;rdOnly=false;links=0;pgroups=1)
c-1-16_3 (enabled=true;active=5;rdOnly=false;links=0;pgroups=1)
c-1-24_1 (enabled=true;active=3;rdOnly=false;links=0;pgroups=1)
c-2-30_1 (enabled=true;active=15;rdOnly=false;links=0;pgroups=1)
c-1-15_2 (enabled=true;active=8;rdOnly=false;links=0;pgroups=1)
c-3-20_1 (enabled=true;active=1;rdOnly=false;links=0;pgroups=1)
c-1-21_2 (enabled=true;active=1;rdOnly=false;links=0;pgroups=1)
c-1-20_1 (enabled=true;active=29;rdOnly=false;links=0;pgroups=1)
c-3-26_1 (enabled=true;active=26;rdOnly=false;links=0;pgroups=1)
c-1-16_1 (enabled=true;active=3;rdOnly=false;links=0;pgroups=1)
c-1-17_2 (enabled=true;active=5;rdOnly=false;links=0;pgroups=1)
c-2-32_1 (enabled=true;active=28;rdOnly=false;links=0;pgroups=1)
c-1-11_1 (enabled=true;active=20;rdOnly=false;links=0;pgroups=1)
c-1-18_3 (enabled=true;active=15;rdOnly=false;links=0;pgroups=1)
c-1-18_1 (enabled=true;active=11;rdOnly=false;links=0;pgroups=1)
c-2-38_1 (enabled=true;active=9;rdOnly=false;links=0;pgroups=1)
c-3-24_1 (enabled=true;active=5;rdOnly=false;links=0;pgroups=1)
c-1-20_3 (enabled=true;active=29;rdOnly=false;links=0;pgroups=1)
c-2-34_1 (enabled=true;active=9;rdOnly=false;links=0;pgroups=1)
c-2-36_1 (enabled=true;active=26;rdOnly=false;links=0;pgroups=1)
c-1-22_3 (enabled=true;active=14;rdOnly=false;links=0;pgroups=1)
c-1-22_1 (enabled=true;active=14;rdOnly=false;links=0;pgroups=1)
c-1-29_1 (enabled=true;active=12;rdOnly=false;links=0;pgroups=1)
c-1-24_3 (enabled=true;active=4;rdOnly=false;links=0;pgroups=1)
c-2-28_1 (enabled=true;active=19;rdOnly=false;links=0;pgroups=1)
c-1-19_2 (enabled=true;active=9;rdOnly=false;links=0;pgroups=1)
c-1-23_2 (enabled=true;active=16;rdOnly=false;links=0;pgroups=1)
unresilient pools:
c-1-23_3 (enabled=true;active=1;rdOnly=false;links=0;pgroups=1)
umt3int01_1 (enabled=true;active=4;rdOnly=false;links=0;pgroups=1)
c-1-22_2 (enabled=true;active=0;rdOnly=false;links=0;pgroups=1)
c-2-35_1 (enabled=true;active=0;rdOnly=false;links=0;pgroups=1)
c-3-27_1 (enabled=true;active=26;rdOnly=false;links=0;pgroups=1)
c-1-15_1 (enabled=true;active=22;rdOnly=false;links=0;pgroups=1)
c-1-16_2 (enabled=true;active=20;rdOnly=false;links=0;pgroups=1)
umt3int02_1 (enabled=true;active=9;rdOnly=false;links=0;pgroups=1)
c-1-17_3 (enabled=true;active=18;rdOnly=false;links=0;pgroups=1)
c-1-28_1 (enabled=true;active=13;rdOnly=false;links=0;pgroups=1)
c-1-19_3 (enabled=true;active=23;rdOnly=false;links=0;pgroups=1)
c-3-28_1 (enabled=true;active=3;rdOnly=false;links=0;pgroups=1)
c-1-17_1 (enabled=true;active=19;rdOnly=false;links=0;pgroups=1)
c-3-23_1 (enabled=true;active=11;rdOnly=false;links=0;pgroups=1)
c-2-37_1 (enabled=true;active=17;rdOnly=false;links=0;pgroups=1)
c-1-21_3 (enabled=true;active=14;rdOnly=false;links=0;pgroups=1)
c-1-21_1 (enabled=true;active=15;rdOnly=false;links=0;pgroups=1)
c-2-29_1 (enabled=true;active=18;rdOnly=false;links=0;pgroups=1)
c-1-19_1 (enabled=true;active=24;rdOnly=false;links=0;pgroups=1)
c-1-18_2 (enabled=true;active=29;rdOnly=false;links=0;pgroups=1)
c-1-15_3 (enabled=true;active=21;rdOnly=false;links=0;pgroups=1)
umt3int03_1 (enabled=true;active=24;rdOnly=false;links=0;pgroups=1)
c-3-25_1 (enabled=true;active=3;rdOnly=false;links=0;pgroups=1)
c-1-20_2 (enabled=true;active=12;rdOnly=false;links=0;pgroups=1)
c-1-24_2 (enabled=true;active=17;rdOnly=false;links=0;pgroups=1)
c-3-19_1 (enabled=true;active=16;rdOnly=false;links=0;pgroups=1)
c-2-33_1 (enabled=true;active=20;rdOnly=false;links=0;pgroups=1)
c-1-23_1 (enabled=true;active=1;rdOnly=false;links=0;pgroups=1)
c-2-31_1 (enabled=true;active=29;rdOnly=false;links=0;pgroups=1)
c-3-21_1 (enabled=true;active=1;rdOnly=false;links=0;pgroups=1)
c-1-30_1 (enabled=true;active=20;rdOnly=false;links=0;pgroups=1)
c-3-29_1 (enabled=true;active=4;rdOnly=false;links=0;pgroups=1)
--
WenjingWu - 24 Sep 2007