Local AGLT2 Monitors

There are many monitors we've implemented. These include both AGLT2 and general USATLAS pages.

Summaries

• AGL Compute Summary page of Philippe's for AGL, MSU, UM resources (cf. AglT2MonitComputeSummary and ComputeNodeHealthAssessment)
• OMD dashboards
  • UM-main
  • UM-WN
  • MSU-main
  • MSU-WN
• Interactive plots of Condor and Ganglia activity on the clusters
• Network monitoring from UM ITComm (uniqname login required)
  • Network weather map
  • 40G Link 1 of 2 between Shinano and r-BIN-CATH traffic, errors/discards
  • 40G Link 2 of 2 between Shinano and r-BIN-CATH traffic, errors/discards
  • 40G Link 1 of 2 between r-BIN-CATH and Mogami traffic, errors/discards
  • 40G Link 2 of 2 between r-BIN-CATH and Mogami traffic, errors/discards
  • 100G Link between r-BIN-CATH and OmniPoP/Chicago traffic, errors/discards

All

• Cacti Monitoring Use guest, guest to access
  • AGLT2_UM Graphs Use guest, guest to access
• Syslog-NG monitoring [Note: use guest, guest to enter]
• M/Monit web interface
• UPS monitoring
• AFS monitoring
• Condor Job status only monitoring (on AGLBATCH)
• Condor Job monitoring (on MARS01) (Stopped? Needs fixing/updating)
• Inventory information. Part of ticketing system. Most systems added by the Fusion/OCS agent. Enter spare parts under "Consumables" and update Consumables when a part is used.
• Issue Tracking/Ticketing. Please enter any problems or new requests here.
• GLPI Test Instance. A separate instance of glpi with its own database. Anything you do in here won't effect the production instance.
• Ganglia monitoring for all of AGLT2
• Wenjing's dCache Dashboard
• dCache sys-log dCache Sys-log Monitor
• dCache Monitor dCache Monitor for AGLT2
• dCache StorageClass rates monitoring for AGLT2 (many other graphs available here)
• SRM watch SRM watch for AGLT2
• AGLT2 Pools Allocation Pool_Allocation
• Pool Balance Progress Monitor Monitor for pool balance
• AGLT2 SRM V2.2 storage space info.
• Dcache Function Daily TestDcache Function Daily Test
• AGLT2 RSV testing results web page.
• Calibration splitter page at aglbatch.aglt2.org
• Host certificate expiration monitor page
• LSA server room (hosts AGLT2) temperatures (NOTE: Protected: requires UMich login)
• MD1000 shelf monitoring: Typical URL is https://umfs07.aglt2.org:1311/
  • You must log in to the web page that displays
• Per-node job success summary of Panda jobs at AGLT2
• Datasets at T2 in USATLAS.
• t-head01 consistency checker (ccc) output logs.
• svn viewer. Login required.
• Squid cacti monitors
• ReSS Central Services History for gate keepers.
• DN checker page on gate04 (protected)
• DN checker page on gate02 (protected)
• NetDisco network view at UM

Monitoring Configuration Info

• MSUInfraMonConfig Infrastructure monitoring configuration at MSU

Starting points for IO Monitoring

• WLCG Monitoring starting point
• FAX Specific Monitoring
• New DDM Dashboard as of October 24, 2018

Grid Monitors

• CERN Dataset Popularity service
• PANDA production monitoring
• Open Science Grid monitoring map
• OSG Job Graph monitoring for USATLAS Tier2s (job slots)
• VORS (Virtual Organization Resource Selector)
• BNL Netflow bandwidth monitor for USATLAS Tier-2s.
• BNL FTS monitor page
• SRM testing v2.2 status page from LBL
• Gratia reporting from OSG.
• GridScan Report status about the gatekeeper
• WLCG/Gratia UNL US Tier-2 WLCG/gratia accounting interface
• EGEE Accounting web page (should gather US info from Gratia above).
• Daily RSV Site Availability -- requires browser certificate
• lfc.aglt2.org access count histogram
• MyOSG home page. Includes RSV monitoring history information.
• DDM/SAM monitor.
• Oracle Streams monitor at CERN, requires CERN login and membership in e-group grid-service-databases (subscribe at https://e-groups.cern.ch).
• Deprecated but still functional Oracle Streams monitor at CERN (requires user/pw to access...contact Shawn)
• Gratia dCache probes that go on the billing host
  • This shows info on setting up the probes.
• CERN AGLT2_CALIBDISK monitor (NOTE requires CERN authentication)
• ATLAS DQ2 monitor for AGLT2_MCDISK
• ATLAS DQ2 monitor for AGLT2_DATADISK
• Central Deletion Monitoring
• New deletion monitoring pages for Central Deletion
• Hiro's DQ2 log monitor web page
• Hiro's Throughput testing results page
• Hiro's Dataset monitoring/status page
• Hiro's FTS monitoring page, including channel status
• FTS Blacklist status
• Hammer Cloud auto-exclusion plot
• Alessandro's ATLAS install web GUI. Can find out which software is installed at specific sites.
• CERN federation report on US sites
• OSG delivered job statistics reports
• CERN-MICHIGAN FTS channel info (used for AGLT2_CALIBDISK)
• perfSONAR Dashboard
• ATLAS eLog -- an eLog account is required
• Site Space Monitor
• Down Time Calendar for ATLAS
• ANALY Que History View
• ADC Monitoring dashboard
• The New BigPanda dashboard
• DDM Accounting Dashboard
• AGLT2 squid central monitors
• ATLAS Down time Calendar

Salvaged this topic from another page - this chart could be useful. It's a status matrix now, but could be changed to be a matrix of task subject -> tool. Could be useful if we filled in the chart and linked each tool as appropriate.

ClusterUtilitiesQuestions

-- BobBall - 26 Jun 2007