Auditing Project Architecture VERY HIGH LEVEL

1
Auditing Project Architecture VERY HIGH LEVEL

• Tanya Levshina

2
Auditing Project Architecture
Grid Site without Log Search Service
CE
SE
OSG Central Facility
Catch-All Log Search Service Host
VO Resource Site
VO Services Host
Central Repository
Grid Site with Log Search Service
Site Central Log Monitoring Host
Security Officer
CE
SE
Legend
log repository
site
auditing data repository
cluster
host
flow of data request
application
flow of data storage
3
Grid Site with Centralized Log collection Log
Search Service

• Hosts multiple CEs and SEs
• Runs Grid and VO specific Services
• Uses syslog-ng to collect distributed log files
  in central repository
• Installs Gratias probes to report information
  about grid jobs
• Uses Log Search Service for logs monitoring
• Allows to execute queries to Log Search Service
  to authorized user

4
Gird Site without Log collection and Log Search
Service

• Hosts multiple CEs and SEs
• Runs Grid and VO specific Services
• Uses syslog-ng or some other mechanism to collect
  distributed log files and forward them to central
  repository in OSG Facilities
• Installs Gratias probes to report information
  about grid jobs

5
VO Resources Site

• Runs VO specific Services
• Uses syslog-ng or some other mechanism to collect
  distributed log files and forward them to central
  repository in OSG Facilities
• Installs Gratias probes to report information
  about grid jobs

6
OSG Central Facility

• Set of nodes provided by one of OSG Grid Sites
• Offers
• Auditing Service
• Auditing Repository
• Catch-All Log Search Service
• Catch-All Central Log Repository

7
Auditing Service Architecture
Log Search Service
User Client
Query Executor
Gratia DB
Admin Client
Auditing Server
Report
Report Generator
Auditing DB
Archiver
MS
8
Auditing Service Components

• Auditing Server
• Authenticates and authorized clients
• Forwards authorized query to QE
• Logs the request, its issuer and results in DB
• Forwards authorized request for report to RG
• Query Executor
• Receives request from AS
• Queries all relevant Grid Site Log Search
  Services
• Queries Gartia DB for information about finished
  grid jobs
• Archiver
• Archives/de-archives historic events from/to mass
  storage
• Admin Client
• Registers/Unregisters Grid Site and Site Security
  Admin
• Registers/Unregisters Admin
• Assigns/de-assigns Admin role based on credential
• Allows Admin to define query
• Allows Site Admin to approved predefined query
• User Client
• Launches an authorized query