NOvA DAQ

1
NOvA DAQ

• 642,816 channels _at_ 300 hits/sec avg.
• 20,088 Front-End Boards ( 3 MByte/sec data rate
  per FEB)
• 324 Data Combiner Modules, each reading out 64
  FEBs.
• 1.8 to 3.5 GByte/sec detector data rate.

2
DAQ - 1.7.x and 2.7.xFront-end Data to Farm
APD Front-end Boards (20,088)
X64
X64
Data Concentrators (324)
Ethernet Network
Cross-connect
Trigger Processors (256)
3
DAQ on the Detector
4
DAQ Network
4m cables
Data Concentrator
Control/ Timing
Gigabit Ethernet
Front-end Boards
5
Timing System
GPS
Data Concentrator
Clock, Sync, Cmd, Data
FEB
Fanout
X64
X64
X6
Cross- connect
GE Network
X324
Run Control Host
Storage Internet
Processor Farm
X256
6
DCM Block Diagram
Front-End Inputs X 64
Cmd Data
Clk Sync
DRAM
LVDS Drivers
FPGA
JTAG
PLD
Boot Flash
Processor
GE PHY
From Control/ Timing System
Gigabit Ethernet
Clk, Sync, Cmd, Data
To Data Network
7
DCM Layout
FE Links
Buffer memory (DRAM)
Gigabit Ethernet
FPGA (embedded processor Ethernet)
8
DAQ Network
Data Concentrators
X 9
48 port GE switches
X 8
Processors
9
DAQ Network - Realization
COTS SWITCHES
10
Dataflow
0a
1a
Switch
2a
3a
Data Concentrators
0b
1b
2b
3b
0c
1c
2c
3c
0d
1d
2d
3d
11
Dataflow2
0a
0b
Switch
0c
0d
Processors
1a
1b
1c
1d
2a
2b
2c
2d
3a
3b
3c
3d
12
DAQ/DCM Design flow
Integration Prototype FEB
Production FEB
Pilot FEB
Prototype DCM (5) RD 1.7.2.1.x
Integration Prototype DCM (9) RD 1.7.2.1.6.x
Production Pilot DCM (9) Construction 2.7.2.1.2
Production DCM (324) Construction 2.7.2.1.2
Mini-DAQ 1 Switch, 10 Proc
Mini-DAQ 1 Switch 5 Proc
Production DAQ - 2 level Switch, 256 Proc
Integration Prototype Near Detector 2007
Near Detector 6 Years
Far Detector Data for 6 Years
Production Test Stand
13
DAQ/DCM Cost flow
Integration Prototype FEB
Production FEB
Pilot FEB
Prototype DCM (5) RD 1.7.2.1.x 23.2k MS 282k
Labor
Integration Proto DCM (9) RD 1.7.2.1.6. 23.2k
MS 18.1k Labor
Production Pilot DCM (9) Construction
2.7.2.1.2 21.1k MS 4.2k Labor
Production DCM (324) Construction 2.7.2.1.2 400k
MS 80k Labor
Mini-DAQ 1 Switch, 8 Proc 35.3k MS 8.7 Labor
Mini-DAQ 1 Switch 5 Proc 113.7k MS 338.5k Labor
Prod DAQ 24 Switches, 256 Proc 670.8k
MS 165.5k Labor
DAQ Hardware RD 160k MS 638k Labor DAQ
Hardware Prod. 1127k MS 258k Labor
Integration Prototype Near Detector 2007
Near Detector 6 Years
Far Detector 6 Years
Note DAQ includes timing, network and control
room
Production Test Stand
14
Finito
15
Backup slides
16
DCM Wiring
CAT5e cable
Clk
Sync
Cmd
Data
17
DCM Timing
Clock
Sync
start bit
stop bit
1
0
1
1
0
0
0
1
0
Cmd / Data (4X oversampled)
18
(No Transcript)