dragnet:system_software

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision		 Previous revision
dragnet:system_software [2017-08-18 00:20] – [LOFAR Builds] clarify amesfoortdragnet:system_software [2017-08-18 01:04] (current) – [QPID Message Broker Config for Operations] clarify amesfoort
Line 27: Line 27:
 ===== Other Packages installed by Alexander ===== ===== Other Packages installed by Alexander =====
 Many packages installed by Alexander on DRAGNET have a ''/home/alexander/pkg/PKGNAME-install.txt'' with commands close to a shell script used to config/build/install the package on DRAGNET. If you need to upgrade/reinstall, just copy-paste each command line by line with your brain engaged.\\ Many packages installed by Alexander on DRAGNET have a ''/home/alexander/pkg/PKGNAME-install.txt'' with commands close to a shell script used to config/build/install the package on DRAGNET. If you need to upgrade/reinstall, just copy-paste each command line by line with your brain engaged.\\
 +
 +
 +===== QPID Message Broker Config for Operations ====
 +To keep this rather complex config beast as low profile as possible on DRAGNET, this is only set up on DRAGNET to facilitate observation feedback flowing back to Observatory systems (MoM). This is inevitable (COBALT expects the local qpid queues), although failure impact is low: status in MoM.\\
 +
 +To use [[operator:resourcetool | resourcetool]], qpid is also needed, but by always specifying a broker host on the command line, we can avoid tracking RO qpid config just for that. It also makes operations vs test systems explicit (ccu001 vs ccu199).
 +
 +QPID is going to be used more and more, e.g. also for user ingest.
 +
 +Reinoud (and Jan David) are the people to debug qpid trouble with.
 +
 +
 +=== QPID Config for Feedback ===
 +On DRAGNET, I created 3 queues on each node (twice, once for operations and once for the test system), and routes from all nodes to the head node, and from the head node to ccu001 (operations) and ccu199 (test).\\
 +See **/home/amesfoort/build_qpid_queues-dragnet.sh** although typically I use it as notes instead of running it nilly-willy... RO software also has scripts where I added our queues and routes in case everything would need to be reset.\\
 +
 +Overview on a node (1st queue with pseudo-random name is from the viewing operation itself):
 +[amesfoort@dragnet ~]$ qpid-stat -q
 +  Queues
 +    queue                                     dur  autoDel  excl  msg   msgIn  msgOut  bytes  bytesIn  bytesOut  cons  bind
 +    =========================================================================================================================
 +    a1fe3b70-1595-4e4d-9313-8d1706861ba0:0.0       Y        Y        0     0      0       0      0        0         1     2
 +    lofar.task.feedback.dataproducts          Y                      0  11.4k  11.4k      0   39.1m    39.1m        1     1
 +    lofar.task.feedback.processing            Y                      0     0      0       0      0        0         1     1
 +    lofar.task.feedback.state                 Y                      0     0      0       0      0        0         1     1
 +    test.lofar.task.feedback.dataproducts     Y                      0    61     61       0    185k     185k        1     1
 +    test.lofar.task.feedback.processing       Y                      0     0      0       0      0        0         1     1
 +    test.lofar.task.feedback.state            Y                      0     0      0       0      0        0         1     1
 +
 +Overview of all routes //to// the ''dragnet'' head node (6 per node):
 +  [amesfoort@dragnet ~]$ qpid-route route list
 +  dragnet:5672 dragproc.control.lofar:5672  
 +  dragnet:5672 dragproc.control.lofar:5672  
 +  dragnet:5672 dragproc.control.lofar:5672  
 +  dragnet:5672 dragproc.control.lofar:5672  
 +  dragnet:5672 dragproc.control.lofar:5672  
 +  dragnet:5672 dragproc.control.lofar:5672  
 +  dragnet:5672 drg01.control.lofar:5672  
 +  dragnet:5672 drg01.control.lofar:5672  
 +  dragnet:5672 drg01.control.lofar:5672  
 +  dragnet:5672 drg01.control.lofar:5672  
 +  dragnet:5672 drg01.control.lofar:5672  
 +  dragnet:5672 drg01.control.lofar:5672  
 +  dragnet:5672 drg02.control.lofar:5672  
 +  [...]
 +  dragnet:5672 drg22.control.lofar:5672  
 +  dragnet:5672 drg23.control.lofar:5672  
 +  dragnet:5672 drg23.control.lofar:5672  
 +  dragnet:5672 drg23.control.lofar:5672  
 +  dragnet:5672 drg23.control.lofar:5672  
 +  dragnet:5672 drg23.control.lofar:5672  
 +  dragnet:5672 drg23.control.lofar:5672  
  
  
  • Last modified: 2017-08-18 01:04
  • by amesfoort