Sciense Oprations

Hello,



We have reached a major milestone: RPMs are now the recommended way to install most of the OSG Software.



Today we have released OSG Software version 3.0.5. As of this release, the following components are now considered production-ready:



* The Compute Element

* RSV

* The Storage Elements (Bestman, Xrootd, HDFS)



See the release notes for details.

https://twiki.grid.iu.edu/bin/view/Documentation/Release3/Release305



We encourage you to try out this new RPM-based OSG Software because we believe that it is ready to work in production. As previously announced, we will only be providing critical updates to the older Pacman-based software releases. Therefore all new features will be delivered via this new RPM-based release.



You can ask support via the usual channels. If you need any help with the transition from Pacman to RPM, please feel free to ask for help.



We look forward to your feedback on this new release.

Start Time: Wednesday Dec 14, 12 Noon Pacific

End Time: Wednesday Dec 14, 4 PM Pacific

Description:- DOEGrids CA operators will be updating the DOEGrids CA service with the new signing certificate. This change does require CA service restart. During this maintenance window CA Operators will be restarting the service multiple times, which means the access to the CA services (Certificate Enrollment and Approval interface for Agents) will be affected. This Change to the DOEGrids CA should not have any impact for the user community, because the key material for the new Signing Certificate is the same as the current one. No certificate request approvals will be processed during the entire maintenance window.

Please see ticket 11270 at:
https://ticket.grid.iu.edu/goc/11270

The central DocDB server will be patched and restarted next Wednesday, Dec. 14 between 7 a.m. and 8 a.m. The outage is expected to last only five to ten minutes.



If you have any questions or if you experience any problems following the outage, please contact the Fermilab Service Desk.







Fermilab Service Desk

http://servicedesk.fnal.gov

servicedesk@fnal.gov

(630) 840-2345

Hello,



I'm pleased to announced OSG Software version 3.0.4. This is the new OSG Software distributed via RPMs for Scientific Linux 5, CentOS 5, and Red Hat Enterprise Linux 5. The changes in this release include changes that affect the existing general production release of VOMS, the Client, the Worker Node Client, and glexec. In particular:



* We've updated Globus to a new version that will be compatible with Globus 5.2 when it moves into EPEL in 2012. This required us to rebuild all the packages that link against Globus. There are few functional changes in Globus, but there are bug fixes.



* The CA certificates have been updated to fix a minor packaging problem, but not their content. We expect the IGTF 1.24 update to be released in early January after further testing in our internal OSG integration testbed.



* We have also released some new software as a "limited production release"--details are in the release notes.



Release notes and pointers to documentation can be found at:

https://twiki.grid.iu.edu/bin/view/Documentation/Release3/Release304



You can ask support via the usual channels. We look forward to your feedback on this new release.



-alain

--------------------------------------

Alain Roy

Open Science Grid Software Coordinator

roy@cs.wisc.edu

http://opensciencegrid.org

The GOC will upgrade the following services beginning Tuesday, December 13th, 2011 at 13:00 UTC. The GOC reserves 8 hours (13:00 - 21:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



MyOSG / OIM / GOC Ticket / Software Cache / TWiki

The footer will be modified to include a link to the Indiana University privacy policy [GOCADMIN-75]

MyOSG 1.44



ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Disabling BDII information gatherer used by BDII GridMap which is deprecated long ago.

Fixed the Mac EOD (end of line) issue discovered in GOC ticket application

Removed GOC BDII ITB service from Status Overview page. Updated BDII raw data link from is-itb.grid to is.grid

RSV Process 1.16

Removed alert forwarder that sends error messages directly to goc@

GOC Ticket 1.47



ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Made definition for json_decode optional and replaced split() with explode() (prepearing for php53)

Fixed the timing of setting default timezone to deal with boot time false alarm.

Added GGUS Ticket ID to metadata column on the ticket navigator

Defined the column that are displayed by default (when there is no cookie set) for navigator.

Added ability to sign email content sent from security notification form and added vulnerability mailing list address to destination list. [TICKET-31]



GOC BDII

is3 and is5 will be added to DNS RR (LVS interface for is3 and is5 is available at vip-is.grid.iu.edu)

OIM.grid.iu.edu 2.40



ITB version is now available for testing at https://oim-itb.grid.iu.edu

Updating Installed Capacity Report Script

Deprecated /pub pages will no longer serviced via httpd (http://oim.grid.iu.edu/pub/) [OIM-11]

The water leak in the Indianapolis machine room has been repaired and second instance of BDII returned to DNS round robin. Another shutdown will be required to replace all power sockets that were submerged. The schedule for this replacement has not been announced but the GOC has been assured prior notice will be given.

Due to a water pipe burst at the Indianapolis Campus the BDII instance at is2.grid.iu.edu will be removed from DNS Round Robin at 5pm EST today and remain inactive until at least Monday. This should be transparent to all OSG BDII users as the BDII instance located in the Bloomington machine room will pick up all traffic.



All other Production OSG Services are fully homed in Bloomington and will not be affected.

On Tuesday, we announced the general release of the RPM-based client, worker node client, and glexec (OSG Software 3.0.3). For those of you installing glexec, we recommend that you wait until our 3.0.4 release (currently scheduled for next Tuesday, December 6th) to install it. The installation in 3.0.3 works well on 64-bit platforms, but 32-bit platforms requires extra undocumented editing of the glexec/lcmaps configuration. In addition, updating from 3.0.3 to 3.0.4 will require additional editing of the glexec/lcmaps configuration on all platforms. This suggestion does not apply to the non-glexec portion of the clients: while we will update them, the updates will be transparent.



We hope this doesn't cause any inconvenience.



--------------------------------------

Alain Roy

Open Science Grid Software Coordinator

roy@cs.wisc.edu

http://opensciencegrid.org

Hello,



I'm pleased to announced the general availability of OSG Software, release 3.0.3 (a.k.a. VDT). This is the new OSG Software distributed via RPMs for Scientific Linux 5, CentOS 5, and Red Hat Enterprise Linux 5. This release includes the Client, Worker Node Client, and glexec.



Release notes and pointers to documentation can be found at:

https://twiki.grid.iu.edu/bin/view/Documentation/Release3/Release303



(You'll note that 3.0.3 was originally released a week ago--no changes have been made, other than declaring that the clients and glexec are ready for general production use.)



As many of you know, we are phasing in our new software distribution. Today we are announcing the general release of our clients and glexec, and we will be gradually releasing more software between now and mid-December. Some software is in "limited release" (that is, a production release, but intended for early adopters and not widely announced), so you may notice details about it in the release notes.



You can ask support via the usual channels. We look forward to your feedback on this new release.



-alain

--------------------------------------

Alain Roy

Open Science Grid Software Coordinator

roy@cs.wisc.edu

http://opensciencegrid.org

From 24/Nov through 27/Nov the GOC will be operating on a Holiday

schedule. Staff will be available to respond to emergencies but

routine operations will resume at start of business Monday 28/Nov.



The GOC wishes its users and OSG staff a happy and satisfying

Thanksgiving Holiday.

The GOC will upgrade the following services beginning Tuesday, November 22nd, 2011 at 14:00 UTC. The GOC reserves 8 hours (14:00 - 22:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.
OIM 2.39

ITB version is now available for testing at https://oim-itb.grid.iu.edu
Reorganized the resource service details into a separate table so that user can store different set of service details for each service group [OIM-18]
Added external assignment ID field for support center table so that GOC-TX can use it to populate necessary field on the destination ticket [OIM-21]
MyOSG 1.43

ITB version is now available for testing at https://myosg-itb.grid.iu.edu
Restructured resource service detail model, and removing central & hidden service filters. Updated Resource Group summary page and XML output to reflect the service detail model change [OIM-18]
RSV Process 1.15
Updated the oim model to use resource_service_detail for endpoint override (hasn't tested much) [OIM-18]
Fixed the unescaped XML character issue on resource status cache generator.

GIP Validator
Updated to pull both production and ITB resource information from is.grid.iu.edu
GOC Ticket 1.46

ITB version is now available for testing at https://ticket-itb.grid.iu.edu
Changed apache configuration to allow GOC-TX to access attachment files.
(patch) Fixed the issue where some user couldn’t login with a DN who has single quote characters inside their DN
Made submit button to only fire once [TICKET-3]
Hidden attachment interface for custom form submitter (for now) since it only works on an existing ticket
Fix the issue where ticket navigator filter would filter ticket with white space characters [TICKET-15]
GOC-TX 1.21

Added ability to synchronize attachments on GGUS, GOC FP, VDT, BNL ticketing systems.
Added FNAL ServiceNow ticket interface
Various minor bug fixes & logging improvments
All Hosts — OS Updates

We will be installing updated packages from the OS provider on all physical and virtual hosts, including updates to the kernel (https://rhn.redhat.com/errata/RHSA-2011-1386.html) and Java (https://rhn.redhat.com/errata/RHSA-2011-1384.html). There will be downtime during the day for most services, but in most cases it should not be more than 15 minutes. In the case of the CEMon-BDII aggregator service, we will use the DNS round-robin to shift traffic away from the server undergoing maintenance, so no downtime is required, but there may be some degradation of service during this time.

******************************

OSG 1.2.25 Update Notification

******************************



Date: November 10, 2011



Affected Components



The following components are affected:



* Gratia probes



Summary



This release contains the following security updates:



* Gratia-Common-Probe 1.08.00a-2



This update provides a new version of the Gratia probes that

fixes a security issue.



Update instructions can be found on the OSG Twiki under the OSG

1.2 update instructions ( https://twiki.grid.iu.edu/bin/view/ReleaseDocumentation/OSG12UpdateInstructions ).



Additional Information

The release notes for the VDT 2.0.0p32 release underlying this

release can be found here ( http://vdt.cs.wisc.edu/releases/2.0.0/release-p32.html ).

OSG Operations has been informed the recent flooding in Thailand has caused damage to the Thai grid infrastructure. OSG Operations wishes the best to our Thailand collaborators during this disaster and hopes for a speedy recovery.



This infrastructure includes the NECTEC CA which can not serve its CRL due to flood damage. There is no expected time for return to service, but we will pass on relevant updates as they arrive. RSV Warnings for the CRL Expiry Probe are appearing and this is expected behavior. This probe is non-critical and will not affect the resource status in OSG or WLCG. Administrators should be aware that this warning may last until connectivity is restored at the institution serving the NECTEC CA.



Details of the CRL Expiry probe will show a message "WARNING: CRL file for CA with hash '8a047de1' has not been updated…" until this service is restored.

Hello,



I'm pleased to announced the general availability of OSG Software, release 3.0.0u2

(a.k.a. VDT). This is our brand-new release of the OSG Software distributed via RPMs

for Scientific Linux 5, CentOS 5, and Red Hat Enterprise Linux 5. This release

includes VOMS.



Release notes and pointers to documentation can be found at:

https://twiki.grid.iu.edu/bin/view/Documentation/Release3/Release300u2



As many of you know, we are phasing in our new software distribution. Today we are

announcing the general release of VOMS (client and server, including VOMS Admin), and

we will be gradually releasing more software between now and mid-December. Some

software is in "limited release" (that is, a production release, but intended for

early adopters and not widely announced), so you may notice details about it in the

release notes.



You can ask support via the usual channels. We look forward to your feedback on this

new release.



-alain

--------------------------------------

Alain Roy

Open Science Grid Software Coordinator

roy@cs.wisc.edu

http://opensciencegrid.org

The GOC will upgrade the following services beginning Tuesday, November 8th, 2011 at 14:00 UTC. The GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



Software Cert request form



ITB version is available for testing at http://software-itb.grid.iu.edu/cert/certreg.php

Added William Baltz to ATLAS VO sponsor.

OSG Display 1.0.9



ITB version is now available for testing at http://display-itb.grid.iu.edu

Fixed grammatical errors

Reduced the flickering caused by content resizing

Added jQuery mobile skin for mobile access

Please be aware the GOC makes reasonable effort to support all major browsers current versions but cannot guarantee proper behavior for all browsers and browser versions.

MyOSG 1.42



ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Added mechanism to pull metric detail from the complete source (MetricRecord_Xml) if the detail seems to be truncated at 255 by Gratia collector.

GOC Ticket 1.45



ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Fixed a typo [Jira TICKET-28]

Enabling local attachment feature

Fixed the expandall / sort button issue on ticket viewer due to shortened URL

******************************

OSG 1.2.24 Update Notification

******************************



Date: October 25, 2011



Affected Components



The following components are affected:



* CE installations

* CEMon

* GUMS/VOMS

* OSG client

* OSG wn-client

* Any other installation that uses Java



Summary



This release contains the following security updates:



* Java JDK 1.6.0u29



This update updates the Java JDK distributed with OSG software to

address multiple security vulnerabilities found in the Java JVM

and class libraries.



Update instructions can be found on the OSG Twiki under the OSG

1.2 update instructions ( https://twiki.grid.iu.edu/bin/view/ReleaseDocumentation/OSG12UpdateInstructions ).



Additional Information

The release notes for the VDT 2.0.0p31 release underlying this

release can be found here ( http://vdt.cs.wisc.edu/releases/2.0.0/release-p31.html ).

At 6:00 AM (eastern) October 19th Indiana University network engineers

will perform an emergency reboot of the primary and secondary

routers in the Indianapolis machine room. No outages are

expected and GOC personnel will be standing by during the reboots.



The GOC apologizes for the short notice and any potential inconvenience.

The GOC will upgrade the following services beginning Tuesday, October 25th, 2011 at 13:00 UTC. The GOC reserves four hours (13:00 - 17:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

OSG Display 1.0.9



(This is a re-release of Oct 11th release.) Please be aware the GOC makes reasonable effort to support all major browsers current versions but cannot guarantee proper behavior for all browsers and browser versions.



ITB version is now available for testing at http://display-itb.grid.iu.edu

Fixed grammatical errors

Reduced the flickering caused by content resizing

Added jQuery mobile skin for mobile access

MyOSG 1.42



ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Added mechanism to pull metric detail from the complete source (MetricRecord_Xml) if the detail seems to be truncated at 255 by Gratia collector.

GOC Ticket 1.44



ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Fixed a typo [Jira TICKET-28]



OS Updates



As is usual for the second update cycle in a month, the GOC will be updating the operating systems of all physical and virtual machines with the latest security and bugfix patches from the OS provider. In the case of BDII, we will be using the DNS round-robin to redirect traffic to the host not undergoing maintenance, but in all other cases expect a few minutes of downtime.

A new VO package is now available. This package updates the LBNE VO, removes the GROW VO, and changes the address of the GLOW VOMS.



A detailed list of changes is available at:

https://twiki.grid.iu.edu/bin/view/Operations/PackageV40



OSG Operations suggests backing up your installation before running any

update commands.



To pull the new VO Package for an OSG 1.0.x or 1.2.0 Resource please

use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-package



To pull the new VO Package for the OSG Client 1.0.x or 1.2.0 please use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-client



Please see tickets at:

https://ticket.grid.iu.edu/goc/10929

https://ticket.grid.iu.edu/goc/10877

https://ticket.grid.iu.edu/goc/11072

A new release of the CA certificates is available at

http://software.grid.iu.edu/pacman/cadist/.



This is version 1.24 and uses IGTF 1.42 as the basis.





Changes to the OSG certificates package:



====== Version 1.24 =============

Built 11 Oct 2011

IGTF 1.42 release

Changes from IGTF

Corrected signing_policy file for UKeScience CA 2B (UK)

Fermilab will have an outage of its Feynman Computing Center on Saturday, October 15. Services will begin going off at 03:00 AM Central. Power to the Feynman Computing Center building and computer rooms will be off from 06:00-14:00 Central. All services are expected to be restored by 17:00 Central at the latest.



OSG Gratia accounting reporting services, OSG VO VOMS/VOMRS service, and OSG ReSS services will remain available due to redundant facilities in another building.



The gatekeepers FNAL_FERMIGRID and FNAL_GPGRID_1 will be unavailable during the above time frame. The main www.opensciencegrid.org web page and OSG DOCDB will be unavailable during the above time frame. All LISTSERV lists for OSG will also be unavailable. Gratia Accounting collection services will be unavailable but the Gratia system is configured to recover automatically after the outage so there will be no data loss.

The GOC will upgrade the following services beginning Tuesday, October 11th, 2011 at 13:00 UTC. The GOC reserves four hours (13:00 - 17:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



RSV Client (GOC Internal Service)



Adding a new RSV probes to monitor a service under development.



MyOSG 1.41



ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Modify service status dashboard to display status of a service under development.

[MYOSG-22]

Hidden DN information from rgdowntime(&xml) page

Added DN information to vosummary / rgsummary / scsummary / miscuser (&XMLs) pages

Fixed the XML parser issue on vovomsstatus XML

Modified ResourceContact, VOContact, VOReportContact, SupportCenterContact, and Contact models to pull DN records for each contact

Improved mobile content view (added viewport meta element and fixed various CSS issues for mobile content)



OSG Jira



ITB version is now available for testing at http://jira-osg-itb.grid.iu.edu

Upgrading to version Jira 4.4



OSG Display



ITB version is now available for testing at http://display-itb.grid.iu.edu

Fixed grammatical errors

Reduced the flickering caused by content resizing

Added jQuery mobile skin for mobile access

VM Moves



The GOC will be moving the virtual machines “software2” and “rsvprocess2” from the IUPIU data center to the IUB data center. No service interruption is expected, but software.grid.iu.edu may experience somewhat slower performance. myosg1 and data1, both currently hosted at IUB will be moved to a new host also located at IUB. A brief outage for MyOSG should be expected.

A new release of the CA certificates is available at

http://software.grid.iu.edu/pacman/cadist/.



This is version 1.23 and uses IGTF 1.41 as the basis.





Changes to the OSG certificates package:



====== Version 1.23 =============

Built 27 Sept 2011

IGTF 1.41 release

Changes from IGTF

* Added accredited PSC MyProxy SLCS CA (US)

* Updated CRL URL for LIPCA (PT)

* Extended life time of SlovakGrid CA root (SK)

* Added accredited DZ-eScience CA (DZ)

* Added accredited NICS SLCS MyProxy CA (US)

* Added new UK eScience issuing CAs 2A and 2B to allowed namespaces and

removed superfluous signing policy entries (UK)

* Normalised the certificate files (.0) for selected CAs in the 'old' format

distribution. This does not affect the 'new' OpenSSL v1+ compatible release.

Affected CAs are CESNET, NIKHEF, NIIF, DFN-GridGermany-Root, PSC-Myproxy-CA,

and NERSC-SLCS. Old and new format files are now identical.



* The "worthless" area, containing some files that are distributed merely

for convenience for selected specific purposes, has been re-named to

"unaccredited". Files contained in this directory must be treated with

utmost care, and their inclusion in the distribution does not constitute

any form of endorsement by the IGTF of these files or their content.

* Added unaccredited InCommon Server CA to convenience directory (US)

A new release of the CA certificates is available at

http://software.grid.iu.edu/pacman/cadist/.



This is version 1.23 and uses IGTF 1.41 as the basis.





Changes to the OSG certificates package:



====== Version 1.23 =============

Built 27 Sept 2011

IGTF 1.41 release

Changes from IGTF

* Added accredited PSC MyProxy SLCS CA (US)

* Updated CRL URL for LIPCA (PT)

* Extended life time of SlovakGrid CA root (SK)

* Added accredited DZ-eScience CA (DZ)

* Added accredited NICS SLCS MyProxy CA (US)

* Added new UK eScience issuing CAs 2A and 2B to allowed namespaces and

removed superfluous signing policy entries (UK)

* Normalised the certificate files (.0) for selected CAs in the 'old' format

distribution. This does not affect the 'new' OpenSSL v1+ compatible release.

Affected CAs are CESNET, NIKHEF, NIIF, DFN-GridGermany-Root, PSC-Myproxy-CA,

and NERSC-SLCS. Old and new format files are now identical.



* The "worthless" area, containing some files that are distributed merely

for convenience for selected specific purposes, has been re-named to

"unaccredited". Files contained in this directory must be treated with

utmost care, and their inclusion in the distribution does not constitute

any form of endorsement by the IGTF of these files or their content.

* Added unaccredited InCommon Server CA to convenience directory (US)

OSG Operations and Integration are pleased to announce the release of OSG version 1.2.23.



******************************

OSG 1.2.23 Update Notification

******************************



Date: September 28, 2011



The following components are affected:



CE installations

RSV installations

CEMon

GUMS/VOMS

Any other installation that uses apache httpd or tomcat



Summary



This release contains the following security updates:



Apache httpd

Apache tomcat



This update addresses and closes a DOS attacks on apache httpd and tomcat. Sites using components that use apache httpd or tomcat are encouraged to update as soon as possible.



Update instructions can be found on the OSG Twiki under the OSG 1.2 update instructions. (https://twiki.grid.iu.edu/bin/view/ReleaseDocumentation/OSG12UpdateInstructions)



Additional Information

The release notes for the VDT 2.0.0p30 release underlying this release can be found here. (http://vdt.cs.wisc.edu/releases/2.0.0/release-p30.html)

The Grid Operations Center is updating its maintenance window today, September 27, in order to accommodate some additional DNS difficulties. The maintenance will now continue until 19:00 UTC. We appreciate your understanding.

The GOC will upgrade the following services beginning Tuesday, September 27th, 2011 at 13:00 UTC. The GOC reserves four hours (13:00 - 17:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



MyOSG 1.40



ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Added links to gratiaweb service on home page, and gratia accounting pages [GOCTICKET 11025]

Added XML View for Statua Map [MYOSG-26]

GOC Ticket 1.43



ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Added patch for missing cc list for bulkresource submitter.

Added session clear code after the bulkresources are submitted - in order to prevent double submission.

Added sorting function to quickdesc list

TWIKI



ITB version is now available for testing at https://twiki-itb.grid.iu.edu

Patching security vulnerability (CVE-2011-3010) which affects new topic screen & SlideShowPlugin

VM Move



myosg2.grid.iu.edu and data2.grid.iu.edu will be moved from their current VM host in Indianapolis to a host in Bloomington. This has been done with twiki.grid and oim.grid in the past. These hosts are each part of a DNS round-robin, which will be used to direct traffic to the hosts that are not moving, so we expect no interruption in service due to this move. This is an advisory just in case, however.



OS Updates



We will be installing Red Hat Enterprise Linux updates to all services, including an update to Apache that addresses the RANGE header vulnerability (CVE-2011-3192). There is a kernel patch included, which means that there will need to be restarts. Downtime is to be expected, although in the case of is.grid.iu.edu we will make use of DNS to route traffic to the server that is up.

Colleagues,



We are pleased to announce that the GOC hosted Glidein Factory is up and ready to go. Any VOs interested in using it can contact us at osg-gfactory-support@physics.ucsd.edu and we will register your frontend to use it.



The new production instance uses glideinWMS 2.5.2 and condor 7.6.3. We will follow standard GOC change management procedures for any major upgrades or software updates for this instance. Major updates will happen under the usual maintenance windows on the 2nd and 4th Tuesdays of each month and any changes will be tested the week prior on our ITB Factory instance.



As usual if you have any questions please contact us at osg-gfactory-support@physics.ucsd.edu.



Jeff Dost

OSG Glidein Factory Operations

A new release of the CA certificates is available at

http://software.grid.iu.edu/pacman/cadist/.



This is version 1.22 and uses IGTF 1.40 as the basis.





Changes to the OSG certificates package:



====== Version 1.22 =============

Built 6 Aug 2011

IGTF 1.40 release



Changes from OSG

Old format and new format now have same md5sum

OSG Operations and Integration are pleased to announce the release of OSG version 1.2.22.





******************************

OSG 1.2.22 Update Notification

******************************



Date: September 13, 2011



Affected Components



The following components are affected:



* CE installations

* RSV installations

* CEMon

* Any other installation that uses apache httpd



Summary



This release contains the following security updates:



* Apache httpd



This update addresses and closes a DOS attack on apache httpd.

Sites using components that use apache httpd are encouraged to

update as soon as possible. This vulnerability as been listed as

CVE-2011-3192 ( https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2011-3192 ).



Update Instructions

Update instructions can be found on the OSG Twiki under the OSG

1.2 update instructions ( https://twiki.grid.iu.edu/bin/view/ReleaseDocumentation/OSG12UpdateInstructions ).



Additional Information

The release notes for the VDT 2.0.0p29 release underlying this

release can be found here ( http://vdt.cs.wisc.edu/releases/2.0.0/release-p28.html ).

The GOC will upgrade the following services beginning Tuesday, September 13th, 2011 at 13:00 UTC. The GOC reserves four hours (13:00 - 17:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



OIM 2.38



ITB version is now available for testing at https://oim-itb.grid.iu.edu

Updated Resource Form / WLCG checkbox details [OIM-17]



GOC Ticket 1.42



ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Overhauled the bulkresource submitter. Made it subclasse of BaseController (to have the contact info section), then added capability to "modify" after user previews tickets to be submitted. [TICKET-19]

Fixed the issue where title field was not properly displayed after a failed submission & preselection via MyOSG [TICKET-22]



MyOSG 1.39



ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Removed obsolete resource_type field parameter passed to GOC Ticket [TICKET-22]

Updated robots.txt with obsoleted list of /wizard... URLs

Added debug log to diagnose BDII/cluster error message

Added log to catch search queries that didn't yield any results

Fixed issue where fullbase() sometimes fails to construct correct URL if HOST_NAME is not set.

Updated osg-table jquery plugin so that it will display "loading" icon when user tries to expand bdii record

The GOC will upgrade the following services beginning Tuesday, August 23rd, 2011 at 13:00 UTC. The GOC reserves four hours (13:00 - 17:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



RSV-SAM Uploader



Minor update to the logging & monitoring script to allow verbose / debug logging to be separated from the normal error log.



Software Cache



Installing service monitor.



OSG Display



ITB version is now available for testing at https://display-itb.grid.iu.edu

Made graph titles consistent across all graphs types. [DISPLAY-1]



Gratiaweb



ITB version is now available for testing at https://gratiaweb-itb.grid.iu.edu

Fixed proxy timeout issues. This fix allows long running queries to be properly processed and passed to the user. [METRICS-1] / [METRICS-3]



TWiki



ITB version is now available for testing at https://twiki-itb.grid.iu.edu

Removed old twiki controllers. Although twiki’s native login managers were replaced by GOC’s custom X509 authentication module, old controllers were still available and partly functioning [TWIKI-4]

TWiki will be moved to a new host (jazmine.uits.indiana.edu).

At 4:15 EDT today Indiana University experienced a network outage. This outage was resolved and service was restored at 6:35 EDT. During this period all OSG Operations Services located at IU were offline, this includes the OSG BDII and MyOSG critical level services along with the OSG Software Cache, RSV, OIM, OSG Display, Ticket, TWiki and the VOMS for MIS and OSGEDU. Details of the outage will be reported at the weekly Operations (https://twiki.grid.iu.edu/bin/view/Operations/ProductionMeetingMinutes) and Production (https://twiki.grid.iu.edu/bin/view/Production/WeeklyProductionMeetings) Meetings.

OSG Operations and Integration are pleased to announce the release of OSG version 1.2.21.



******************************

OSG 1.2.21 Update Notification

******************************



Date: August 11, 2011



Affected Components



The following components are affected:



* All RSV installations

* CE installations

* Gratia



Summary



This release contains the following updates:



* GIP updates

* Gratia probe updates

* JDK update

* Bestman2 update to 2.0.14

* LFC update



Several other updates are also included in this release, see

the VDT update page for more details



Update Instructions

Update instructions can be found on the OSG Twiki under the OSG

1.2 update instructions (https://twiki.grid.iu.edu/bin/view/ReleaseDocumentation/OSG12UpdateInstructions).



Additional Information

The release notes for the VDT 2.0.0p28 release underlying this

release can be found here (http://vdt.cs.wisc.edu/releases/2.0.0/release-p28.html ).

This message is for the OSG site administrators who have used rpm or

yum mechanisms to update their certificate authority (CA) caches since

9:00 EDT 8/9/11. If you retrieve CA caches via pacman updates, you can ignore

this message.



There was a problem in the production rpm cache that began with the

cache update yesterday (8/9/11) and was corrected this afternoon

(8/10/11). If you did a yum update during this time (yum update

osg-ca-certs), your site may have ended up with CA caches that may

cause problems. You may also see RSV CA probe failures. We have fixed the

problem in the software cache. In order to get rid of the incorrect

package and install the new one, please run the command:



rpm -Uhv --oldpackage http://software.grid.iu.edu/yum/rpms/noarch/osg-ca-certs-1.20-0.noarch.rpm

(all one line)



To understand whether you installed the incorrect package, go to

TRUSTED_CA directory and check the installed package version. If you

see 1.20NEW in CHANGES file, you have the incorrect package. If you

see 1.20, then you have the correct version, and you do not need to take

any action. You can also go inside TRUSTED_CA/certificates directory

and do an ls -al, if you see a large number of symbolic links, you

have the incorrect package.



Our sincere apologies for this mistake. Please contact us immediately

if you have questions.



Mine Altunay (OSG Security Coordinator)

Scott Teige (OSG Operations Technical Lead)

The GOC will upgrade the following services beginning Tuesday, August 9th, 2011 at 13:00 UTC. The GOC reserves four hours (13:00 - 17:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



OIM 2.37



ITB version is now available for testing at https://oim-itb.grid.iu.edu

Added blogs and display service links on the application header



OSG Display 1.0.8



ITB version is now available for testing at http://display-itb.grid.iu.edu

Made the auto-rotation of the tab to stop when user switch a tab.

Updated the data refresh frequency from every 10 minutes to every 15 minutes [GOC Ticket 9245]



MyOSG 1.38



ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Added GOC glidein service to the Operations Status Overview page.

Added blogs and display service links on the application header & home page. Moved BDII information browser page to the sample page list on the home page.



GOC Ticket 1.41



ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Added check to make sure at least one assignee was assignee [TICKET-8]

Moved the location of the assignment override logic back to NextAssignment model

Added a functionality on ticket viewer to show who is currently viewing the same ticket

(already patched) Fixed the issue where page redirection was broken if the ticket's the auto-window closing feature somehow does not work on the browser.

Fixed the issue where incorrect ticket ID was displayed for security announcement ticket access control page.

Added blogs and display service links on the application header



InCommon HTTP/SSL certificates



We will be replacing various DOEGrids-issued HTTP/SSL certificates with our new UserTrust/InCommon-issued certificates. This change was postponed from the previous update cycle due to OS updates. Affected services are myosg, oim, software, ticket, and twiki. InCommon certificates are trusted on all major browsers by default and do not require users to manually trust our certificates anymore. In order to ensure a smooth transition, please start testing them on our ITB instances.

https://myosg-itb.grid.iu.edu

https://oim-itb.grid.iu.edu

https://software-itb.grid.iu.edu

https://ticket-itb.grid.iu.edu

https://twiki-itb.grid.iu.edu

IU engineers have scheduled power maintenance for the University Library at IUPUI from 5:30 to 7:30 AM EDT Thursday, August 4, 2011. Some network equipment used by OSG is sited there. Emergency power will be supplied to the network equipment and no outages are anticipated. GOC will monitor the status and respond as appropriate should failure occur.

At 6:40 EDT Saturday July 30th, network connectivity was lost in the Indianapolis machine room.

Recovery was complete by 8:25 and all GOC services are currently operating normally.

The GOC will upgrade the following services beginning at Tuesday, July 26th, 2011 at 13:00 UTC. The GOC reserves eight hours (13:00 - 21:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

OIM 2.36



ITB version is now available for testing at https://oim-itb.grid.iu.edu

Update DivRep library to the latest version

Cosmetic updates due to FF / Chrome updates.

Installed capacity report / Removed the bin/wlcg.sh dependency and added a rpm builder.



MyOSG 1.37



ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Updated BDII information page to have sortable tables for various BDII objects such as Service, CE, SE, Storage Areas, and Cluster. Each records can be expanded to display detailed information [MYOSG-10]

On Resource Group / Gratia Accounting Graphs pages, switched gratia graphs URLs from UNL to gratiaweb.grid.iu.edu.

Updated various GOC Ticket URLs to use shorter URLs.

Cosmetic updates due to FF / Chrome updates.

GOC Ticket 1.40



ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Updated GOC Tickets URLs that were still using long URL format.

Fixed a bug where ticket ID was not correctly displayed on security ticket template.

Cosmetic updates due to FF / Chrome updates.

Software



ITB version is now available for testing at https://software-itb.grid.iu.edu/cert/certreg.php

Removed Sau Lan Wu and John Huth from the VO sponsor list for ATLAS VO [GOC Ticket 10700]

InCommon HTTP/SSL certificates



We will be replacing various DOEGrids-issued HTTP/SSL certificates with our new UserTrust/InCommon-issued certificates. Affected services are myosg, oim, software, ticket, and twiki. InCommon certificates are trusted on all major browsers by default and do not require users to manually trust our certificates anymore. In order to ensure a smooth transition, please start testing them on our ITB instances.

https://myosg.grid.iu.edu

https://oim.grid.iu.edu

https://software.grid.iu.edu

https://ticket.grid.iu.edu

https://twiki.grid.iu.edu



New Service: GratiaWeb



The Gratia graph service is now available from the GOC at http://gratiaweb.grid.iu.edu The previous instance http://t2.unl.edu/gratia/ currently forwards to the GOC site. If you are using the old URL, please update to http://gratiaweb.grid.iu.edu

New Service: “Planet OSG” - Blog Aggregator



OSG Planet service is now available from the GOC at http://blogs.grid.iu.edu

This service allows you to read blogs written by people from the Open Science Grid community by aggregating various blogs into a single URL. You can read them directly on this URL, or via your favorite Atom/RSS reader by subscribing to its feeds.

All Services: Operating System Upgrades



We will be installing updated packages from Redhat for all production systems. This will mean downtime, although in the case of the BDII service, we will use the DNS round-robin to direct traffic to the currently unaffected server. These OS updates have already been installed on all ITB systems, and you are encouraged to test them.

Indiana University network engineers will perform maintenance effecting the Indianapolis machine room between 6:00 and 8:00 AM EDT on Sunday July 24th. This maintenance will interrupt network connectivity to the Indianapolis instances of GOC services. The actual outage is expected to be much shorter than the maintenance window and is currently estimated to be 10-15 minutes. Disruptions to GOC services are expected to be minimal.

A new VO package is now available. This package updates the CMS GUMS information to add the cmssoft group and contact information for the DREAM VO.



A detailed list of changes is available at:

https://twiki.grid.iu.edu/bin/view/Operations/PackageV39



The GOC suggests backing up your installation before running any

update commands.



To pull the new VO Package for an OSG 1.0.x or 1.2.0 Resource please

use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-package



Please remember to add local accounts for cmssoft as necessary.



To pull the new VO Package for the OSG Client 1.0.x or 1.2.0 please use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-client

Please see ticket 10666 at:
https://ticket.grid.iu.edu/goc/viewer?id=10666

A new VO package is now available. This package adds the GCVO (Grid Colombia VO), the GCEDU (Grid Colombia Education VO), SuperB, and DREAM.



A detailed list of changes is available at:

https://twiki.grid.iu.edu/bin/view/Operations/PackageV38



The GOC suggests backing up your installation before running any

update commands.



To pull the new VO Package for an OSG 1.0.x or 1.2.0 Resource please

use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-package



Please remember a UNIX accounts for these new VOs to be properly mapped. The GCEDU VO is an educational VO and will contain student users, please only enable this VO if you support the OSG Education projects.



To pull the new VO Package for the OSG Client 1.0.x or 1.2.0 please use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-client

IU Electrical Engineers will perform maintenance potentially effecting theIndianapolis machine room between 8am-5pm EDT on both Thursday and Friday, July 14 and 15. While this work is not expected to cause any outage to OSG Services, there are minor risks associated with any power maintenance. If there is an outage, we will immediately inform the community and take proper corrective action. All services located in Bloomington will not be affected.

The GOC will upgrade the following services beginning at Tuesday, July 12th, 2011 at 14:00 UTC. The GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



GOC-Ticket Exchanger 1.20



(Postponed from 6.14 release) Exchanging submitter DN between GGUS and Footprints so that ticket submitted through Footprints can be edited in GGUS via the same submitter.



GOC Ticket 1.39



ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Updated various GOC ticket viewer links to use shorter URL (/goc/123)

Removed unnecessary invocation of GOC assignee logic on Custom Form.





All Services: Network Port Reorganization



As part of the process of adding new servers to the Bloomington rack, we will be reorganizing the network ports on July 12 to keep them in an intuitive and maintainable order. Although every server will be affected, outages longer than ten seconds are not expected. We will be monitoring in case of more lasting consequences.



Coming Soon - InCommon HTTP/SSL certificates





We will be replacing various DOEGrids-issued HTTP/SSL certificates with our new UserTrust/InCommon-issued certificates on July 26th. Affected services are myosg, oim, software, ticket, and twiki. InCommon certificates are trusted on all major browsers by default and do not require users to manually trust our certificates anymore. In order to ensure a smooth transition, please start testing them on our ITB instances.

https://myosg-itb.grid.iu.edu

https://oim-itb.grid.iu.edu

https://software-itb.grid.iu.edu

https://ticket-itb.grid.iu.edu

https://twiki-itb.grid.iu.edu

Network engineers will perform maintenance effecting the Indianapolis

machine room between 6:00 and 8:00 AM EDT on Sunday July 10th. This

maintenance will interrupt network connectivity to the Indianapolis

instances of GOC services. The actual outage is expected to be much

shorter then the maintenance window and is currently estimated

to be 10-15 minutes. Disruptions to GOC services are expected to be minimal.

OSG Operations and Integration are pleased to announce the release of OSG version 1.2.20.





******************************

OSG 1.2.20 Update Notification

******************************



Date: June 30, 2011



Affected Components



The following components are affected:



* All RSV installations

* CE installations



Summary



Due to the fourth of July holiday weekend, OSG support

resources will be limited so admins may want to wait until

Tuesday July 5th before updating.

This release contains the following updates:



* Several gatekeeper changes for CMS

* Optional re-nicing of the globus-gatekeeper to give it a

lower priority to keep the gatekeeper more responsive under heavy

loads

* Random sleep for fork jobs to prevent unwanted synchronization

of grid monitor processes



* Condor job manager changes to support group accounting

* SGE job manager changes to use a more reliable polling method

* Cleanup scripts are now provided by VDT so that files left by

globus in user home directories can be removed automatically



Several other updates are also included in this release, see

the VDT update page for more details.





Update Instructions

Update instructions can be found on the OSG Twiki under the OSG

1.2 update instructions ( https://twiki.grid.iu.edu/bin/view/ReleaseDocumentation/OSG12UpdateInstructions

).



Additional Information



The release notes for the VDT 2.0.0p27 release underlying this

release can be found here (

http://vdt.cs.wisc.edu/releases/2.0.0/release-p27.html ).

OSG Resource Providers,



The LIGO VO (http://www.ligo.caltech.edu/) is looking for cycles. LIGO is currently running on approximately one-third of the OSG Resources and is ready to expand to more. Please take a look to see if your resource is enabled to allow LIGO VO jobs, and if it is not please consider enabling it. Below is a description of the application. LIGO has a strong application group that will work closely with resource providers to get the Einstein at OSG Application running. If you'd like to help please enable the LIGO VO and contact goc@opensciencegrid.org to let us know you'd like LIGO to run at your site. We are more than happy to provide assistance with enabling the VO or getting the application working on your site.



Thank you in advance for your participation,

Rob Quick

OSG Operations Coordinator

and

Robert Engel

LIGO Application Developer



About E@OSG

-----------



Einstein@OSG is software written to allow BOINC projects such as Einstein@Home to be executed in Grid environments. Initially developed at the Max-Planck-Institute for Gravitational Physics in Germany it is running today on the German D-Grid and the Open Science Grid. The software consists of a server scheduling and submitting jobs to grid resources and a client monitoring and executing the Einstein@Home client. Einstein@OSG has completed hundred's of million cpu hours on a vast number of heterogeneous grid resources mainly by utilizing available idle cycles.





E@OSG Execution on the OSG

--------------------------



The client supports following important features:



* ability to run on heterogeneous clusters providing i386 and x86_64 worker node architectures

* execution in $OSG_WN_TMP to avoid utilizing the network file system

* checkpointing on external SRM resources as well as network file systems such as NFS

* full support for eviction of jobs, automatic suspend and restart of the job

* automatic error detection and recovery of jobs

* support for GPU acceleration when available

* fine grained control about the client run-time (minutes to days) and scheduler (1 to 1000s of jobs)



which allows LIGO to utilize all compute elements currently available to LIGO to run jobs:



https://twiki.grid.iu.edu/bin/view/Main/RobertEngel#EinsteinHome_at_the_Open_Science



Benefits of running E@OSG on your Site

--------------------------------------



E@OSG continuously runs on many OSG resources mainly utilizing idle cycles that otherwise might be wasted. Our automatic error detection also informs us quickly about errors on grid resources, such as:



* lost mounts on worker nodes

* misconfigured firewalls on worker nodes

* failing GRAM and GridFTP services

* wrong set permissions on SRM and NFS directories



By opening GOC tickets we can quickly inform the resource provider about problems on the resource that otherwise might be unnoticed.

The OSG DocDB will be unavailable on Tuesday, July 5 between 07:00 and 08:00 central time.

The GOC will upgrade the following services beginning at Tuesday, June 28th, 2011 at 14:00 UTC. The GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



OIM



ITB version is now available for testing at https://oim-itb.grid.iu.edu/pub/

Updated OIM v1 legacy views. Switched OIM db URL to localhost, and updated obsolute MyOSG URLs [OIM-11]



GOC Ticket 1.38



ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Added list of emails under each security contact types [old JIR GOCTICKET-77]

Made security tickets to not listed in the /navigator unless user has authrozation for view_security_incident_ticket [GOCTICKET-81]

Added missing submitter metadata for custom form

Added a note for assignment tip in the ticket editor



MyOSG



Installed awstats (apache log analyzer) * please contact GOC for the URL if you’d like to test this.



OSG Jira



ITB version is now available for testing at https://jira-osg-itb.grid.iu.edu



Upgrading to version 4.3.4. Please see release notes since our last update

http://confluence.atlassian.com/display/JIRA043/JIRA+4.3.4+Release+Notes

http://confluence.atlassian.com/display/JIRA043/JIRA+4.3.3+Release+Notes

http://confluence.atlassian.com/display/JIRA043/JIRA+4.3.1+Release+Notes



Upgrading GreenHopper to 5.6.5

http://confluence.atlassian.com/display/GH055/GreenHopper+5.5+Release+Notes

http://confluence.atlassian.com/display/GH/GreenHopper+5.6+Release+Notes

http://confluence.atlassian.com/display/GH/GreenHopper+5.6.1+Release+Notes

http://confluence.atlassian.com/display/GH/GreenHopper+5.6.2+Release+Notes

http://confluence.atlassian.com/display/GH/GreenHopper+5.6.4+Release+Notes

http://confluence.atlassian.com/display/GH/GreenHopper+5.6.5+Release+Notes



Installing Links Hierarchy Report Plugin



Installing Gant Chart Plugin

OSG Collaborators,



Please join us in welcoming the George E Brown Network for Earthquake Engineering Simulation (NEES) VO to the OSG community! NEES is a shared national network of 14 experimental facilities, collaborative tools, a centralized data repository, and earthquake simulation software. Together, these resources provide the means for collaboration and discovery in the form of advanced research based on experimentation and computational simulations of the ways buildings, bridges, utility systems, coastal regions, and geomaterials perform during seismic events.



OSG User Support has worked with this VO for several months by helping them integrate their applications with OSG. We would like to ask opportunistic sites to grant NEES access to resources. Information about their work and science is available at http://nees.org.



NEES has been recently added to the VO Package. We urge you to update to this new VO package to enable the NEES VO for opportunistic use. Instructions for doing this can be found here: http://osggoc.blogspot.com/2011/06/new-vo-package.html



Thank you in advance for your support of this new OSG VO.

At approximately 3:00pm Eastern time the Indiana University DNS administrators erroneously removed myosg.grid.iu.edu from their DNS servers. The service was unavailable at myosg.grid.iu.edu but could be reached via myosg1.grid.iu.edu and myosg2.grid.iu.edu. This problem was fixed by DNS administrators at 4:00pm Eastern time. We apologize for any inconvenience this has caused.

Between 14:50 and 15:10 UTC one instance of MyOSG (myosg2) experienced a spike in memory usage.

Some users may have encountered slow response times during this period. We believe the problem

was transitory in nature and is currently not effecting service. As a precaution, the effected

instance will be removed from DNS round robin at noon eastern time. The memory allocated to

this machine will be increased and the process repeated on the remaining instance. We do not

anticipate visible interruption of service during this process.

The GOC will upgrade the following services beginning at Tuesday, June 14th, 2011 at 14:00 UTC. The GOC reserves eight hours (14:00 - 22:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

MyOSG 1.36



ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Moved the Tiny URL button to the top of the page, and made it to generate TinyURL in a single click (and the URL pre-selected) [MYOSG-11]



GOC Ticket 1.37



ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Renamed "Internal Activities" to "Footprints Activities", and renamed "Meta Information" to "Ticket Creation Information" in order to differentiate it from ticket metadata which are now key/value pairs stored in data.grid for each tickets.

Enabled shorter URL for ticket viewer (like.. https://ticket.grid.iu.edu/goc/10000)

Moved submitter DN information from update description to DB based metadata. Changed the layout for ticket viewer metadata in order to accommodate long value



GOC-Ticket Exchanger 1.19



Exchanging submitter DN between GGUS and Footprints so that ticket submitted through Footprints can be edited in GGUS via the same submitter.



OIM 2.35 (https://oim.grid.iu.edu)



ITB version is now available for testing at https://oim-itb.grid.iu.edu

Made Footprints ticket templates used during various registrations configurable via admin page [OIM-10]

Added contact type description field to contact type table in order to store tooltip information for each contact types.

Added tooltips for various contact type information based on the information stored in https://twiki.grid.iu.edu/bin/view/Operations/OIMTermDefinition#Contact [old-JIRA OIM-21]

Updated the WLCG flag labels so that their purposes are clear [old - OIM-53]

Made a service editor to be pre-inserted in a form during new resource registration.

Updated resource group selector inside resource registration form so that site & resource group can be selected independently in order to make it easier to specify resource group.

Added delete button inside Resource Downtime Editor.

Changed the way downtime records are “removed” by implementing ability to use "disable" flag instead of remove the downtime record physically.

Implemented GOCTicket metadata accesser with ability to set metadata (for SUBMITTER DN)

Various cosmetic changes.



RSV Gratia Collector (rsv.grid.iu.edu)



A major relocation of various key tables & query changes for RSV-SAM transporter.



GOC BDII



Changed the way resource summary XML was generated so that the final file creation step will be more atomic. (There is no change to the BDII service itself)



Software.grid.iu.edu



Installing AWStat (Apache Log Analyzer)

A new VO package is now available. This package adds the NEES VO and removes the JDEM VO.



A detailed list of changes is available at:

https://twiki.grid.iu.edu/bin/view/Operations/PackageV37



The GOC suggests backing up your installation before running any

update commands.



To pull the new VO Package for an OSG 1.0.x or 1.2.0 Resource please

use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-package



Please remember a UNIX account for 'nees' will need to be set up as specified in the VO Package V37 document referenced above. Also, if you have a local 'jdem' unix account it can be disabled.



To pull the new VO Package for the OSG Client 1.0.x or 1.2.0 please use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-client

During today's Operations Service upgrades the OSG BDII machines did not return as expected. The OSG BDII was unavailable from 16:10 UTC until 17:04 UTC. This maintenance was expected to be transparent as announced in the change log sent via mail and posted at http://osggoc.blogspot.com/2011/05/goc-service-update-tuesday-may-24th-at.html.



This was due to a system level update that included an OpenLDAP update that was not compatible with the BDII software. OpenLDAP was reverted and BDII is now fully functional.

The GOC will upgrade the following services beginning at Tuesday, May 24th, 2011 at 14:00 UTC. The GOC reserves eight hours (14:00 - 22:00 UTC) in the unlikely event that unexpected problems are encountered.  We encourage users to test affected services before the production release.





RSV Process 1.14

Made changes so that RSV Process will output RSV current status XML with ServiceUri, GatheredAt as well as DetailsData information collected from GOC’s Gratia Collector.



MyOSG 1.35

ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Added ServiceURI & GatheredAt indicator on Current RSV Status page similar to RSV history page.

Removed sam-bdii.cern.ch from list of top level BDII hosts to be testeed

VOMS Monitor Consolidator / Switched X509 certificate used to query VOMS servers from http certificate to host certificate stored on the server. It shouldn’t be using http certificate, and http certificate will soon replaced by InCommon certificate which will cause this consolidator to not function.



GOC Ticket 1.35

ITB version is now available for testing at https://ticket-itb.grid.iu.edu

Loosened the validation rule for RA form's sponsor name to allow period and single quote marks [TICKET-9]

Updated resource model so that it will optionally filter out disabled support centers.





RSV Gratia Collector (rsv.grid.iu.edu)

A major relocation of various key tables & query changes for RSV-SAM transporter.



GOC Ticket Synchronizer 1.18.1 (GOC-TX)

The update will be released in the morning of 5/25(Wednesday) after the GGUS upgrade has been completed.

Updated to new WSDL for GGUS version 7.5 (using Guenter’s alt. WSDL) https://savannah.cern.ch/support/?119899

Added InCommon & DOEGrid CA to trusted cacert file.

Fixed the way GOC Accessor handles errors while contacting GOC ticket to decide who to assign a ticket to. Also improved the error message to make it clear which assignee has been assigned as as alternative if the error occurs.

Added a default OriginNote setter for RTAccessor::get to be more consistent with other accessors.

Added Ticket ID to the GGUS2FP convert.

Added GGUS source ticket ID and more verbose information whenever GGUS passes invalid Resource / Resource Group values.

Added ticket exchange origin information for all updates made to GOC Ticket / Footprints





Operating system updates

The GOC will update the OS on all hosts, physical and virtual, and will apply the latest patches and updates.  This includes updates to the system libraries and kernel and will thus require a reboot of all hosts.

The servers that serve the Open Science Grid Gratia service will have their network

IP addresses changed on Friday, May 13 beginning at approximately 9:30 a.m. Work is

anticipated to finish by 10:30 a.m. but may last until 12 p.m.



The reporting servers will change first and then the gratia collectors. An OSG Gratia

reporting capacity should be available for most of this time due to high-availability

services. The OSG Gratia collection capacity is configured to catch up automatically

after any downtime.

There were intermittent network problems at Fermilab from approximately 10 a.m. CDT to 12:45 CDT today, Thursday, May 5.



Various on-site and off-site users reported timeouts accessing the OSG Gratia service. The Gratia service remained up throughout.



The network problems have now been resolved.

The GOC will upgrade the following services beginning at Tuesday, May 10th, 2011 at 14:00 UTC. The GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



OIM 2.33 (https://oim.grid.iu.edu)



ITB version is now available for testing at https://oim-itb.grid.iu.edu

Updated Support Center Ticket template (https://jira.opensciencegrid.org/browse/TICKET-7)

Installed capacity report / Added “ALICE Berkeley CA" to the list of expected Tier2 federations.





MyOSG 1.34 (https://myosg.grid.iu.edu)



ITB version is now available for testing at https://myosg-itb.grid.iu.edu

(Already released) Fixed a bug where URL for VO summary page was incorrect inside OIM search result

Resource Group / GIP Status / Added timestamp indicator for WLCG status section

Resource Group / RSV Status History / Added ServiceUri and GathereAt parameters for RSV probe result detail section to allow site administrator to find RSV record transport issues (https://jira.opensciencegrid.org/browse/MYOSG-9)





GOC Ticket Synchronizer 1.18 (GOC-TX)



GGUS Test instance is currently not functioning properly, and we are not able to test following changes. If GGUS test instance will not recover in time, we may not be able to include following changes in 5/10 release.

Added GGUS source ticket ID and more verbose information whenever GGUS passes invalid Resource / Resource Group values.

Updated GGUS WSDL from 7.1 to 7.5 as preparation to https://savannah.cern.ch/support/?119899

Added ticket exchange origin information for all updates made to GOC Ticket / Footprints

A new VO package is now available. This package adds the SURAGrid VO, the MAP Fermigrid sub-VO, the GM2 Fermigrid sub-VO, and updates the gums.template for CDF and CSIU.



A detailed list of changes is available at:

https://twiki.grid.iu.edu/bin/view/Operations/PackageV36



The GOC suggests backing up your installation before running any

update commands.



To pull the new VO Package for an OSG 1.0.x or 1.2.0 Resource please

use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-package



Please remember a UNIX account for 'suragrid','map', and 'gm2' will need to be set up as specified in the VO Package V36 document referenced above.



To pull the new VO Package for the OSG Client 1.0.x or 1.2.0 please use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-client

Today beginning at 2:30PM EDT network connectivity was lost for a period of approximately 13 minutes. This network outage caused all OSG services based solely at the Indianapolis Campus to be unavailable. This includes OIM and the OSG TWiki. Network connectivity was returned to normal at 2:43PM EDT. Services hosted at both campuses or solely on the Bloomington campus were not affected.

As some of you may have noticed, the ESNet-Root-CA has had service problems since yesterday (April 18, 2011). The CRL file published by the ESNet Root CA (not the DOEGrids CA) was not available at it's expected coordinates. The ESnet Operations Team has notified us that they put a fix in place to redirect to the new location. OSG Security along with a few OSG Site Administrators have tested the fix successfully. Please let us know if you still have any connection problems to the CRL server.



Please also remember that even if you receive (or had already received) error/failure messages, this situation will NOT affect your site's availability. The CRL file has a lifetime of a year and if you ever have downloaded a copy previously, you will continue your operations as usual. The error messages on RSV probes also does not affect your site availability metrics.



We are also aware that this problem may have affected WLCG users access to CERN Single-Sign-On service via their certificates. We believe the fix in place may take care of this problem. However, we have not verified this with CERN IT staff. We will inform you when we hear from them.

DOEGrids CA services will undergo planned maintenance on Wednesday, April 13, 2011 between 19:00 - 23:00 UTC. CRLs will not be affected. However, all other services on pki1.doegrids.org will be affected.



OSG users access to the grid resources will continue as normal. However, requests for new certificates and renewal of expiring certificates will not be processed during maintenance.

The GOC will upgrade the following services beginning at Tuesday, April 12th, 2010 at 14:00 UTC. The GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



OIM 2.32 (https://oim.grid.iu.edu)



ITB version is now available for testing at https://oim-itb.grid.iu.edu

Made Site Form’s State field optional

Installed Capacity Report Script / Updated to include VO ownership information for more detail please see https://ticket.grid.iu.edu/goc/viewer?id=10131



MyOSG / Gip Validator Consolidator



Made changes to the top level wlcg bdii monitor script so that BDII entries are loaded one at a time in order to minimize timeout issue possibly caused during low throughput events of IU network.

The DOEGrids services were restored late Friday evening. We have received confirmation that they have resumed normal operations as of Monday morning.



If you tried to submit a new certificate request or renew your certificate on Friday and received an error, please resubmit your request now.

Please see ticket 10187 at:
https://ticket.grid.iu.edu/goc/viewer?id=10187

OSG Operations has been informed the DOEGrid CA Services will remain offline for an unspecified period of time, this is likely to last through the weekend of April 2nd and 3rd. During this time all requests for new certificates and certificate renewals will not be processed by DOEGrids. We will alert you on Monday April 4th how users can obtain new certificates or renew their existing certificates. We are currently working to find a back up service.



This downtime will NOT affect the grid access for the users who already have unexpired certificates. OSG Resources will continue providing access and working as usual. Resources will NOT experience any critical RSV failures due to this down time (because the CA certificate and CRL files are still available). We will continue updating you as the situation develops. If the downtime continues over 72 hours, sites may experience a NON-CRITICAL failure of RSV probes. We will inform you promptly if that happens.

Please see ticket 10187 at:
https://ticket.grid.iu.edu/goc/viewer?id=10187

DOEGrids Agent Services (https://pki1.doegrids.org:8100/ca/) is currently unavailable. A CA administrator is investigating the root cause of the issue. No further information is available as to when the service will restored.



Please see ticket 10187 at:
https://ticket.grid.iu.edu/goc/viewer?id=10187

OSG Operations and Integration are pleased to announce the release of OSG version 1.2.19



******************************

OSG 1.2.19 Update Notification

******************************



Affected Components



The following components are affected:



* All RSV installations

* CE installations

* GUMS installations



Summary



This release contains the following updates:



* A new version of RSV with fixes for a race condition that may cause a site to go into the unknown status on MyOSG in rare instances. There is also a fix that allows probes to run correctly if RSV is started in a directory where the RSV user doesn't have read permissions

* Security and bug fixes to Tomcat, Java, MySQL

* Updates to PHP and Apache

* Configure-osg update which allows BDII or cemon configuration to be ignored as well a minor bugfix



This release fixes all the RSV bugs that were present in the previous release and should be appropriate for sites that report to the WLCG.



Update Instructions

Update instructions can be found on the OSG Twiki under the OSG 1.2 update instructions ( https://twiki.grid.iu.edu/bin/view/ReleaseDocumentation/OSG12UpdateInstructions ).



Additional Information

The release notes for the VDT 2.0.0p26 release underlying this release can be found here ( http://vdt.cs.wisc.edu/releases/2.0.0/release-p26.html ).

A new VO package is now available. This package adds the CSIU VO and updates the gums.template for Engage VO and CMS VO.



A detailed list of changes is available at:

https://twiki.grid.iu.edu/bin/view/Operations/PackageV35



The GOC suggests backing up your installation before running any

update commands.



To pull the new VO Package for an OSG 1.0.x or 1.2.0 Resource please

use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-package



Please remember a UNIX account for 'csiu' will need to be set up and pool accounts for engage-ucsdgrid if you plan on supporting these VOs.



To pull the new VO Package for the OSG Client 1.0.x or 1.2.0 please use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-client

The GOC will upgrade the following services beginning at Tuesday, March 22nd, 2011 at 14:00 UTC. The GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.



GOC Ticket 1.34 (https://ticket.grid.iu.edu)



ITB version is now available for testing at https://ticket-itb.grid.iu.edu





* Added a new REST interface for ticket search (used by MyOSG for now)

* Fixed the formatting of metadata.





MyOSG 1.33 (https://myosg.grid.iu.edu)



ITB version is now available for testing at https://myosg-itb.grid.iu.edu



* Added GOC Ticket for search target via GOC Ticket REST interface. Also added OIM contact's primary email for search target (only available for registered OIM users)



GOC Ticket Synchronizer 1.17 (GOC-TX)



* Added filter for RT accessor so that invalid XML character won't be introduced to GOC-TX system.



TWiki (http://twiki.grid.iu.edu)

ITB version is now available for testing at https://twiki-itb.grid.iu.edu; we encourage users to test this service before the production release.



* Increased SSL renegotiation buffer size in order to allow larger attachments.



All Services

We are making various backend changes that should make all services run more smoothly.



* Changes to Puppet server management software configuration: Puppet will no longer run as a daemon in the background but as a cron job on a similar schedule. This should free up memory for more important processes.





* Change to how GOC servers share public SSH host keys with each other: The Puppet server will generate a flat file, and Puppet clients will pull it, rather than using Puppet's 'storeconfig' database, which was losing track of keys somehow.





* New Puppet rules: Puppet will ensure that the GOC's existing nscd and sshd custom configurations are uniformly applied across all servers -- nscd restarts daily to keep it from locking up, and sshd only logs inactive users out after an extraordinarily long period of time. Note that these changes are already on most servers and have been for some time; this will simply ensure that they are on all.

In light of the tragic events in Japan, the staff at the GOC hopes for the best for all of those affected by the earthquakes and tsunamis.



Specific to OSG Operations and Security we are, and will continue to see, RSV Warnings for the CRL Expiry Probe. This probe is non-critical and will not affect the resource status in OSG or WLCG. But, administrators should be aware that this warning may last until network connectivity is restored at the institutions serving Japanese CRLs. These CRLs include AIST and KEK.



We just learned that NAREGI CA has recovered connectivity. Therefore, this advisory only affects KEK CA and AIST CA.



We have around 80 users with certificates from KEK CA. We found no users

in OSG with a certificate issued by AIST CA. KEK CA CRL is scheduled to

expire on April 9, 2011 and AIST CRL is scheduled to expire on March 26,

2011. Both CA certificates have lifetimes through 2015. If connectivity

is not recovered by CRL expiration dates, our users with KEK and AIST

certificates will not be able to access grid resources due to expired

CRL files. We will give you more information once we understand how long

the recovery will take, and we will seek ways to restore access to

affected users.



Thank you,

OSG Operations

OSG DocDB may experience a brief outage on Thursday, March 10 between 07:00 and 08:00 CDT while the server reboots. The reboot and accompanying outage are related to work in another database and will not otherwise affect OSG DocDB.

The GOC will upgrade the following services beginning at Tuesday, March 8th, 2010 at 14:00 UTC. The GOC reserves eight hours (14:00 - 22:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

MyOSG 1.32 (https://myosg.grid.iu.edu)

ITB version is now available for testing at https://myosg-itb.grid.iu.edu

Added OIM Search box that allows user to search various OIM entities which returns links to various OSG entities related to each entities. If no result is found, it provide link to OSG custom search provided by Google.
Various cosmetic / efficiency updates.

A new release of the CA certificates is available at

http://software.grid.iu.edu/pacman/cadist/.



This is version 1.17 and uses IGTF 1.38 as the basis.





Changes to the OSG certificates package:



===== Version 1.17 ==============

Built 7 Feb 2011

IGTF 1.38 - current hash format (openssl 0.9x)



Changes from by IGTF

* Updated meta-data info file for SRCE (HR)

* Updated KEK CA root (617ff41b) with extended life time (JP)

* Updated contact email address for ArmeSFo (AM)

* Extended allowed namespace and new URL for SEE-GRID CA as EGI catch-all (EU)

* Extended allowed namespace for NAREGI CA (JP)

* Added accredited CILogin MICS CA (US)

* Extended life time for NCSA CACL (MICS) CA (US)

* Extended life time for NCSA MyProxy (SLCS) CA (US)

* Extended life time for NorduGrid CA (DK,NO,SE,FI,SI)

* Corrected namespaces file for TCS eScience Personal (EU)



Additional OSG Changes:

None

OSG Operations and Integration are pleased to announce the release of OSG version 1.2.18



******************************

OSG 1.2.18 Update Notification

******************************



Date: February 16, 2011



Affected Components



The following components are affected:



* All RSV installations



Summary



This release contains the following updates:



* RSV 3.3.6 which fixes two bugs:

* A reporting bug that prevents WLCG availability from being reported to the GOC correctly

* A bug that prevents successfully sent reports from being deleted correctly and results in those records accumulating on the system



This release fixes all the RSV bugs that were present in the previous release. However, in our post-release testing, we found a new bug that in some rare circumstances could prevent WLCG availability statistics from being reported. While this is an unlikely occurrence, we recommend that sites which depend on WLCG availability reporting should hold off to the next release that will fix this bug. We believe this bug fix can be released within a week.



Update Instructions

Update instructions can be found on the OSG Twiki under the OSG 1.2 update instructions ( https://twiki.grid.iu.edu/bin/view/ReleaseDocumentation/OSG12UpdateInstructions ).



Additional Information

The release notes for the VDT 2.0.0p25 release underlying this release can be found here ( http://vdt.cs.wisc.edu/releases/2.0.0/release-p25.html ).

The GOC will upgrade the following services beginning at Tuesday, February 22th, 2010 at 14:00 UTC. The GOC reserves eight hours (14:00 - 22:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

OIM 2.31 (https://oim.grid.iu.edu)



ITB version is now available for testing at https://oim-itb.grid.iu.edu



(patched) Fixed a bug that prevents resource registration ticket to be created if support center for the resource can not be found (soap element count for assignee field issue)

Improved the way error log was generated during footprint ticket generation.



GOC Ticket 1.33 (https://ticket.grid.iu.edu)



ITB version is now available for testing at https://ticket-itb.grid.iu.edu



Updated ticket title style for simple ticket updater.

Added a prompt to ask user if user really wants to submit a form without entering any update text.

Changed wording on VO form

(patched) Combined first and last name fields on ticket viewer / editor to be consistent with how name field is handled internally.

(patched) Fixed a bug on custom form (for admin only) error messages

TWiki (http://twiki.grid.iu.edu)



ITB version is now available for testing at https://twiki-itb.grid.iu.edu; we encourage users to .test this service before the production release.



TWiki's X509 authentication plugin has been replaced by GOC's custom made User authentication module which uses Apache's native x509 feature, and direct access to OIM authe/autho tables. This update will fix FNAL Certificate issue and other issues that have been discovered recently.

Fixed the MIME issue with various MS. Office documents on IE.

Setup forwarding from http to https (like it used to)



MyOSG 1.31 (https://myosg.grid.iu.edu)



ITB version is now available for testing at https://myosg-itb.grid.iu.edu



Added a link to user feedback form.

Made OpenTickets model more error resistant (in case of GOC Ticket connectivity issue)

(patched) Added missing CSS images



OSG Display (http://display.grid.iu.edu)



Modified SQL queries used for Gratia DB which might be causing performance issue (this update has not be finalized yet, and it is experimental until proven effective)



Operating System updates

RHEL operating system patches will be applied to bring systems up to date. A reboot will be required resulting in brief outages during the maintenance period.

Hello everyone,



Today we discovered a bug in the most recent OSG software release (1.2.17, released on Monday, February 7th) that affects WLCG availability reporting for sites. Sites may go into an UNKNOWN state one day after updating.



If you have not yet updated to version 1.2.17, we recommend that you wait until version 1.2.18. We expect to release it on Tuesday, February 15th.



If you have already updated to version 1.2.17, an easy workaround exists; we will have details available tomorrow after we conclude an initial round of testing. If your site has already reported as UNKNOWN, the GOC can help update the accounting records so that your site is not incorrectly marked as UNKNOWN.



In addition, we have identified the reason that we missed this bug in testing, and we have updated our Integration Testbed procedures to catch this type of problem in the future.



We apologize for any inconvenience.



-alain

-----------------------------------------------------------------

Alain Roy

Open Science Grid Software Coordinator roy@cs.wisc.edu

http://opensciencegrid.org http://vdt.cs.wisc.edu

OSG Operations and Integration are pleased to announce the release of OSG version 1.2.17



******************************

OSG 1.2.17 Update Notification

******************************



Date: February 7, 2011



Affected Components



The following components are affected:



* All OSG software installations



Summary



This release incorporates a variety of fixes and changes to various OSG software components. RSV has been changed to use a new rsv-control script that allows for more control when starting, stopping, and running RSV probes. RSV now also has better support for a standalone RSV monitoring system. Bestman and Bestman2 have been updated to more recent version with several improvements and bug fixes. In addition, a new version of GIP has been included. The GIP update includes several job manager related bug fixes as well as support for WLCG site attributes..



* RSV has had a major overhaul to how it works. See theRSV documentation ( http://twiki.grid.iu.edu/bin/view/MonitoringInformation/RSV33 ) for full details.

* Bestman and SRM-Client-LBNL have been updated to 2.2.1.3.18

* Bestman2, Bestman-Client, and SRM-Tester3-LBNL have been updated to 2.0.5

* SRM-Client-Fermi has been updated to 1.9.5-23

* GIP has been updated to 1.1.14 and now supports advertising of WLCG site information

* MyProxy has been updated to address a security issue

* Gratia has been updated and now supports HTPC accounting



Update Instructions

Update instructions can be found on the OSG Twiki under the OSG 1.2 update instructions ( https://twiki.grid.iu.edu/bin/view/ReleaseDocumentation/OSG12UpdateInstructions ).



Additional Information

The release notes for the VDT 2.0.0p24 release underlying this release can be found here ( http://vdt.cs.wisc.edu/releases/2.0.0/release-p24.html ).

The GOC will upgrade the following services beginning at Tuesday, February 8th, 2010 at 14:00 UTC. The GOC reserves four hours (14:00 - 18:00 UTC) in the unlikely event that unexpected problems are encountered. We encourage users to test affected services before the production release.

OIM 2.30 (https://oim.grid.iu.edu)



ITB version is now available for testing at https://oim-itb.grid.iu.edu



Made Site Form to not allow user from selecting disabled or inactive support centers.

Added a new OIM authorization action in order to allow security team to update contact information.

MyOSG / GIP-Validator



top-level-wlcg-bdii-monitor / Added LDAP timeout (5 seconds for each host) to handle unresponsive WLCG LDAP instances in order to avoid script timeout.

VO Matrix (v1.12) / Fixed bugs on VO matrix generator where invalid VO information from RSV can cause null pointer exception.



OSG Display (http://display.grid.iu.edu)



ITB version is now available for testing at https://display-itb.grid.iu.edu



Updated Gratia SQL used to query source data in order to improve query performance.

TWiki (http://twiki.grid.iu.edu)



To correct a networking irregularity, the virtual server on the OSG TWiki's virtual machine host must be restarted. No other virtual machines share the same host, so no other services will be affected. The total downtime should not exceed 15 minutes.



We appreciate your understanding for the delay in this announcement. Weather emergencies in Indiana have caused staffing difficulties.

A new VO package is now available. This package removes the GRASE VO, which is now functioning under the NYSGrid VO. It also removes the FNAL CMS VOMS entry from the vomses file, due to an error experienced by CMS users when this instance is used.



A detailed list of changes is available at:

https://twiki.grid.iu.edu/bin/view/Operations/PackageV34



The GOC suggests backing up your installation before running any

update commands.



To pull the new VO Package for an OSG 1.0.x or 1.2.0 Resource please

use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-package



Please remember a UNIX account for 'hcc' will need to be set up.



To pull the new VO Package for the OSG Client 1.0.x or 1.2.0 please use:

# cd $VDT_LOCATION

# source setup.sh

# pacman -update vo-client

Please see ticket 9835 at:
https://ticket.grid.iu.edu/goc/viewer?id=9835