Nas02 - node 6 battery failed ( node is read only)

No impact on service during period
Service affected: nas02 Group & Home File Shares
Start: 23 Dec 2017, 9:09 AM
End: Unknown
Login to request notification
node 6 of the nas02 Isilon cluster has failed a battery test. this has place the node in a read-only state.

No impact to customers. Only a reduction is available capacity.
Update: 29 Dec 2017, 10:20 AM
Battery shows good status from Hardware logs. Running manual battery test. If this complete OK, then read-only state will clear from node. If it fails, then new part will be dispatched.

Emails blocked by spam filtering

Reduced service delivery during period
Service affected: Mimecast
Start: 13 Dec 2017, 4:07 PM
End: Unknown
Login to request notification
Spam filters are blocking legitimate emails and email domains. The algorithms for blocking emails are currently being assessed.

Email not available for some people

Reduced service delivery during period
Service affected: Exchange Mail and Calendaring
Start: 27 Nov 2017, 12:45 PM
End: Unknown
Login to request notification
Users are reporting that their email is offline, or that Outlook cant connect to Exchange.

Intermittent Outages affecting Outlook and other critical systems

Reduced service delivery during period
Service affected: Exchange Mail and Calendaring
Start: 20 Nov 2017, 10:04 AM
End: Unknown
Login to request notification
Intermittent outages of login, service connectivity and outlook email.

ITS are currently investigating.

Please contact the Service Desk on 56000 if you are affected by this outage.

Note: some people have reported that Outlook problems can be resolved by restarting outlook.
Update: 21 Nov 2017, 10:13 AM
Restarting cache may fix outlook issues: 1. turn cache off. 2. wait for inbox to update. 3. turn cache back on.

Eduroam and UQ connection issues with Microsoft Win 10 Creators Update

No impact on service during period
Service affected: Wireless Network
Start: 12 May 2017, 8:00 AM
End: Unknown
Login to request notification
Windows 10 creators update is causing issues with Eduroam and UQ wireless networks. Please use the Microsoft troubleshooting tool to resolve the issues @ https://aka.ms/diag_cssemerg11005

More information can be found at https://appuals.com/slow-wifi-issues-after-installing-creators-update-fix/

Resolution: 19 Jul 2017, 7:34 AM
Automatic resolution.
Resolution: 19 Jul 2017, 7:34 AM
Microsoft have resolved the issue with the latest update

Shutdown and Retirement of Lync 2010 System - Replaced by Zoom

Resolved
Service affected: MS Lync 2010 - DECOMMISSIONED
Start: 19 Jan 2018, 11:00 AM
End: 19 Jan 2018, 12:00 PM
Login to request notification
The on-premise Microsoft Lync 2010 system has been replaced by Zoom. Most user have been using Zoom over the last 12 months.

Information about Zoom can be found on the ITS Website.

In preparation for the decommission of the Lync system, the servers will be shutdown first. The decommission of the Lync system will then commence at the beginning of February.

Most Lync users who have been migrated to Office 2016 should have already moved over to Zoom.
Resolution: 19 Jan 2018, 12:00 PM
Automatic resolution.

Management Outage to Gatton Solar Farm

Resolved
Service affected: Gatton Solar Farm Firewall
Start: 17 Jan 2018, 6:00 PM
End: 17 Jan 2018, 7:00 PM
Login to request notification
Firewall patching
Resolution: 17 Jan 2018, 7:00 PM
Automatic resolution.

UQ wireless service partial outage

Resolved
Service affected: Wireless Network
Start: 13 Jan 2018, 9:00 AM
End: 13 Jan 2018, 2:41 PM
Login to request notification
Users may currently be experiencing connectivity issues with Eduroam and UQ wireless service. ITS engineers are investigating.
Resolution: 13 Jan 2018, 2:41 PM
DHCP server configuration updated.

DNS failure

Resolved
Service affected: CAHP - Casual Academic Hire & Payment
Start: 11 Jan 2018, 10:30 AM
End: 11 Jan 2018, 11:22 AM
Login to request notification
The DNS for for CAHP project (simo.uq.edu.au) is not resolving correctly. We are taking steps to restore functionality and the system should be available again, soon.
Resolution: 11 Jan 2018, 11:22 AM
The DNS issue has been resolved and access to the system has been restored. Apologies for the inconvenience.
Update: 11 Jan 2018, 11:25 AM
The problem has been fixed and service has been restored. Apologies for the inconvenience.

Infrastructure patching

Resolved
Service affected: Unitask
Start: 10 Jan 2018, 4:00 PM
End: 10 Jan 2018, 4:30 PM
Login to request notification
Unitask production instances (EC2) will be patched today to mitigate potential security vulnerabilities.

An outage of a couple of minutes is expected.
Resolution: 10 Jan 2018, 4:30 PM
Automatic resolution.

Mac Mail in Office 365

Resolved
Service affected: Exchange Mail and Calendaring
Start: 10 Jan 2018, 9:30 AM
End: 12 Jan 2018, 1:09 PM
Login to request notification
An issue has been identified where Mac Mail is not sending or recieving email for accounts hosted in Office 365.

The issue can be worked around by using the web portal in the mean time: https://outlook.office.com

ITS staff are investigating the cause of the issue.
Resolution: 12 Jan 2018, 1:09 PM
Apple Mac mail is working again for users who have had their staff mailbox on office365. Those Mac Mail users with on premise mailbox were not not affected. Also, issues relating to some office 365 users with iPhones and Android phone and the native mail clients are now resolved. We do not know the root cause or true resolution of the issue. We are still working with some vendors and working through the troubleshooting logs to see if anything can be identified.
Resolution: 12 Jan 2018, 1:09 PM
Apple Mac mail is working again for users who have had their staff mailbox on office365. Those Mac Mail users with on premise mailbox were not not affected. We do not know the cause or resolution of the issue. However, we are still working with some vendor and looking through the troubleshooting logs to see if anything can be identified.

Change mail routing from exchange

Resolved
Service affected: Mail Routing
Start: 9 Jan 2018, 12:00 PM
End: 9 Jan 2018, 12:30 PM
Login to request notification
Change mail routing from exchange to be directed to the mail security gateway.
Resolution: 9 Jan 2018, 12:30 PM
Automatic resolution.

Install Windows Patches - Commvault Servers

Resolved
Service affected: Backup
Start: 9 Jan 2018, 9:30 AM
End: 9 Jan 2018, 4:00 PM
Login to request notification
Install latest windows patches on Commserve and Media Agents
Resolution: 9 Jan 2018, 4:00 PM
Updates applied

Change mail routing from exchange

Resolved
Service affected: Mail Routing
Start: 4 Jan 2018, 6:00 PM
End: 4 Jan 2018, 6:30 PM
Login to request notification
Change mail routing from exchange to be directed to the mail security gateway.
Update: 5 Jan 2018, 12:02 AM
Change was reverted at 11.30pm (4/1/18). An issue was identified where uq email addresses which forwarded to an external email address would bounce because it is classified as a relay message (e.g. the external address appears to be impersonating an uq email address). Further investigate is require before this change can be reattempted.
Resolution: 4 Jan 2018, 6:30 PM
Automatic resolution.

Lost Connection with Cloud Server

Resolved
Service affected: Oracle Cloud Services CRM and Marketing Automation
Start: 4 Jan 2018, 3:03 PM
End: 4 Jan 2018, 3:47 PM
Login to request notification
All instances and environments offline
Resolution: 4 Jan 2018, 3:47 PM
Automatic resolution.

Echo360 maintenance

Resolved
Service affected: Echo360 Servers
Start: 29 Dec 2017, 10:00 AM
End: 29 Dec 2017, 10:45 AM
Login to request notification
Echo360 will under security maintenance on the 29th of December.
ITS apologies for any inconvenience.
Resolution: 29 Dec 2017, 10:45 AM
Automatic resolution.

Blackboard upgrade

Resolved
Service affected: Blackboard
Start: 27 Dec 2017, 8:00 AM
End: 29 Dec 2017, 1:00 PM
Login to request notification
On the 27th, 28th and 29th of December Blackboard will be upgraded to Q4 2016 CU 6. Blackboard will be unavailable for use during this time. For more information on this upgrade, please see the UQ eLearning website (https://www.elearning.uq.edu.au/projects/learnuq-upgrade-timeline-2017).
Resolution: 29 Dec 2017, 1:00 PM
Blackboard has been successfully upgraded. Learn.uq.edu.au is now available again.

Deployment of new version of Graduate School processes

Resolved
Service affected: Unitask
Start: 21 Dec 2017, 8:00 AM
End: 21 Dec 2017, 8:45 AM
Login to request notification
New version of three existing Graduate School processes and an update to a Student Administration API will be deployed to UniTask production.

Updated processes are:
* Attainment of Milestone
* Thesis submission
* Change of Research project

Resolution: 21 Dec 2017, 8:45 AM
Automatic resolution.

Deployment of new version of a Student Administration process.

Resolved
Service affected: Unitask
Start: 18 Dec 2017, 4:30 PM
End: 18 Dec 2017, 5:00 PM
Login to request notification
A new version of a Student Administration process will be deployed to UniTask production.

Updated process is:
* Removal of financial liability
Resolution: 18 Dec 2017, 5:00 PM
Automatic resolution.

Upgrade NGDC Serverfarm Firewalls

Resolved
Service affected: NGDC Serverfarm Firewall
Start: 18 Dec 2017, 7:00 AM
End: 18 Dec 2017, 9:00 AM
Login to request notification
Upgrade Firewall OS
Resolution: 18 Dec 2017, 9:00 AM
Automatic resolution.

snapclient01 clusterware failing to start

Resolved
Service affected: Oracle Tier 1 DB Hosting
Start: 17 Dec 2017, 11:54 AM
End: 18 Dec 2017, 11:09 AM
Login to request notification
Please note: Database services are not impacted as part of this incident however one compute node in the underlying infrastructure is offline.

An issue has arisen which is preventing the restart of clusterware services on snapclient01 which has to be patched as part of CR 3507 and planned service notice 17010

Oracle Grid Infrastructure Configuration Changes to use RDS protocol instead of UDP for cluster interconnect communication and apply patch for bug 26271158 (RAC One Node database crash post GI upgrade to 12.2.0.1)

Data Services DBA team have raised a ticket with the Oracle for support.

Resolution: 18 Dec 2017, 11:09 AM
The root cause was found to be incorrect ownership of clusterware binary files. Once the ownership was set correctly the services were restarted successfully
Update: 18 Dec 2017, 11:10 AM
SR has been raised with Oracle support. Diagnosis of root cause is still ongoing

The Oracle Tier 1 DB Hosting service will be undergoing scheduled maintenance

Resolved
Service affected: Oracle Tier 1 DB Hosting
Start: 17 Dec 2017, 8:00 AM
End: 17 Dec 2017, 12:00 PM
Login to request notification
Oracle Grid Infrastructure Configuration Changes to use RDS protocol instead of UDP for cluster interconnect communication and apply patch for bug 26271158 (RAC One Node database crash post GI upgrade to 12.2.0.1)
Resolution: 17 Dec 2017, 12:00 PM
All databases have been successfully switched from snap-cluster to crackle-cluster. The rest of the planned patching has been cancelled due to clusterware issues on one node in snap-cluster. All database services have been restored. The clusterware issue will be tracked as part of an incident report.
Update: 17 Dec 2017, 11:54 AM
snapclient01 did not restart as part of this patching. SR has been raised with Oracle Incident report to follow Patching has been cancelled until diagnosis of the root cause is complete

Lync Server with reduced functionality

Resolved
Service affected: MS Lync 2010 - DECOMMISSIONED
Start: 16 Dec 2017, 11:55 AM
End: 19 Jan 2018, 12:01 PM
Login to request notification
There is an issue with the underlying legacy database used by the lync system. This has caused the lync system to operate in a limited functionality. Most user have been migrating to the Zoom system. A fixed is being investigated, however, this system has been replaced by the Zoom system and is scheduled to be retired in the near future.
Resolution: 19 Jan 2018, 12:01 PM
Lync system has now been powered down in preperation to be decommissioned. User should be using the Zoom system.

Upgrade PaperCut to the latest version

Resolved
Service affected: Papercut Print Services
Start: 16 Dec 2017, 7:00 AM
End: 16 Dec 2017, 11:00 AM
Login to request notification
UQs current version of PaperCut is V16.2 which was installed in August 2016. Application Administration would like to upgrade it to V17.3.6.
Resolution: 16 Dec 2017, 11:00 AM
Automatic resolution.

Soefile and PS89dev connection error

Resolved
Service affected: File Serving - Unix
Start: 12 Dec 2017, 1:54 PM
End: 12 Dec 2017, 2:49 PM
Login to request notification
Customers making new connections were denied access. Existing connections worked OK.
Resolution: 12 Dec 2017, 2:49 PM
AD Account was deleted, restored AD account.

Deployment of new version of Student Administration processes

Resolved
Service affected: Unitask
Start: 11 Dec 2017, 4:30 PM
End: 11 Dec 2017, 5:00 PM
Login to request notification
A new version of five Student Administration processes will be deployed to UniTask production and an existing process will be updated.

The new processes are:
* Removal of financial liability
* Change of finalised grade
* Extension of assessment due date
* Extend studies and new confirmation of enrollment
* Student fee refund

Updated process is:
* Withdrawal without academic penalty

Resolution: 11 Dec 2017, 5:00 PM
Automatic resolution.

Enable deny rule for block 152.98.200.0/21

Resolved
Service affected: Firewalls
Start: 11 Dec 2017, 7:00 AM
End: 11 Dec 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 152.98.200.0 to 152.98.207.255 that do not have an existing firewall rule
Resolution: 11 Dec 2017, 7:05 AM
Automatic resolution.

Adobe connect unable to launch meetings

Resolved
Service affected: Adobe Connect
Start: 9 Dec 2017, 10:59 AM
End: 4 Jan 2018, 3:20 PM
Login to request notification
Adobe connect is currently unable to launch meetings due to an SSL misconfiguration.
ITS technicians are investigating.
Resolution: 4 Jan 2018, 3:20 PM
Adobe meetings are now available again.
Resolution: 4 Jan 2018, 3:20 PM

Exchange Client Access Service Tier - Configuration Change for cross-premise calendar sharing

Resolved
Service affected: Exchange Mail and Calendaring
Start: 7 Dec 2017, 10:00 PM
End: 7 Dec 2017, 10:30 PM
Login to request notification
Due to a newly discovered configuration issue with shared calendar access for users who have been migrated to the Office 365 service, an emergency configuration change needs to take place on UQs on-premise Exchange Client Access Servers.

Clients using Outlook Web Access, ActiveSync (mobile devices) or EWS clients such as MacMail may experience a brief service connectivity outage.
Resolution: 7 Dec 2017, 10:30 PM
Automatic resolution.

ITS Jira unavailable

Resolved
Service affected: ITS Jira
Start: 6 Dec 2017, 8:05 AM
End: 6 Dec 2017, 10:20 AM
Login to request notification
ITS Jira is currently unavailable.
ITS technicians are investigating.
Resolution: 6 Dec 2017, 8:20 AM
Automatic resolution.
Resolution: 6 Dec 2017, 8:20 AM
ITS Jira is now available again. Root cause is still being investigated.

Scheduled Maintenance - Deployment of Graduate School processes to UniTask production

Resolved
Service affected: Unitask
Start: 6 Dec 2017, 8:00 AM
End: 6 Dec 2017, 9:00 AM
Login to request notification
New version of Graduate School processes will be deployed to UniTask production.
Resolution: 6 Dec 2017, 9:00 AM
Automatic resolution.

Enable deny rule for block 152.98.192.0/21

Resolved
Service affected: Firewalls
Start: 6 Dec 2017, 7:00 AM
End: 6 Dec 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 152.98.192.0 to 152.98.199.255 that do not have an existing firewall rule
Resolution: 6 Dec 2017, 7:05 AM
Automatic resolution.

Enable deny rule for block 130.102.168.0/21

Resolved
Service affected: Firewalls
Start: 4 Dec 2017, 7:00 AM
End: 4 Dec 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 130.102.168.0 to 130.102.175.255 that do not have an existing firewall rule
Resolution: 4 Dec 2017, 7:05 AM
Automatic resolution.

Legacy Echo360 Maintenance

Resolved
Service affected: Echo360 Servers
Start: 2 Dec 2017, 7:00 AM
End: 2 Dec 2017, 7:30 AM
Login to request notification
The Legacy Echo360 system (Containing previous semester recordings) will undergo security maintenance on Saturday December 2nd between 7:00am and 7:30am
Resolution: 2 Dec 2017, 7:30 AM
Automatic resolution.

Deployment of new version of Worklist to production

Resolved
Service affected: Unitask
Start: 1 Dec 2017, 9:15 AM
End: 1 Dec 2017, 9:45 AM
Login to request notification
A new version of Worklist will be deployed. No impact is expected to Unitask users.
Resolution: 1 Dec 2017, 9:45 AM

Enable deny rule for block 130.102.160.0/21

Resolved
Service affected: Firewalls
Start: 29 Nov 2017, 7:00 AM
End: 29 Nov 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 130.102.160.0 to 130.102.167.255 that do not have an existing firewall rule
Resolution: 29 Nov 2017, 7:05 AM
Automatic resolution.

Semester 2 2017 Grade Release

Resolved
Service affected: SI-net
Start: 29 Nov 2017, 6:00 AM
End: 29 Nov 2017, 5:00 PM
Login to request notification
Please note that Semester 2 2017 grade release occurs on the morning of Wednesday, 29th November. This involves distribution of results to students by email and SMS from 7:30am. There will be increased access of mySI-net, my.UQ, email and other services by students from 6am onwards. Results are opened to students in mySI-net at 9:00am.
Resolution: 29 Nov 2017, 5:00 PM
Automatic resolution.

ServiceView & Service Status page maintenance

Resolved
Service affected: ServiceView
Start: 28 Nov 2017, 5:00 PM
End: 28 Nov 2017, 7:00 PM
Login to request notification
ServiceView and the Service Status page will undergo maintenance to update the SSL certificate used. No noticeable outage is expected.
Resolution: 28 Nov 2017, 7:00 PM
The maintenance has been completed successfully.

Power loss at Indroopilly Mine

Resolved
Service affected: Networks
Start: 28 Nov 2017, 11:00 AM
End: 28 Nov 2017, 1:00 PM
Login to request notification
There is an electrical issue at Indroopilly mine. To aid in Fault Finding, the P&F electrician has removed power to the site.

This will affect all services and no estimated repair time has been provided.

Pete Keeffe
Manager, Networks &DC
Resolution: 28 Nov 2017, 1:00 PM
Power restored

Carrier ISDN outage at Herston

Resolved
Service affected: PABX Voice Services
Start: 27 Nov 2017, 11:45 AM
End: 28 Nov 2017, 5:46 PM
Login to request notification
Technicians are investigating a fault with ISDN service at Herston campus. Fault has been logged with carrier.

Fault only impacting indial ranges at Herston campus 0733465000-07334655599 and 0733655000 - 0733655599
Update: 29 Nov 2017, 7:15 AM
Range 0733655000 to 5599 is still being diverted to UQ operator. All other ranges are now working. Fault still only impacting inbound calls from external to the UQ PABX.
Resolution: 28 Nov 2017, 5:46 PM
Automatic resolution.
Resolution: 28 Nov 2017, 5:46 PM
Carrier has ported range to StLucia PABX as determined physical cut to carrier service to Herston campus
Update: 28 Nov 2017, 8:00 AM
All external/inbound calls to the Herston campus are being diverted to the UQ operator who is transferring calls. Internal and external calls are working from the Herston campus, the fault relates to inbound calls from the carrier network. Carrier technician is onsite this morning.
Update: 27 Nov 2017, 3:15 PM
Carrier has identified a problem with upstream carrier access path. Carrier has escalated fault and implemented call diversion to UQ operator as temporary work around

Nas02 (isilon-CCR) SyncIQ Jobs Failing

Resolved
Service affected: nas02 Group & Home File Shares
Start: 27 Nov 2017, 8:11 AM
End: 27 Nov 2017, 10:00 AM
Login to request notification
SyncIQ jobs started failing at 0811 27/11/17.

These SyncIQ jobs backup data on nas02 (CCR) by replicating it to nas01 (PRN).

EMC Support have been contacted and technicians are investigating this issue.


0906 update: DNS issue identified, currently being investigated.
Resolution: 27 Nov 2017, 10:00 AM
DNS change (CR#3480) caused this issue flushdns performed on cluster which resolved the SyncIQ issues.
Resolution: 27 Nov 2017, 10:00 AM
Automatic resolution.
Update: 27 Nov 2017, 10:10 AM
0900 - DNS issues identified and resolved 1000 - SyncIQ still having issues - /flushdns perfomed on both clusters and SyncIQ recovered.

Update Drupal CMS to release v1.55.1

Resolved
Service affected: CMS - ITS Drupal
Start: 27 Nov 2017, 8:00 AM
End: 27 Nov 2017, 4:00 PM
Login to request notification
The following updates will affect Stage, Prod and Sandbox sites using the Standard UQ Drupal Distribution.

The following updates will affect live sites, stage sites and sandbox sites using the Standard templates.

New features:

Added a label to snippets for editors to more easily identify them on a page of content.
Updated Secure CKFinder resources with updated allowed file type lists.
Add support menu to admin menu.

Bug fixes:

Patched fieldable_panel_panes to avoid invalid error messages for logged in users.
FIxed default content importing issues to avoid duplicated content being created.
Disabled Profile content type creating new revisions to avoid conflicts with imported profiles.

Technical upgrades under the hood:

Updated entityqueue from 1.1 to 1.2.
Updated field_group from 1.5 to 1.6.
Patched fieldable_panel_panes.
Resolution: 27 Nov 2017, 4:00 PM
Automatic resolution.

Enable deny rule for block 130.102.128.0/21

Resolved
Service affected: Firewalls
Start: 27 Nov 2017, 7:00 AM
End: 27 Nov 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 130.102.128.0 to 130.102.135.255 that do not have an existing firewall rule
Resolution: 27 Nov 2017, 7:05 AM
Automatic resolution.

Migrate (Non-WebDNS) DNS zones to Bluecat

Resolved
Service affected: DNS
Start: 27 Nov 2017, 6:00 AM
End: 29 Nov 2017, 4:00 PM
Login to request notification
Move all zones hosted on legacy nameservers apart from slave, dynamic, autodns or webdns zones.

Full list too large for serviceview (over 300) however please note that this includes moving root zone uq.edu.au.

All imports are made and checked before updating nameserver delegation (no downtime).

Import will be instant and most important domains will be delegated first. Updating zone delegation and allowing for ttl expiry will take longer so the change window is spread across a few days.
Resolution: 29 Nov 2017, 4:00 PM
Automatic resolution.

Echo360 Cloud Migration

Resolved
Service affected: Echo360 Servers
Start: 26 Nov 2017, 7:00 AM
End: 26 Nov 2017, 5:00 PM
Login to request notification
Echo 360 recording will be intermittently unavailable on Sunday 26th while the recording devices are cut over to the new Echo Cloud instance.
Existing recordings will not be affected, and will be available to play.
Resolution: 26 Nov 2017, 5:00 PM
Automatic resolution.

IpAlloc Database unavailable during maintenance

Resolved
Service affected: IpAlloc VPN IP allocation
Start: 25 Nov 2017, 8:00 AM
End: 25 Nov 2017, 9:30 AM
Login to request notification
Shutdown IpAlloc database during ZFS maintenance
Resolution: 25 Nov 2017, 9:30 AM
Automatic resolution.

OS patching for Oracle SNAP Development DB Linux Hosts

Resolved
Service affected: Oracle Tier 3 DB Hosting
Start: 25 Nov 2017, 8:00 AM
End: 25 Nov 2017, 9:30 AM
Login to request notification
OS patching on Development Oracle Database hosts: snapdev01, snapdev02
Resolution: 25 Nov 2017, 9:30 AM
Automatic resolution.

OS patching for Oracle CRACKLE Development DBs on Linux Hosts

Resolved
Service affected: Oracle Tier 3 DB Hosting
Start: 25 Nov 2017, 8:00 AM
End: 25 Nov 2017, 9:30 AM
Login to request notification
OS patching on crackledev01, crackledev02 Ref: ITS Infrastructure Services has scheduled a patching cycle for routine host maintenance.
Resolution: 25 Nov 2017, 9:30 AM
Automatic resolution.

Aurion and MyAurion not available during maintenance

Resolved
Service affected: Aurion
Start: 25 Nov 2017, 6:00 AM
End: 25 Nov 2017, 8:00 AM
Login to request notification
Unix server patching and fail-over testing
Resolution: 25 Nov 2017, 8:00 AM
Patching and testing completed successfully

Preparation for multiauth support in auth.uq.edu.au

Resolved
Service affected: Single SignOn
Start: 23 Nov 2017, 12:00 PM
End: 23 Nov 2017, 12:59 PM
Login to request notification
This change will allow the auth.uq.edu.au Single Sign-On service to support multiple authentication sources.

Additional authentication sources may include the Australian Access Federation, or social media systems such as LinkedIn. Logins by these new methods need to be enabled for particular Service Providers on an individual basis.
Resolution: 23 Nov 2017, 12:59 PM
Automatic resolution.

Physical to virtual conversion of MasterDB workstations

Resolved
Service affected: Aurion
Start: 23 Nov 2017, 9:30 AM
End: 23 Nov 2017, 5:00 PM
Login to request notification
We are performing a PtoV conversion of the three windows 7 machines for HRIS.

sources IPs:
192.168.157.117
192.168.157.26
192.168.157.41

these machines will be converted and place within the NextGen Datacentre Server farm.
Resolution: 23 Nov 2017, 5:00 PM
Automatic resolution.

Move Hercules Active firewall to Prentice

Resolved
Service affected: Firewalls
Start: 22 Nov 2017, 6:30 PM
End: 22 Nov 2017, 6:30 PM
Login to request notification
Change Serverfarm Active ASA firewall to Prentice
Resolution: 22 Nov 2017, 6:30 PM
Automatic resolution.

Aurion and MyAurion not available during maintenance

Resolved
Service affected: Aurion
Start: 22 Nov 2017, 6:00 PM
End: 22 Nov 2017, 6:30 PM
Login to request notification
Restart required due to ongoing issues
Resolution: 22 Nov 2017, 6:30 PM
Automatic resolution.

Emergency Restart of SOEFILE

Resolved
Service affected: File Serving - Unix
Start: 22 Nov 2017, 6:00 PM
End: 22 Nov 2017, 6:30 PM
Login to request notification
Restart the server that provides

- shares on
SOEFILE
STAFF
STUDENT
AURION
SMBFS2

- ftp services
- NFS services
Resolution: 22 Nov 2017, 6:30 PM
Automatic resolution.

Switchover Archibus Prod DB from crackle to snap

Resolved
Service affected: ARCHIBUS
Start: 22 Nov 2017, 5:00 PM
End: 22 Nov 2017, 5:10 PM
Login to request notification
Switchover Archibus Prod DB from crackle to snap
Resolution: 22 Nov 2017, 5:10 PM
Automatic resolution.

Switch over Collations database to prentice

Resolved
Service affected: Oracle Tier 1 DB Hosting
Start: 22 Nov 2017, 3:40 PM
End: 22 Nov 2017, 3:50 PM
Login to request notification
Switch over Collations database to prentice
Resolution: 22 Nov 2017, 3:50 PM
Automatic resolution.

Aurion and MyAurion not available during maintenance

Resolved
Service affected: Aurion
Start: 22 Nov 2017, 10:30 AM
End: 22 Nov 2017, 11:00 AM
Login to request notification
An emergency re-start is needed to fix ongoing issues
Resolution: 22 Nov 2017, 11:00 AM
Automatic resolution.

Enable deny rule for block 130.102.120.0/21

Resolved
Service affected: Firewalls
Start: 22 Nov 2017, 7:00 AM
End: 22 Nov 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 130.102.120.0 to 130.102.127.255 that do not have an existing firewall rule
Resolution: 22 Nov 2017, 7:05 AM
Automatic resolution.

Aurion and MyAurion not available during maintenance

Resolved
Service affected: Aurion
Start: 20 Nov 2017, 6:00 PM
End: 20 Nov 2017, 6:15 PM
Login to request notification
Aurion and MyAurion not available due to system maintenance
Resolution: 20 Nov 2017, 6:15 PM
Automatic resolution.

Resolving DNS service degradation

Resolved
Service affected: DNS
Start: 20 Nov 2017, 9:59 AM
End: 20 Nov 2017, 12:18 PM
Login to request notification
One resolving nameserver is currently unavailable. The service is currently being restored.
Resolution: 20 Nov 2017, 12:18 PM
Resolving nameserver restored

Deployment of new version of WWAP process to UniTask production

Resolved
Service affected: Unitask
Start: 20 Nov 2017, 8:00 AM
End: 20 Nov 2017, 9:00 AM
Login to request notification
A new version of Withdrawal Without Academic Penalty will be deployed to UniTask production.
Resolution: 20 Nov 2017, 9:00 AM

Enable deny rule for block 130.102.96.0/21

Resolved
Service affected: Firewalls
Start: 20 Nov 2017, 7:00 AM
End: 20 Nov 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 130.102.96.0 to 130.102.103.255 that do not have an existing firewall rule
Resolution: 20 Nov 2017, 7:05 AM
Automatic resolution.

SQL 2014 Clustered Database Services - OS Patching

Resolved
Service affected: SQL 2014 Clustered Database Hosting
Start: 18 Nov 2017, 9:00 AM
End: 18 Nov 2017, 12:00 PM
Login to request notification
This outage is to facilitate regular monthly operating system updates, security enhancements, and overall service improvements.

Clients and applications with databases hosted on the Microsoft SQL Server 2014 cluster, will experience a very brief service interruption whilst database instances are failed over between ITS data centres.

The service interruption duration is generally 60-120 seconds within the designated outage window. Affected applications and services typically reconnect automatically.
Resolution: 18 Nov 2017, 12:00 PM
Automatic resolution.

Central Exchange Mail Services - OS Patching

Resolved
Service affected: Exchange Mail and Calendaring
Start: 18 Nov 2017, 9:00 AM
End: 18 Nov 2017, 12:00 PM
Login to request notification
As part of ongoing and proactive maintenance, some Exchange services will experience brief service interruptions.

Some Central Exchange users may experience small, intermittent interruptions to their mail and calendaring services during the scheduled maintenance window.

ITS apologises for any inconveniences that this may cause.

This continual, proactive work being undertaken is to provide an ongoing high level of Exchange Mail service availability to the University community.
Resolution: 18 Nov 2017, 12:00 PM
Automatic resolution.

Starting@UQ QTAC Account Activation is currently experiencing technical difficulties

Resolved
Service affected: Starting@UQ QTAC Account Activation/Enrolment Website
Start: 17 Nov 2017, 10:00 AM
End: 17 Nov 2017, 1:34 PM
Login to request notification
The Starting@UQ QTAC Account Activation website is currently experiencing technical difficulties.

ITS staff are investigating.
Resolution: 17 Nov 2017, 1:34 PM
The technical difficulties have been resolved and successful activations have been seen in the logs.

Intermittent Outages affecting critical systems

Resolved
Service affected: Data Centre Network
Start: 17 Nov 2017, 8:15 AM
End: 20 Nov 2017, 7:30 AM
Login to request notification
There is an issue in the DC that is intermittently affecting some critical systems & Alerting. Several teams are investigating the issue and expect all services to be restored quickly.

Pete Keeffe
Manager, Networks & DC
Resolution: 20 Nov 2017, 7:30 AM
Cause was a faulty link
Resolution: 18 Nov 2017, 2:00 AM
Automatic resolution.
Resolution: 18 Nov 2017, 2:00 AM
This has now been resolved. The issue was caused by a bug in the code, as a work around we have removed the traffic type that was instigating the bug.
Update: 17 Nov 2017, 4:00 PM
Reloaded GPN Unit, Active failed over to GPN on reload. Both units stopped forwarding packets (suspect Active was repeatedly moving between nodes). 16:20 Prentice interfaces were physically disconnected. GPN resumed as Active and services restored.
Update: 17 Nov 2017, 3:35 PM
The legacy server farm firewall suffered another short outage at 1:35pm. ITS will be performing emergency change to fail over to the the standby firewall until root cause can be determined.

Restart UniTask production database

Resolved
Service affected: Unitask
Start: 15 Nov 2017, 4:45 PM
End: 15 Nov 2017, 5:45 PM
Login to request notification
UniTask production database will be rebooted to set-up replication for the production UniTask instance to provide data to the Reportal/DataWarehouse.
Resolution: 15 Nov 2017, 5:45 PM
Automatic resolution.

Update Drupal CMS to release v1.54.2

Resolved
Service affected: CMS - ITS Drupal
Start: 15 Nov 2017, 8:00 AM
End: 15 Nov 2017, 4:00 PM
Login to request notification
The following updates will affect Stage, Prod and Sandbox sites using the Standard UQ Drupal Distribution.

Bug fixes:

Add view mode option back to Grid of links.
Fixed styling issue with Chosen select filter applying to date fields.
Fixed default content importing issues where some default training content was not spun up properly.

Technical upgrades under the hood:

Added smart_ip module to distribution.
Patched ctools.
Resolution: 15 Nov 2017, 4:00 PM
Automatic resolution.

Enable deny rule for block 203.100.16.0/20

Resolved
Service affected: Firewalls
Start: 15 Nov 2017, 7:00 AM
End: 15 Nov 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 203.100.16.0 to 203.100.31.255 that do not have an existing firewall rule
Resolution: 15 Nov 2017, 7:05 AM
Automatic resolution.

Deployment of new version of Change to Work Hours or Days process

Resolved
Service affected: Unitask
Start: 14 Nov 2017, 4:30 PM
End: 14 Nov 2017, 5:30 PM
Login to request notification
A new version of Change to Work Hours or Days process will be deployed. No impact is expected to Unitask users.
Resolution: 14 Nov 2017, 5:30 PM

Maintenance of Unitask

Resolved
Service affected: Unitask
Start: 13 Nov 2017, 4:45 PM
End: 13 Nov 2017, 5:45 PM
Login to request notification
Changes will be implemented in Unitask to facilitate upcoming deployment on Withdrawal Without Academic Penalty process.
Resolution: 13 Nov 2017, 5:45 PM
Changes has been applied successfully to facilitate upcoming deployment on Withdrawal Without Academic Penalty process.

Mail security gateway migration

Resolved
Service affected: Mail Routing
Start: 13 Nov 2017, 10:00 AM
End: 17 Nov 2017, 6:00 PM
Login to request notification
A large number of UQ mail domains will have their mail routing updated such that they specify a new cloud-based mail security gateway as the MTA in their MX records.

The mail header on inbound messages will change such that the Received header no longer references mx1-4.uq.edu.au, and instead refers to a new mail security gateway address. The X-IronPort-* and X-IPAS-* headers will also no longer be included.

A migration schedule, with tentative dates, can be found here:

https://projects.its.uq.edu.au/mimecast/Shared%20Documents/MimeCast%20Migration%20Plan%20Public.xlsx?Web=1
Resolution: 17 Nov 2017, 6:00 PM
Automatic resolution.

Enable deny rule for block 130.102.32.0/21

Resolved
Service affected: Firewalls
Start: 13 Nov 2017, 7:00 AM
End: 13 Nov 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 130.102.32.0 to 130.102.39.255 that do not have an existing firewall rule
Resolution: 13 Nov 2017, 7:05 AM
Automatic resolution.

Convert UniFi, TRIM, ERA and Aurion Production Databases to Single Instance

Resolved
Service affected: Oracle Tier 1 DB Hosting
Start: 12 Nov 2017, 6:00 AM
End: 12 Nov 2017, 8:00 AM
Login to request notification
The UniFi, Aurion, IntERAct and TRIM databases will be converted to single instance databases.
This change should be transparent to end users. However, if you encounter unexpected errors during this time period, please refresh your browser and retry the operation.
Resolution: 12 Nov 2017, 8:00 AM
Automatic resolution.

Convert SI-net Production Database to Single Instance

Resolved
Service affected: SI-net
Start: 11 Nov 2017, 6:00 AM
End: 11 Nov 2017, 7:00 AM
Login to request notification
The SI-net production database will be converted to a single-instance database.
This change should be transparent to end users. However, if you encounter unexpected errors during this time period, please refresh your browser and retry the operation.
Resolution: 11 Nov 2017, 7:00 AM
Automatic resolution.

ITS Jira Instance Upgrade

Resolved
Service affected: ITS Jira
Start: 9 Nov 2017, 7:30 PM
End: 9 Nov 2017, 11:00 PM
Login to request notification
ITS Jira instance (https://jira.its.uq.edu.au) is being migrated to data center version to enable high availability & improved performance.

Application would be unavailable at the times specified above.

CR#3527 - Approved by CAB
Resolution: 9 Nov 2017, 11:00 PM
Automatic resolution.

Starting@UQ QTAC Account Activation - Upgrade of functionality

Resolved
Service affected: Starting@UQ QTAC Account Activation/Enrolment Website
Start: 9 Nov 2017, 11:00 AM
End: 9 Nov 2017, 11:20 AM
Login to request notification
To help improve the user experience for new QTAC students during the downtime between QTAC rounds, the ability to download the personalized PDF files will be added into the Starting@UQ QTAC Account Activation site as well as the existing email method.

Resolution: 9 Nov 2017, 11:20 AM
Starting@UQ QTAC Account Activation system has been upgraded

Authentication failing

Resolved
Service affected: Tier 3 HNAS File Storage
Start: 9 Nov 2017, 8:40 AM
End: 9 Nov 2017, 9:40 AM
Login to request notification
The storage system is intermittently losing connection UQ domain controllers. Authentication may fail to share hosted from the device.

These include

ca-nas01
its-nas01
uq-nas01

SUpport ticekt have been logged with vendor and further investigation is being conducted.

Update: 9 Nov 2017, 9:45 AM
rsync job was pinning CPU at 100%. job has been stopped. Service has been restored
Resolution: 9 Nov 2017, 9:40 AM
Automatic resolution.

Enable deny rule for block 152.98.240.0/21

Resolved
Service affected: Firewalls
Start: 8 Nov 2017, 7:00 AM
End: 8 Nov 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 152.98.240.0 to 152.98.247.255 that do not have an existing firewall rule
Resolution: 8 Nov 2017, 7:05 AM
Automatic resolution.

ESXi host storage failure

Resolved
Service affected: VMware PRN DC
Start: 7 Nov 2017, 10:49 AM
End: 7 Nov 2017, 11:41 AM
Login to request notification
A VMware PRN DC ESXi host lost connectivity to its storage at 10:49:23am and was restored at 11:41:35am. the following VMs were affected -

cmm-srv02
akipsnew
icte-pepiappdv1
itm-man
vptools-man
its-appsense
Monkey
pixie
shada
dent-tiweb-trn
PY-OQA
signit
gpem-loggernet
uq-print1
uq-appspace
pf-persp-dev2
HS-NetPhys-Test
pf-salto-dev
ca-hris-dev1
sci-av01
shrs-tinyeye
snowden
its-vptools
its-silk-app1
ca-athens
herodotus
ragnar
bonanza
bucket
sci-fm06
smp-island
uq-edrmsdev
pf-service1
vCWCA
CITG-Papercut
web01-vet
sci-git
its-wsus01
its-rmsdev
sql01-vet
fac-intra1
uq-splusapp1
sinix
uqvcsqlprn2
ca-advreintg
sci-lists
smi-vc01
uq-winweb-stag1
uqbkci1
sci-veeam01
Resolution: 7 Nov 2017, 11:41 AM
Automatic resolution.

Move ESXi hosts from current vCenter to new vCenter

Resolved
Service affected: VMware PRN DC
Start: 7 Nov 2017, 8:30 AM
End: 7 Nov 2017, 3:00 PM
Login to request notification
Move ESXi hosts from current Windows Server based vCenter to new Appliance based vCenter.

ITS Infrastructure services will be carrying out changes to repoint ESXi hosts to new vCenter appliance within the legacy DC vCenter at Prentice.

How does this impact you?

During the scheduled change, console access to virtual machines within the affected vCenter will be unavailable. RDP/SSH etc will still be accessible. We do not expect any outages to virtual machines residing on our infrastructure.

As we repoint hosts from each vCenter you will no longer be able to access your Virtual machines via the old vCenter servers -

https://uqvcprn01.soe.uq.edu.au/vsphere-client (Web Client) or
https://vswca.soe.uq.edu.au/ui/ (HTML5 vSphere client)

Instead, you will be able to access your Virtual machines via,

https://prn-vcenter.its.uq.edu.au (Web Client) or
https://h5vswca.compute.dc.uq.edu.au/ui (HTML5 vSphere client)

We recommend searching for the name of the VM to quickly find it.

Once these changes are completed for all legacy vCenters, all virtual infrastructure (Legacy and NextGen) will be available via a single pane of glass via urls,
https://prn-vcenter.its.uq.edu.au/vsphere-client
https://ccr-vcenter.its.uq.edu.au/vsphere-client
https://h5vswca.compute.dc.uq.edu.au/ui (HTML5 vSphere client)

Resolution: 7 Nov 2017, 3:00 PM
Automatic resolution.

Mail security gateway migration

Resolved
Service affected: Mail Routing
Start: 6 Nov 2017, 10:00 AM
End: 10 Nov 2017, 6:00 PM
Login to request notification
A large number of UQ mail domains will have their mail routing updated such that they specify a new cloud-based mail security gateway as the MTA in their MX records.

The mail header on inbound messages will change such that the Received header no longer references mx1-4.uq.edu.au, and instead refers to a new mail security gateway address. The X-IronPort-* and X-IPAS-* headers will also no longer be included.

A migration schedule, with tentative dates, can be found here:

https://projects.its.uq.edu.au/mimecast/Shared%20Documents/MimeCast%20Migration%20Plan%20Public.xlsx?Web=1
Resolution: 10 Nov 2017, 6:00 PM
Automatic resolution.

Move ESXi hosts from current vCenter to new vCenter

Resolved
Service affected: VMware GPN DC
Start: 6 Nov 2017, 8:30 AM
End: 6 Nov 2017, 3:00 PM
Login to request notification
Move ESXi hosts from current Windows Server based vCenter to new Appliance based vCenter.

ITS Infrastructure services will be carrying out changes to repoint ESXi hosts to new vCenter appliance within the legacy DC vCenter at GP North.

How does this impact you?

During the scheduled change, console access to virtual machines within the affected vCenter will be unavailable. RDP/SSH etc will still be accessible. We do not expect any outages to virtual machines residing on our infrastructure.

As we repoint hosts from each vCenter you will no longer be able to access your Virtual machines via the old vCenter servers -

https://uqvcprn01.soe.uq.edu.au/vsphere-client (Web Client) or
https://vswca.soe.uq.edu.au/ui/ (HTML5 vSphere client)

Instead, you will be able to access your Virtual machines via,

https://prn-vcenter.its.uq.edu.au (Web Client) or
https://h5vswca.compute.dc.uq.edu.au/ui (HTML5 vSphere client)

We recommend searching for the name of the VM to quickly find it.

Once these changes are completed for all legacy vCenters, all virtual infrastructure (Legacy and NextGen) will be available via a single pane of glass via urls,
https://prn-vcenter.its.uq.edu.au/vsphere-client
https://ccr-vcenter.its.uq.edu.au/vsphere-client
https://h5vswca.compute.dc.uq.edu.au/ui (HTML5 vSphere client)

Resolution: 6 Nov 2017, 3:00 PM
Automatic resolution.

Enable deny rule for block 152.98.232.0/21

Resolved
Service affected: Firewalls
Start: 6 Nov 2017, 7:00 AM
End: 6 Nov 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 152.98.232.0 to 152.98.239.255 that do not have an existing firewall rule
Resolution: 6 Nov 2017, 7:05 AM
Automatic resolution.

New SSL certificate for www.sinet.uq.edu.au

Resolved
Service affected: SI-net
Start: 2 Nov 2017, 7:30 AM
End: 2 Nov 2017, 7:35 AM
Login to request notification
New SSL certificate will be loaded. Users may experience brief outage / connection timeout when new certificate is loaded.
Resolution: 2 Nov 2017, 7:35 AM
Automatic resolution.

Emergency Maintenance Fortitude Valley to Springfield

Resolved
Service affected: Networks
Start: 1 Nov 2017, 10:00 PM
End: 1 Nov 2017, 11:59 PM
Login to request notification
SUBJECT: Emergency Maintenance - Card Replacement - Fortitude Valley to Springfield 01/11/17
SCOPE: Transponder Card Replacement

START TIME: Wednesday 01 November 2017 22:00 AEST (01 November 2017 12:00 UTC)
END TIME: Wednesday 01 November 2017 23:59 AEST (01 November 2017 13:59 UTC)

DESCRIPTION: AARNet staff will be replacing a possibly faulty Transponder card at Fortitude Valley that is providing services to Springfield. An outage of around 10 minutes is expected during the advertised window, however the whole window is reserved.

AFFECTED: ANS003048ATS RDSI UQ
ANS003049ATS RSDSI UQ
ANS002395ATS-UQ St Lucia/Prentice
ANS004478ATS UQ-QIMR to Polaris
ANS005556MNS UQ-Polaris Bldg.39
ANS005557MNS UQ-Polaris Bldg.39
TICKET NO: NOCTTS-23337
CONTACT: 1300 APL NOC or noc@aarnet.edu.au
COUNTER: Message #1

Kind Regards,

Cassie Byrne-Quinn
NOC Operator
________________________________________
AARNET NOC: e. noc@aarnet.edu.au t. 1300 APL NOC (+612 6222 3555)
street address: POD3, 20 Dick Perry Avenue, KENSINGTON WA 6151
t. +61 8 9289 2214 e. cassie.byrne-quinn@aarnet.edu.au
w. www.aarnet.edu.au
Resolution: 1 Nov 2017, 11:59 PM
Automatic resolution.

Deployment of new process for HR

Resolved
Service affected: Unitask
Start: 1 Nov 2017, 4:50 PM
End: 1 Nov 2017, 5:00 PM
Login to request notification
A process for HR - Change to Work Hours or Days will be deployed.
No impact is expected to Unitask users.
Resolution: 1 Nov 2017, 5:00 PM
Automatic resolution.

Enable deny rule for block 152.98.224.0/21

Resolved
Service affected: Firewalls
Start: 1 Nov 2017, 7:00 AM
End: 1 Nov 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 152.98.224.0 to 152.98.231.255 that do not have an existing firewall rule
Resolution: 1 Nov 2017, 7:05 AM
Automatic resolution.

A process in Unitask is experiencing issues

Resolved
Service affected: Unitask
Start: 31 Oct 2017, 12:40 PM
End: 31 Oct 2017, 12:45 PM
Login to request notification
Requests to the Withdraw Without Academic Penalty process cant be submitted at the moment.

A fix is going to be released which will cause a service impact of about one minute.
Resolution: 31 Oct 2017, 12:45 PM
Automatic resolution.

Maintenance of Unitask

Resolved
Service affected: Unitask
Start: 30 Oct 2017, 5:00 PM
End: 30 Oct 2017, 5:30 PM
Login to request notification
Changes to the database structure needs to be performed in preparation to the release of HR process Change of Work Hours or Days.

As part of the change, processes need to be paused and resumed.
Resolution: 30 Oct 2017, 5:30 PM
Automatic resolution.

Change mail routing to use new mail security gateway for a number of EAIT production domains

Resolved
Service affected: Mail Routing
Start: 30 Oct 2017, 10:00 AM
End: 2 Nov 2017, 6:00 PM
Login to request notification
A number of EAIT production domains will have their mail routing updated such that they specify a new mail security gateway as the MTA in their MX records.
Resolution: 2 Nov 2017, 6:00 PM
Automatic resolution.

Enable deny rule for block 152.98.216.0/21

Resolved
Service affected: Firewalls
Start: 30 Oct 2017, 7:00 AM
End: 30 Oct 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 152.98.216.0 to 152.98.223.255 that do not have an existing firewall rule
Resolution: 30 Oct 2017, 7:05 AM
Automatic resolution.

My.UQ intermittent service

Resolved
Service affected: new myUQ for Students
Start: 30 Oct 2017, 5:00 AM
End: 30 Oct 2017, 2:40 PM
Login to request notification
The My.UQ website is running under intermittent service.

ITS staff are investigating.
Resolution: 30 Oct 2017, 2:40 PM
My.UQ has stabilized now

Change mail routing to use new mail security gateway for a number of production domains

Resolved
Service affected: Mail Routing
Start: 27 Oct 2017, 11:00 AM
End: 27 Oct 2017, 6:00 PM
Login to request notification
The following production domains will have their mail routing updated such that they specify a new mail security gateway as the MTA in their MX records:

hass.uq.edu.au
library.uq.edu.au
music.uq.edu.au
uqp.com.au
uqp.uq.edu.au
Resolution: 27 Oct 2017, 6:00 PM
Automatic resolution.

Checkbox Survey System Update

Resolved
Service affected: Checkbox
Start: 26 Oct 2017, 7:00 PM
End: 26 Oct 2017, 8:00 PM
Login to request notification
The Checkbox survey system will be updated to the latest version.
Resolution: 26 Oct 2017, 8:00 PM
Automatic resolution.

Maintenance of Unitask

Resolved
Service affected: Unitask
Start: 26 Oct 2017, 5:00 PM
End: 26 Oct 2017, 5:45 PM
Login to request notification
Some changes will be implemented to the production environment in preparation to the release of HR Change of Work Hours or Days process next week.
Resolution: 26 Oct 2017, 5:45 PM
Updates were successfully applied.

Relocate ESXi hosts from current vCenter to new vCenter

Resolved
Service affected: VMware CCR DC
Start: 26 Oct 2017, 1:00 PM
End: 26 Oct 2017, 3:30 PM
Login to request notification
Relocate CCR ESXi hosts from current Windows Server based vCenter to new Appliance based vCenter.

ITS Infrastructure services will be carrying out changes to repoint ESXi hosts to new vCenter appliance within the legacy DC vCenter at CCR.

How does this impact you?

During the scheduled change, console access to virtual machines within the affected vCenter will be unavailable. RDP/SSH etc will still be accessible. We do not expect any outages to virtual machines residing on our infrastructure.

As we repoint hosts from each vCenter you will no longer be able to access your Virtual machines via the old vCenter servers -

https://uqvcprn01.soe.uq.edu.au/vsphere-client (Web Client) or
https://vswca.soe.uq.edu.au/ui/ (HTML5 vSphere client)

Instead, you will be able to access your Virtual machines via,

https://prn-vcenter.its.uq.edu.au (Web Client) or
https://h5vswca.compute.dc.uq.edu.au/ui (HTML5 vSphere client)

We recommend searching for the name of the VM to quickly find it.

Once these changes are completed for all legacy vCenters, all virtual infrastructure (Legacy and NextGen) will be available via a single pane of glass via urls,
https://prn-vcenter.its.uq.edu.au/vsphere-client
https://ccr-vcenter.its.uq.edu.au/vsphere-client
https://h5vswca.compute.dc.uq.edu.au/ui (HTML5 vSphere client)

Resolution: 26 Oct 2017, 3:30 PM
Automatic resolution.

Change mail routing to use new mail security gateway for a number of production domains

Resolved
Service affected: Mail Routing
Start: 26 Oct 2017, 11:00 AM
End: 26 Oct 2017, 6:00 PM
Login to request notification
The following production domains will have their mail routing updated such that they specify a new mail security gateway as the MTA in their MX records:

education.uq.edu.au
languages-cultures.uq.edu.au
pod.uq.edu.au
printondemand.com.au
confucius.uq.edu.au
Resolution: 26 Oct 2017, 6:00 PM
Automatic resolution.

Enable deny rule for block 130.102.16.0/21

Resolved
Service affected: Firewalls
Start: 25 Oct 2017, 7:00 AM
End: 25 Oct 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 130.102.16.0 to 130.102.31.255 that do not have an existing firewall rule
Resolution: 25 Oct 2017, 7:05 AM
Automatic resolution.

Eduroam outage in QLD Health Hospitals

Resolved
Service affected: Wireless Network
Start: 23 Oct 2017, 8:00 AM
End: 23 Oct 2017, 12:03 PM
Login to request notification
QLD Health and ITS are investigating on the issue
Resolution: 23 Oct 2017, 12:03 PM
Issue has been resolved and connectivity has returned.

Enable deny rule for block 130.102.232.0/21

Resolved
Service affected: Firewalls
Start: 23 Oct 2017, 7:00 AM
End: 23 Oct 2017, 7:05 AM
Login to request notification
Firewall will block IP addresses 130.102.232.0 to 130.102.247.255 that do not have an existing firewall rule
Resolution: 23 Oct 2017, 7:05 AM
Automatic resolution.

AWS Direct Connect maintenance

Resolved
Service affected: Amazon Web Services - Direct Connect
Start: 21 Oct 2017, 8:00 AM
End: 21 Oct 2017, 4:00 PM
Login to request notification
One of the redundant AWS Direct Connect links will be down for third party maintenance on the 21st October between 8am and 4pm.

During this time, the service will be in a hazardous state with no redundancy. Some packet loss may occur when the link is brought down due to route convergence delay.
Resolution: 21 Oct 2017, 4:00 PM
Automatic resolution.

Switchover Patched Databases Back to Crackle

Resolved
Service affected: Oracle Tier 1 DB Hosting
Start: 21 Oct 2017, 6:00 AM
End: 21 Oct 2017, 8:00 AM
Login to request notification
Switchover Patched Databases Back to Crackle

(approx. 5 minute minor disruption per database during switchover from Prentice to GPN)
Resolution: 21 Oct 2017, 8:00 AM
Automatic resolution.

Upgrade NGDC Firewalls

Resolved
Service affected: Firewalls
Start: 20 Oct 2017, 7:00 AM
End: 20 Oct 2017, 9:00 AM
Login to request notification
Upgrade Palo Alto Hardware and Global Protect Client
Resolution: 20 Oct 2017, 9:00 AM
Automatic resolution.

Change mail routing to use cloud security gateway for a number of production domains

Resolved
Service affected: Mail Routing
Start: 19 Oct 2017, 3:00 PM
End: 19 Oct 2017, 6:00 PM
Login to request notification
The following production domains will have their mail routing updated such that they specify a new cloud security gateway service as the MTA in their MX records:

lists.uq.edu.au
pf.uq.edu.au
arts.uq.edu.au
Resolution: 19 Oct 2017, 6:00 PM
Automatic resolution.