Upgrade R11.1.2.3 failed for Gateways

[IPO Thomas]

Hello community,
after the successful upgrade of primary and secondary server from R11.0 to R11.1.2.3, all the IP500V2 gateways abort their update via IP Office Web Manager.
I get the following error messages:
Unable to upgrade.Error: Authentication failed. on 10.145.42.10
Upgrade failed.: Failing at task 'Pull upgrade', step 'Pulling files

Although the passwords are new and the same in all servers and gateways, I get the following error when synchronizing:
Security database synchronization has failed due to the following reason(s): 403:Forbidden : 10.140.42.6

The upgrade attempt was recorded with Sysonitor:

Gateway 10.147.42.10 (1 of 6)

15:15:54 1023387661mS HTTP: 10.147.42.51(13157)-(80) HTTPServerSessionIO: SetState AllSentAndAcknowledged
15:15:54 1023387663mS HTTP: 10.147.42.51(13157)-(80) HTTPServerSessionIO: Persisting TCP Session
15:15:54 1023387663mS HTTP: 10.147.42.51(13157) HTTPDECTSessionIO: SetState Disconnect
15:15:54 1023387663mS HTTP: 10.147.42.51(13157)-(80) HTTPServerSessionIO: SetState Delete
15:15:54 1023387664mS HTTP: 10.147.42.51(13157) ~HTTPDECTSessionIO
15:15:57 1023390080mS HTTP: 0.0.0.0(0)-(0) HTTPSession (Total = 3)
15:15:57 1023390095mS HTTP: Rx Src: 10.140.42.5(80)-(0)
POST 10.147.42.10:80/ws/upgrade/pull_upgrade HTTP/1.1
Via: 1.1 10.140.42.5
Cache-Control: no-cache
Connection: Keep-Alive
Authorization: Basic QWRtaW5pc3RyYXRvcjpLQVNhZG0yMDIy
Accept: application/Avaya-wsadminv1,text/plain
X-User-Client: Avaya-WebAdmin
User-Agent: Avaya-WebAdmin
Content-Type: text/xml; charset=UTF-8
Content-Length: 613
15:15:57 1023390096mS HTTP: Content type doesn't match the file type: content type=text/xml; charset=UTF-8 filename=pull_upgrade
15:15:57 1023390097mS HTTP: 10.140.42.5(80) WebSocketProxySession: GetServiceId incorrect port warning 7 - 8
15:15:57 1023390098mS HTTP: 10.140.42.5(80)-(0) HTTPServerSessionIO: stCreationCallback(8)
15:15:57 1023390098mS HTTP: Public IP=10.140.42.5 Private IP=Not set
15:15:57 1023390098mS HTTP: 10.140.42.5(80)-(0) HTTPSession: SendErrorResponse Code: 403, Entity: Protocol is not supported for this URI
15:15:57 1023390099mS HTTP: 10.140.42.5(80)-(0) HTTPServerSessionIO: SetState GracefulClose
15:15:57 1023390101mS HTTP: Tx Dest: 10.140.42.5(80)-(0)
HTTP/1.1 403 Forbidden
Via: 1.1 10.140.42.5
Connection: close
Date: Tue, 01 Nov 2022 14:15:57 GMT
Cache-Control: no-cache
Server: IPOffice/
X-Frame-Options: SAMEORIGIN
X-XSS-Protection: 1; mode=block
X-Content-Type-Options: nosniff
Content-Type: text/plain
Content-Length: 38
15:15:57 1023390101mS HTTP: 10.140.42.5(80)-(0) HTTPServerSessionIO: Percent(100)
15:15:57 1023390128mS HTTP: 10.140.42.5(80)-(0) HTTPServerSessionIO: SetState AllSentAndAcknowledged
15:15:57 1023390130mS HTTP: 10.140.42.5(80)-(0) HTTPServerSessionIO: Closing TCP Session
15:15:57 1023390130mS HTTP: 10.140.42.5(80)-(0) HTTPServerSessionIO: SetState Delete
15:15:57 1023390132mS HTTP: 10.140.42.5(80)-(0) ~HTTPSession: Duration: 52ms (Total = 2)

Server 10.140.42.5 (1 of 2)

15:15:57 358399673mS HTTP: 10.140.42.5(49368)-(443) HTTPSession(Secure) (Total = 2)
15:15:57 358399673mS HTTP: 10.140.42.5(49368)-(443) HTTPSession: Operational
15:15:57 358399715mS HTTP: 10.140.42.5(49368)-(443) HTTPSession: TLSOperational using cipher=c02f resumed=false
15:15:57 358399756mS HTTP: Secure Rx Src: 10.140.42.5(49368)-(443)
POST /ws/upgrade/pull_upgrade HTTP/1.1
User-Agent: Avaya-WebAdmin
15:15:57 358399758mS HTTP: Proxy Tx Dest: 10.147.42.10(11566)-(80)
POST 10.147.42.10:80/ws/upgrade/pull_upgrade HTTP/1.1
Via: 1.1 10.140.42.5
Cache-Control: no-cache
Connection: Keep-Alive
Authorization: Basic QWRtaW5pc3RyYXRvcjpLQVNhZG0yMDIy
Accept: application/Avaya-wsadminv1,text/plain
X-User-Client: Avaya-WebAdmin
User-Agent: Avaya-WebAdmin
Content-Type: text/xml; charset=UTF-8
Content-Length: 613

15:15:57 358399796mS HTTP: Proxy Rx Src: 10.147.42.10(11566)-(80)
HTTP/1.1 403 Forbidden
Via: 1.1 10.140.42.5
Connection: close
Date: Tue, 01 Nov 2022 14:15:57 GMT
Cache-Control: no-cache
Server: IPOffice/
X-Frame-Options: SAMEORIGIN
X-XSS-Protection: 1; mode=block
X-Content-Type-Options: nosniff
Content-Type: text/plain
Content-Length: 38

15:15:57 358399798mS HTTP: Secure Tx Dest: 10.140.42.5(49368)-(443)
HTTP/1.1 403 Forbidden
15:15:57 358399811mS HTTP: 10.140.42.5(49368)-(443) ~HTTPSession: Duration: 138ms (Total =

Can anybody help me to find the solution? I couldn't find a solution on google and avaya-support.

Greets Thomas

 

[Johnhyde]

I had the same issue, its a known issue, I had to upgrade the IP500 manually.

 

[IPO Thomas]

This cannot be the solution for a customer who is 6 hours away

 

[derfloh]

Just update them like you do with a single site IP500 using IPO Manager

IP Office remote service
IP Office certificate check
CLI based call blocking
SCN fallback over PSTN

 

[IPO Thomas]

it worked, but it's time-consuming