stopping one videobridge tears down all conferenecs

Stooped a bridge which had no traffic manually:

  Mai  22 11:34:31 bridge-t systemd[1]: Stopped Jitsi Videobridge.

All running conferences stopped - after two minutes re-connection was successful.

Jicofo 2021-05-22 11:34:31.423 SEVERE: [33] org.jitsi.jicofo.JitsiMeetConferenceImpl.log() One of our bridges failed: jvbbrewery@internal.auth.run.fairmeeting.net/23e46f6c-b1cf-4ff7-b0e6-0eb2d594533b

Jicofo 2021-05-22 11:34:31.495 SEVERE: [402] org.jitsi.jicofo.AbstractChannelAllocator.log() jvbbrewery@internal.auth.run.fairmeeting.net/b5ca8456-7b02-45cf-8ac8-f6168d8d799c - failed to allocate channels, will consider the bridge faulty: XMPP error: <iq to='focus@auth.run.fairmeeting.net/focus858996473788938' from='jvbbrewery@internal.auth.run.fairmeeting.net/b5ca8456-7b02-45cf-8ac8-f6168d8d799c' id='5Q2fC-79824' type='error'><error type='cancel'><internal-server-error xmlns='urn:ietf:params:xml:ns:xmpp-stanzas'/><text xmlns='urn:ietf:params:xml:ns:xmpp-stanzas' xml:lang='en'>Couldn&apos;t get OctoRelayService</text></error></iq>
org.jitsi.protocol.xmpp.colibri.exception.ColibriException: XMPP error: <iq to='focus@auth.run.fairmeeting.net/focus858996473788938' from='jvbbrewery@internal.auth.run.fairmeeting.net/b5ca8456-7b02-45cf-8ac8-f6168d8d799c' id='5Q2fC-79824' type='error'><error type='cancel'><internal-server-error xmlns='urn:ietf:params:xml:ns:xmpp-stanzas'/><text xmlns='urn:ietf:params:xml:ns:xmpp-stanzas' xml:lang='en'>Couldn&apos;t get OctoRelayService</text></error></iq>
        at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.maybeThrowOperationFailed(ColibriConferenceImpl.java:364)
        at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.createColibriChannels(ColibriConferenceImpl.java:268)
        at org.jitsi.jicofo.OctoChannelAllocator.doAllocateChannels(OctoChannelAllocator.java:95)
        at org.jitsi.jicofo.AbstractChannelAllocator.allocateChannels(AbstractChannelAllocator.java:271)
        at org.jitsi.jicofo.AbstractChannelAllocator.doRun(AbstractChannelAllocator.java:190)
        at org.jitsi.jicofo.AbstractChannelAllocator.run(AbstractChannelAllocator.java:150)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Jicofo 2021-05-22 11:34:31.495 SEVERE: [402] org.jitsi.jicofo.JitsiMeetConferenceImpl.log() One of our bridges failed: jvbbrewery@internal.auth.run.fairmeeting.net/b5ca8456-7b02-45cf-8ac8-f6168d8d799c

Jicofo 2021-05-22 11:34:31.502 SEVERE: [403] org.jitsi.jicofo.AbstractChannelAllocator.log() jvbbrewery@internal.auth.run.fairmeeting.net/a405b28d-98f1-4582-a7bb-43910765b488 - failed to allocate channels, will consider the bridge faulty: XMPP error: <iq to='focus@auth.run.fairmeeting.net/focus858996473788938' from='jvbbrewery@internal.auth.run.fairmeeting.net/a405b28d-98f1-4582-a7bb-43910765b488' id='5Q2fC-79827' type='error'><error type='cancel'><internal-server-error xmlns='urn:ietf:params:xml:ns:xmpp-stanzas'/><text xmlns='urn:ietf:params:xml:ns:xmpp-stanzas' xml:lang='en'>Couldn&apos;t get OctoRelayService</text></error></iq>
org.jitsi.protocol.xmpp.colibri.exception.ColibriException: XMPP error: <iq to='focus@auth.run.fairmeeting.net/focus858996473788938' from='jvbbrewery@internal.auth.run.fairmeeting.net/a405b28d-98f1-4582-a7bb-43910765b488' id='5Q2fC-79827' type='error'><error type='cancel'><internal-server-error xmlns='urn:ietf:params:xml:ns:xmpp-stanzas'/><text xmlns='urn:ietf:params:xml:ns:xmpp-stanzas' xml:lang='en'>Couldn&apos;t get OctoRelayService</text></error></iq>
        at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.maybeThrowOperationFailed(ColibriConferenceImpl.java:364)
        at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.createColibriChannels(ColibriConferenceImpl.java:268)
        at org.jitsi.jicofo.OctoChannelAllocator.doAllocateChannels(OctoChannelAllocator.java:95)
        at org.jitsi.jicofo.AbstractChannelAllocator.allocateChannels(AbstractChannelAllocator.java:271)
        at org.jitsi.jicofo.AbstractChannelAllocator.doRun(AbstractChannelAllocator.java:190)
        at org.jitsi.jicofo.AbstractChannelAllocator.run(AbstractChannelAllocator.java:150)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Jicofo 2021-05-22 11:34:31.502 SEVERE: [403] org.jitsi.jicofo.JitsiMeetConferenceImpl.log() One of our bridges failed: jvbbrewery@internal.auth.run.fairmeeting.net/a405b28d-98f1-4582-a7bb-43910765b488

Jicofo 2021-05-22 11:34:31.520 SEVERE: [408] org.jitsi.jicofo.AbstractChannelAllocator.log() jvbbrewery@internal.auth.run.fairmeeting.net/44
ef327b-26a6-4c91-bc6e-cfcd7588bc45 - failed to allocate channels, will consider the bridge faulty: XMPP error: <iq to='focus@auth.run.fairmeeting.net/focus858996473788938' from='jvbbrewery@internal.auth.run.fairmeeting.net/44ef327b-26a6-4c91-bc6e-cfcd7588bc45' id='5Q2fC-79836' type='error'><error type='cancel'><internal-server-error xmlns='urn:ietf:params:xml:ns:xmpp-stanzas'/><text xmlns='urn:ietf:params:xml:ns:xmpp-stanzas' xml:lang='en'>Couldn&apos;t get OctoRelayService</text></error></iq>
org.jitsi.protocol.xmpp.colibri.exception.ColibriException: XMPP error: <iq to='focus@auth.run.fairmeeting.net/focus858996473788938' from='jvbbrewery@internal.auth.run.fairmeeting.net/44ef327b-26a6-4c91-bc6e-cfcd7588bc45' id='5Q2fC-79836' type='error'><error type='cancel'><internal-server-error xmlns='urn:ietf:params:xml:ns:xmpp-stanzas'/><text xmlns='urn:ietf:params:xml:ns:xmpp-stanzas' xml:lang='en'>Couldn&apos;t get OctoRelayService</text></error></iq>
        at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.maybeThrowOperationFailed(ColibriConferenceImpl.java:364)
        at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.createColibriChannels(ColibriConferenceImpl.java:268)
        at org.jitsi.jicofo.OctoChannelAllocator.doAllocateChannels(OctoChannelAllocator.java:95)
        at org.jitsi.jicofo.AbstractChannelAllocator.allocateChannels(AbstractChannelAllocator.java:271)
        at org.jitsi.jicofo.AbstractChannelAllocator.doRun(AbstractChannelAllocator.java:190)
        at org.jitsi.jicofo.AbstractChannelAllocator.run(AbstractChannelAllocator.java:150)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Jicofo 2021-05-22 11:34:31.520 SEVERE: [408] org.jitsi.jicofo.JitsiMeetConferenceImpl.log() One of our bridges failed: jvbbrewery@internal.auth.run.fairmeeting.net/44ef327b-26a6-4c91-bc6e-cfcd7588bc45
Jicofo 2021-05-22 11:34:31.520 SEVERE: [405] org.jitsi.jicofo.AbstractChannelAllocator.log() jvbbrewery@internal.auth.run.fairmeeting.net/576e37bb-cf33-4748-89fc-507fdc557804 - failed to allocate channels, will consider the bridge faulty: XMPP error: <iq to='focus@auth.run.fairmeeting.net/focus858996473788938' from='jvbbrewery@internal.auth.run.fairmeeting.net/576e37bb-cf33-4748-89fc-507fdc557804' id='5Q2fC-79834' type='error'><error type='cancel'><internal-server-error xmlns='urn:ietf:params:xml:ns:xmpp-stanzas'/><text xmlns='urn:ietf:params:xml:ns:xmpp-stanzas' xml:lang='en'>Couldn&apos;t get OctoRelayService</text></error></iq>
org.jitsi.protocol.xmpp.colibri.exception.ColibriException: XMPP error: <iq to='focus@auth.run.fairmeeting.net/focus858996473788938' from='jvbbrewery@internal.auth.run.fairmeeting.net/576e37bb-cf33-4748-89fc-507fdc557804' id='5Q2fC-79834' type='error'><error type='cancel'><internal-server-error xmlns='urn:ietf:params:xml:ns:xmpp-stanzas'/><text xmlns='urn:ietf:params:xml:ns:xmpp-stanzas' xml:lang='en'>Couldn&apos;t get OctoRelayService</text></error></iq>
        at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.maybeThrowOperationFailed(ColibriConferenceImpl.java:364)
        at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.createColibriChannels(ColibriConferenceImpl.java:268)
        at org.jitsi.jicofo.OctoChannelAllocator.doAllocateChannels(OctoChannelAllocator.java:95)
        at org.jitsi.jicofo.AbstractChannelAllocator.allocateChannels(AbstractChannelAllocator.java:271)
        at org.jitsi.jicofo.AbstractChannelAllocator.doRun(AbstractChannelAllocator.java:190)
        at org.jitsi.jicofo.AbstractChannelAllocator.run(AbstractChannelAllocator.java:150)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

Jicofo 2021-05-22 11:34:31.520 SEVERE: [405] org.jitsi.jicofo.AbstractChannelAllocator.log() jvbbrewery@internal.auth.run.fairmeeting.net/57
6e37bb-cf33-4748-89fc-507fdc557804 - failed to allocate channels, will consider the bridge faulty: XMPP error: <iq to='focus@auth.run.fairme
eting.net/focus858996473788938' from='jvbbrewery@internal.auth.run.fairmeeting.net/576e37bb-cf33-4748-89fc-507fdc557804' id='5Q2fC-79834' ty
pe='error'><error type='cancel'><internal-server-error xmlns='urn:ietf:params:xml:ns:xmpp-stanzas'/><text xmlns='urn:ietf:params:xml:ns:xmpp
-stanzas' xml:lang='en'>Couldn&apos;t get OctoRelayService</text></error></iq>
org.jitsi.protocol.xmpp.colibri.exception.ColibriException: XMPP error: <iq to='focus@auth.run.fairmeeting.net/focus858996473788938' from='j
vbbrewery@internal.auth.run.fairmeeting.net/576e37bb-cf33-4748-89fc-507fdc557804' id='5Q2fC-79834' type='error'><error type='cancel'><intern
al-server-error xmlns='urn:ietf:params:xml:ns:xmpp-stanzas'/><text xmlns='urn:ietf:params:xml:ns:xmpp-stanzas' xml:lang='en'>Couldn&apos;t g
et OctoRelayService</text></error></iq>
        at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.maybeThrowOperationFailed(ColibriConferenceImpl.java:364)
        at org.jitsi.impl.protocol.xmpp.colibri.ColibriConferenceImpl.createColibriChannels(ColibriConferenceImpl.java:268)
        at org.jitsi.jicofo.OctoChannelAllocator.doAllocateChannels(OctoChannelAllocator.java:95)
        at org.jitsi.jicofo.AbstractChannelAllocator.allocateChannels(AbstractChannelAllocator.java:271)
        at org.jitsi.jicofo.AbstractChannelAllocator.doRun(AbstractChannelAllocator.java:190)
        at org.jitsi.jicofo.AbstractChannelAllocator.run(AbstractChannelAllocator.java:150)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Jicofo 2021-05-22 11:34:31.521 INFO: [408] org.jitsi.jicofo.JitsiMeetConferenceImpl.log() Region info, conference=50061: [[null, null]]
Jicofo 2021-05-22 11:34:31.521 INFO: [408] org.jitsi.jicofo.JitsiMeetConferenceImpl.log() Region info, conference=50061: [[null]]
Jicofo 2021-05-22 11:34:31.521 INFO: [408] org.jitsi.jicofo.JitsiMeetConferenceImpl.log() Region info, conference=50061: [[null]]
Jicofo 2021-05-22 11:34:31.521 SEVERE: [405] org.jitsi.jicofo.JitsiMeetConferenceImpl.log() One of our bridges failed: jvbbrewery@internal.auth.run.fairmeeting.net/576e37bb-cf33-4748-89fc-507fdc557804
Jicofo 2021-05-22 11:34:31.521 WARNING: [408] org.jitsi.jicofo.AbstractParticipant.log() Canceling OctoChannelAllocator[BridgeSession[id=50061_9bf0d0, bridge=Bridge[jid=jvbbrewery@internal.auth.run.fairmeeting.net/44ef327b-26a6-4c91-bc6e-cfcd7588bc45, relayId=null, region=null, stress=0.02]]@1328950623, OctoParticipant[relays=[]]@13420813]@171221629

Jicofo 2021-05-22 11:34:31.552 SEVERE: [404] org.jitsi.jicofo.JitsiMeetConferenceImpl.log() Can not invite participant -- no bridge available.

Jicofo 2021-05-22 11:34:31.616 INFO: [413] org.jitsi.protocol.xmpp.AbstractOperationSetJingle.log() RE-INVITE PEER: happsion@conference.run.fairmeeting.net/55696f40

(all are re-invited - all fails) 

Jicofo 2021-05-22 11:35:04.620 WARNING: [29] org.jitsi.jicofo.bridge.BridgeSelectionStrategy.log() Failed to select initial bridge for participantRegion=null

Jicofo 2021-05-22 11:35:43.763 INFO: [29] org.jitsi.jicofo.bridge.BridgeSelectionStrategy.log() Selected initial bridge Bridge[jid=jvbbrewery@internal.auth.run.fairmeeting.net/6b48d3d9-f53e-4b3a-9aa9-29713c4c0b6b, relayId=null, region=null, stress=0.00] with reported stress=0.0 for participantRegion=null using strategy SingleBridgeSelectionStrategy

now conferences recover, even if no new bridges added in brewery

Edited May 22, 2021 by Roland Alton