Bug 17923 - After 1-Mar-2012 Outage - BBC Radio App fails for non UK users.
: After 1-Mar-2012 Outage - BBC Radio App fails for non UK users.
Status: RESOLVED FIXED
Product: MySqueezebox.com
Classification: Unclassified
Component: SlimService
: MySB
: All Other
: -- major with 1 vote (vote)
: ---
Assigned To: Michael Herger
:
Depends on:
Blocks:
  Show dependency treegraph
 
Reported: 2012-03-10 15:43 UTC by Bryan Alton
Modified: 2012-03-14 14:31 UTC (History)
3 users (show)

See Also:
Category: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Bryan Alton 2012-03-10 15:43:33 UTC
After the 1-Mar-2012 outage users started complaining that the Logitech BBC Radio App fails whic used to work before the outage. On IP3K players user would get "Connecting.." and then no action and no music.  Users of Touch/Radio would get "connection reset by local host".

The BBC Radio app effectively tries to play BBC ASX playlist and the same symptoms are shown if a user create a Favorite with the BBC ASX playlist such as http://bbc.co.uk/radio/listen/live/r1.asx

The BBC server will return different URLs depending on whether the requester of the playlist is in the UK or outside the UK. The playlist is a list of mms:// URL to be tried in sequence.   

If the user is in the UK the 1st URL would be
mms://wmlive-acl.bbc.co.uk/wms/bbc_ami/radio1/radio1_bb_live_eq1_sl0

If the user is outside the UK the URL would be
mms://wmlive-nonacl.bbc.net.uk/wms/bbc_ami/radio1/radio1_bb_live_int_ep1_sl0

After the outage bit UK and non UK users had similar symptoms.  If a UK user created a favorite with UK mms url - the station would play.  Similar for non UK users.  After a few days (3 Mar ?) some UK users reported that the BBC Radio was working OK but non UK user still had the problem.

The problem is mysqueezebox.com server is behaving as if it is located in the UK and serving up UK only WMA URLs.  Whereas the mysqueezebox.com server should behave as if it is located in the same country as the requesting player.

To confirm the problem was geo-ip - I enabled logging on a Touch.  When trying to play a BBC Radio ASX playlist - my Touch player tried to play a UK WMA URL and so BBC server refused connection hence "connection reset by local host" 


Mar  7 13:31:45 squeezeplay: INFO   audio.decode - decode_start_handler:279 init decoder wma,wmap,wmal
Mar  7 13:31:45 squeezeplay: INFO   audio.decode - Playback.lua:476 connect 212.58.252.27:80 GET /wms/bbc_ami/radio3/radio3_bb_live_eq1_sl0?BBC-UID=144fd54756a3e21ec8a3a771515510efafee4c4240006124e41f34d6c8309e8a&SSO2-UID= HTTP/1.0^M
Mar  7 13:31:45 squeezeplay: INFO   audio.decode - Playback.lua:479 GET /wms/bbc_ami/radio3/radio3_bb_live_eq1_sl0?BBC-UID=144fd54756a3e21ec8a3a771515510efafee4c4240006124e41f34d6c8309e8a&SSO2-UID= HTTP/1.0^M
Mar  7 13:31:45 squeezeplay: Accept: */*^M
Mar  7 13:31:45 squeezeplay: User-Agent: NSPlayer/8.0.0.3802^M
Mar  7 13:31:45 squeezeplay: Host: wmlive-acl.bbc.co.uk^M
Mar  7 13:31:45 squeezeplay: Pragma: xClientGUID={3a6a0dc8-6199-a22f-e2b0-465c74849e69}^M
Mar  7 13:31:45 squeezeplay: Pragma: no-cache,rate=1.0000000,stream-offset=0:0,max-duration=0^M
Mar  7 13:31:45 squeezeplay: Pragma: stream-time=0^M
Mar  7 13:31:45 squeezeplay: Pragma: request-context=2^M
Mar  7 13:31:45 squeezeplay: Pragma: LinkBW=2147483647, AccelBW=1048576, AccelDuration=21000^M
Mar  7 13:31:45 squeezeplay: Pragma: Speed=5.000^M
Mar  7 13:31:45 squeezeplay: Pragma: xPlayStrm=
Comment 1 Adrian Smith 2012-03-11 03:58:28 UTC
Michael - sent you an off line email re the relavent section from the BBC's radio developer site on this.
Comment 2 Michael Herger 2012-03-11 22:37:04 UTC
Adrian - are you sure there was no change to BBC's end regarding this? Looking at our code we don't do anything dynamic. All our BBC "app" does is point to a static OPML file:

http://www.mysqueezebox.com/static/picks/split/BBC.opml

There's that code snippet somebody posted about adding the x-forwarded-for header: we only add it for radiotime/tunein, but not bbc. Do you know whether they expect or evaluate it?
Comment 3 SVN Bot 2012-03-11 22:43:42 UTC
 == Auto-comment from SVN commit #33886 to the slim repo by mherger ==
 == http://svn.slimdevices.com/slim?view=revision&revision=33886 ==

Bug: 17923
Description: add x-forwarded-for header to BBC stream requests
Comment 4 SVN Bot 2012-03-11 22:44:38 UTC
 == Auto-comment from SVN commit #11350 to the network repo by mherger ==
 == http://svn.slimdevices.com/network?view=revision&revision=11350 ==

Bug: 17923
Description: add x-forwarded-for header to BBC stream requests
Comment 5 Bryan Alton 2012-03-12 02:04:43 UTC
There has been no change or URLs on BBC.  If there was there would have been similar reports on other forums such as the Receiva users.

The problem also happens if a user create a Favorite the one of the BBC ASX URLs such as http://www.bbc.co.uk/radio/listen/live/r4.asx so the issue is not the processing of opml but as a result of where the BBC determines using IP address the location the requestor of the HTTP request for http://www.bbc.co.uk/radio/listen/live/r4.asx

Have you check the geo-ip location of the mysb.com ?
If mysb.com ip address used for HTTP request has not changed then has the BBC's geo-ip determination changed  ?
Comment 6 Michael Herger 2012-03-12 05:04:19 UTC
> Have you check the geo-ip location of the mysb.com ?
> If mysb.com ip address used for HTTP request has not changed then has the BBC's
> geo-ip determination changed  ?

We have to confirm with BBC what they are using to determine a client's IP address. I tried to transfer the x-forwarded-for header, but it didn't help. 

Meanwhile I've found our contact at BBC's let me try him.
Comment 7 Michael Herger 2012-03-13 03:29:13 UTC
As of this morning BBC seems to be returning the international streams again. Could you please confirm? The BBC app is working for me again.
Comment 8 Bryan Alton 2012-03-13 08:29:36 UTC
Still broken using Logitech BBC Radio app on both SB3 and Touch.

Also BBC ASX playlist favorite also broken.
Comment 9 Bryan Alton 2012-03-13 08:33:39 UTC
Also a non UK mms URL for BBC R3 works as a Favorite plays OK on Touch and SB3.

So problem with ASX playlist returning UK URLs is still there.
Comment 10 Bryan Alton 2012-03-13 09:41:56 UTC
Just to confirm - definitely returning UK WMA URL


ar 13 16:40:37 squeezeplay: INFO   audio.decode - decode_start_handler:279 init decoder wma,wmap,wmal
Mar 13 16:40:37 squeezeplay: INFO   audio.decode - Playback.lua:476 connect 212.58.252.30:80 GET /wms/bbc_ami/radio3/radio3_bb_live_eq1_sl0?BBC-UID=b4bfc55f77b82781d76c0c1181ef6ef9a8781951c0a0e1c4045f2408c04e6a&SSO2-UID= HTTP/1.0^M
Mar 13 16:40:37 squeezeplay: INFO   audio.decode - Playback.lua:479 GET /wms/bbc_ami/radio3/radio3_bb_live_eq1_sl0?BBC-UID=b4bfc55f77b82781d76c0c1181ef6ef9a8781951c0a0e1c4045f240698c04e6a&SSO2-UID= HTTP/0^M
Mar 13 16:40:37 squeezeplay: Accept: */*^M
Mar 13 16:40:37 squeezeplay: User-Agent: NSPlayer/8.0.0.3802^M
Mar 13 16:40:37 squeezeplay: Host: wmlive-acl.bbc.co.uk^M
Mar 13 16:40:37 squeezeplay: Pragma: xClientGUID={d47018b6-5972-3bc8-9119-c98158bdaf7c}^M
Mar 13 16:40:37 squeezeplay: Pragma: no-cache,rate=1.0000000,stream-offset=0:0,max-duration=0^M
Mar 13 16:40:37 squeezeplay: Pragma: stream-time=0^M
Mar 13 16:40:37 squeezeplay: Pragma: request-context=2^M
Mar 13 16:40:37 squeezeplay: Pragma: LinkBW=2147483647, AccelBW=1048576, AccelDuration=21000^M
Mar 13 16:40:37 squeezeplay: Pragma: Speed=5.000^M
Mar 13 16:40:37 squeezeplay: Pragma: xPlayStrm=
Comment 11 Michael Herger 2012-03-13 09:47:52 UTC
Well, we need to get some real information from the people who should know. It's a pity he doesn't reply.

Thanks for testing!
Comment 12 Bryan Alton 2012-03-13 13:38:11 UTC
I think it is too much of a coincidence that the BBC geo-ip determination processchanges at the same time as a Mysqueezebox.com outage.

My gut feel is the MySqueezebox.com hosting services has rerouted the mysb.com connections and so I think the MySb.com hosting services should be asked "has anything changed " as a result of the outage (e.g. emergency rerouting of connections and so will not go back until explicitly changed)
Comment 13 Michael Herger 2012-03-14 06:20:30 UTC
I've modified the stream list on test.mysqueezebox.com in order to enforce the international streams. Could you please verify this works for you? 

http://wiki.slimdevices.com/index.php/How_to_connect_your_Squeezebox_to_test.mysqueezebox.com
Comment 14 Michael Herger 2012-03-14 08:02:34 UTC
Ok, I added a few more lines to return a list depending on your country setting. You should be able to get the higher quality streams in the UK now.
Comment 15 Bryan Alton 2012-03-14 08:30:55 UTC
The BBC Radio App seems to work mainly OK on a SB3 - just tested a few
stations.  World Service, R5live and BBC6 didn't play. 
BBC Radio 7 doesn't work but should be now Radio 4 extra  (r4x.asx)
Being picky - still missing 1Xtra, 5live extra and Asian Network.

The Internet Radio Search and Tune-in Apps looking for BBC - still don't work.

It looks like a workaround where the BBC Radio App has the UK/non UK URLs.  If
that is the case then make sure each station playlist has all of the 8 mms://
URLs otherwise a single mms:// URL will become overloaded.

A few users use the "Search" of Tune-in and Internet Radio to play  "Listen
Again" programs on ip3k players on mysb.com and so this solution doesn't help.

I haven't check out regional and local radio but I think they should work.

A workaround but not the way things were which will "upset" some users.
Comment 16 Michael Herger 2012-03-14 08:44:16 UTC
> The BBC Radio App seems to work mainly OK on a SB3 - just tested a few
> stations.  World Service, R5live and BBC6 didn't play. 
> BBC Radio 7 doesn't work but should be now Radio 4 extra  (r4x.asx)
> Being picky - still missing 1Xtra, 5live extra and Asian Network.

Could you please give me a full list of URLs you'd like to see published?

> The Internet Radio Search and Tune-in Apps looking for BBC - still don't work.

Unfortunately there's nothing we can do here. This is all handled by TuneIn and (eventually) BBC. All this wouldn't be required if BBC was interested in this issue. But no reaction so far. After all they are deciding what streams should be served.

> It looks like a workaround where the BBC Radio App has the UK/non UK URLs.  If
> that is the case then make sure each station playlist has all of the 8 mms://
> URLs otherwise a single mms:// URL will become overloaded.

We only point to the playlist. The streams then are returned by BBC:

    <outline URL="http://bbc.co.uk/radio/listen/live/r1_uk.asx" text="BBC Radio 1" type="audio" />
    <outline URL="http://bbc.co.uk/radio/listen/live/r2_uk.asx" text="BBC Radio 2" type="audio" />
    <outline URL="http://bbc.co.uk/radio/listen/live/r3_uk.asx" text="BBC Radio 3" type="audio" />
    <outline URL="http://bbc.co.uk/radio/listen/live/r4_uk.asx" bitrate="48" text="BBC Radio 4" type="audio" />
    <outline URL="http://bbc.co.uk/radio/listen/live/r4lw_uk.asx" bitrate="48" text="BBC Radio 4 LW" type="audio" />
    <outline URL="http://www.bbc.co.uk/fivelive/live/live_uk.asx" text="BBC 5 | news &amp; sports" type="audio" />
    <outline URL="http://www.bbc.co.uk/6music/ram/6music_uk.asx" text="BBC 6 | adult alternative" type="audio" />
    <outline URL="http://www.bbc.co.uk/bbc7/realplayer/bbc7_uk.asx" text="BBC 7 | comedy &amp; drama" type="audio" />
    <outline URL="http://www.bbc.co.uk/worldservice/meta/tx/nb/live/www11_uk.asx" bitrate="32" text="BBC World Service | int'l news" type="audio" />
Comment 17 SVN Bot 2012-03-14 08:54:25 UTC
 == Auto-comment from SVN commit #11364 to the network repo by mherger ==
 == http://svn.slimdevices.com/network?view=revision&revision=11364 ==

Bug: 17923
Description: updated BBC stream list (see http://iplayerhelp.external.bbc.co.uk/help/playing_radio_progs/real_wma_streams)
Comment 18 Bryan Alton 2012-03-14 09:14:03 UTC
Nearly there - I see the updated list and all but Radio 4Extra works.   Radio 4 Extra still seems to have a part of BBC 7 left as I see BBC 7 appear and then it stops.

>> The Internet Radio Search and Tune-in Apps looking for BBC - still don't work.

> Unfortunately there's nothing we can do here. This is all handled by TuneIn and
> (eventually) BBC. All this wouldn't be required if BBC was interested in this
> issue. But no reaction so far. After all they are deciding what streams should
> be served.

I made the comment so that other readers of this thread fully understand the limitations of the fix.
Comment 19 Bryan Alton 2012-03-14 09:16:28 UTC
I forgot to clarify the Radio 4 Extra problem.

The BBC list that you point to is out of date and wrong for Radio 4 Extra.  

The URL for Radio 4 Extra should end with r4x.asx and not r7.asx.  The r7.asx URL no longer works.
Comment 20 SVN Bot 2012-03-14 09:25:59 UTC
 == Auto-comment from SVN commit #11365 to the network repo by mherger ==
 == http://svn.slimdevices.com/network?view=revision&revision=11365 ==

Bug: 17923
Description: fix 4Xtra urls - thanks Bryan
Comment 21 Bryan Alton 2012-03-14 10:22:11 UTC
radio 4 Extra still not working for me - I also still see the BBC Radio 7 message so I think either the update hasn't worked or the old list is cached somewhere.

The ASX URL that plays for me is
http://bbc.co.uk/radio/listen/live/r4x.asx

and one of the mms URL for Radio 4 Extra looks like
mms://wmlive-nonacl.bbc.net.uk/wms/bbc_ami/radio4/radio4xtra_bb_live_int_ep1_sl0
Comment 22 Michael Herger 2012-03-14 10:34:57 UTC
Sorry, forgot to update the server. Should be ok now.
Comment 23 SVN Bot 2012-03-14 13:03:42 UTC
 == Auto-comment from SVN commit #11368 to the network repo by mherger ==
 == http://svn.slimdevices.com/network?view=revision&revision=11368 ==

Fixed Bug: 17923
Description: bump mysb.com to roll out BBC workaround

I consider this "fixed" while this workaround is in place. At the same time we're still trying to get in touch with BBC to fix this correctly by respecting the user's IP address.
Comment 24 Bryan Alton 2012-03-14 14:31:55 UTC
This is all you can do for now. All the channel works.

A minor addition. Many non UK Users expect BBC World Service to be part of a list of BBC stations.  Can I suggest two MP3 streams from this page http://www.bbc.co.uk/worldservice/institutional/2009/10/091029_internetradiomobilelinks.shtml

BBC World Service Programmes English UK Schedule
http://www.bbc.co.uk/worldservice/meta/live/mp3/eneuk.pls

BBC World Service News English
http://www.bbc.co.uk/worldservice/meta/live/mp3/ennws.pls

Final point.

The issue of geo ip blocking affects other users of mysb.com and support should be made aware how this can affect users. For example there is a thread about Canadian users not being able to hear Canadian programmes unless they have LMS running and the users don't understand why  (i.e. mysb.com is based in US but players are based in Canada).  
See http://forums.slimdevices.com/showthread.php?t=93630 and possibly http://forums.logitech.com/t5/Squeezebox-Players/CBC-Radio-app/td-p/808909