Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.




4998 posts

Uber Geek
+1 received by user: 110

Trusted

Topic # 16290 3-Oct-2007 09:26
Send private message

Most of us running homebrew PVR's are probably using XMLTVNZ courtesy of Reven.  Great tool and the PVR community owes a great debt of gratitude to Reven for doing that.

Looking at the tivo community here, they don't use XMLTVNZ but seem to rely on a community of users who use various means to update the epg (from scraping to I am guessing, hand entry) and then run some convoluted process to generate a programme slice which the Tivo units ftp each night.  Out of interest I took a look at the slice file but it's in some binary format which I didn't have time to decode (well I had no file layouts!).

Just wondering if folks have any views on this. Some enterprising person could potentially write a program to read the slice file and output xml as a backup in case screen scraping fails again

Larry




System One: Popcorn Hour A200,  PS3 SuperSlim, NPVR and Plex Server running on Gigabyte Brix (Windows 10 Pro), Sony BDP-S390 BD player, Pioneer AVR, Raspberry Pi running Kodi and Plex, Panasonic 60" 3D plasma, Google Chromecast

System Two: Popcorn Hour A200 ,  Oppo BDP-80 BluRay Player with hardware mode to be region free, Vivitek HD1080P 1080P DLP projector with 100" screen. Harman Kardon HK AVR 254 7.1 receiver, Samsung 4K player, Google Chromecast

 


My Google+ page 

 

 

 

https://plus.google.com/+laurencechiu

 

 


View this topic in a long page with up to 500 replies per page Create new topic
 1 | 2 | 3 | 4
1090 posts

Uber Geek
+1 received by user: 182


  Reply # 89248 3-Oct-2007 14:07
Send private message

While in the past most of us MediaPortal people have relied on Reven's awesome xmltvnz, it's now come to light that for those of us who have a DVB-S cards for freeview it is actually possible to use the sky transponders as an EPG source, even though the picture is encrypted the EPG data is not. This is by far the most reliable way of getting EPG data.






4998 posts

Uber Geek
+1 received by user: 110

Trusted

  Reply # 89281 3-Oct-2007 15:58
Send private message

What about those who don't have Sky?  Can you still get the epg source using a DVB-S card?  I am thinking of getting a DVB-S card for Freeview so that would be a reliable solution




System One: Popcorn Hour A200,  PS3 SuperSlim, NPVR and Plex Server running on Gigabyte Brix (Windows 10 Pro), Sony BDP-S390 BD player, Pioneer AVR, Raspberry Pi running Kodi and Plex, Panasonic 60" 3D plasma, Google Chromecast

System Two: Popcorn Hour A200 ,  Oppo BDP-80 BluRay Player with hardware mode to be region free, Vivitek HD1080P 1080P DLP projector with 100" screen. Harman Kardon HK AVR 254 7.1 receiver, Samsung 4K player, Google Chromecast

 


My Google+ page 

 

 

 

https://plus.google.com/+laurencechiu

 

 


 
 
 
 


389 posts

Ultimate Geek
+1 received by user: 26


  Reply # 89306 3-Oct-2007 17:15
Send private message

  DVB-S cards for freeview it is actually possible to use the sky transponders as an EPG source, even though the picture is encrypted the EPG data is not. This is by far the most reliable way of getting EPG data.


wow that is awesome, can you provide any more info?

cheers

1090 posts

Uber Geek
+1 received by user: 182


  Reply # 89396 4-Oct-2007 08:26
Send private message

Well if you don't have sky (via SVIDEO in on your PVR) then Prime would be the only channel you'd gain EPG data for, because everything else would be coming from the freeview anyway.

Here's how you do it in Mediaportal TVServer:  (I guess other PVRs are the same)

The way TVServer works is that you have 1 Channel with multiple sources, [analog], [DVB-S], [DVB-T], [DVB-C], etc

so take discovery for example you'd Set it up via the svideo input+blaster as usual, then you need to scan in the sky transponders, (which are listed at lyngsat.com). You'll now have all those encrypted channels listed. Go the combinations section under TV Channels and select your analog card which will have your sky channels(SVIDEO from Sky STB) listed on the left select Discovery and you'll see in the right pane that Dicsovery (DVB-S encrtpyed) is listed at the top select it and click "combine".

What you have now is Discovery with 2 sources Analog and DVB-S. So now the DVB-S is a source of EPG for the channel "Discovery"

1 Problem, if you try to try to watch Discovery via DVB-S then it will throw an error "Channel is encrypted".

Solution 1: Under the TV Servers section select your TV Server and move the priority of the analog card above the priority of the DVB-S card. That means it will always be chosen first for the sky channels

Solution 2 (Some people have reported that this works (not for me though)): Un-map the the encrypted SKY channels from the DVB-S card

Hope this makes some sense!






553 posts

Ultimate Geek
+1 received by user: 15


  Reply # 89586 5-Oct-2007 07:42
Send private message

For those of you using Bladerunner Pro & xmlTVNZ, i have found a source for epg data thats already 'ripped' from the sky EPG data stream AND converted to xml and available online (nice.net.nz/epg   - use the listings-all file) which is updated twice daly!

Much, much more reliable than xmlTVNZ and has Both the freeview & sky data!
Now if someone can it to work with BRP and let us know how - we can all enjoy this reliable source. Currently ALOT of MythTV users use this, but im too much of a novice to get it going with BRP (currently just use xmlTVNZ)




Craig

81 posts

Master Geek


  Reply # 89618 5-Oct-2007 11:48
Send private message

Thats a good link there illicit, my guess is if we could run an XSLT over it to make it the same as the output from XMLTVNZ, then BRP should have no trouble parsing it. Might have a try this weekend if i get a chance.



4998 posts

Uber Geek
+1 received by user: 110

Trusted

  Reply # 89664 5-Oct-2007 15:49
Send private message

I looked at it also. Apart from the legality of it, looked like a good source. But to automate it you would need to write a program to download the file each night, and then parse the file to produce the format required by the various pvr's.

I suspect something like Python could do the download and any program do the parsing




System One: Popcorn Hour A200,  PS3 SuperSlim, NPVR and Plex Server running on Gigabyte Brix (Windows 10 Pro), Sony BDP-S390 BD player, Pioneer AVR, Raspberry Pi running Kodi and Plex, Panasonic 60" 3D plasma, Google Chromecast

System Two: Popcorn Hour A200 ,  Oppo BDP-80 BluRay Player with hardware mode to be region free, Vivitek HD1080P 1080P DLP projector with 100" screen. Harman Kardon HK AVR 254 7.1 receiver, Samsung 4K player, Google Chromecast

 


My Google+ page 

 

 

 

https://plus.google.com/+laurencechiu

 

 


72 posts

Master Geek


  Reply # 89669 5-Oct-2007 16:24
Send private message

illicit: For those of you using Bladerunner Pro & xmlTVNZ, i have found a source for epg data thats already 'ripped' from the sky EPG data stream AND converted to xml and available online (nice.net.nz/epg   - use the listings-all file) which is updated twice daly!

Much, much more reliable than xmlTVNZ and has Both the freeview & sky data!
Now if someone can it to work with BRP and let us know how - we can all enjoy this reliable source. Currently ALOT of MythTV users use this, but im too much of a novice to get it going with BRP (currently just use xmlTVNZ)




Craig


i had a look at nice.net.nz and noticed that he had (under tools) what could be the tools required to get it into bladerunner.

dunno.

553 posts

Ultimate Geek
+1 received by user: 15


  Reply # 89804 6-Oct-2007 12:46
Send private message

upsilon: Thats a good link there illicit, my guess is if we could run an XSLT over it to make it the same as the output from XMLTVNZ, then BRP should have no trouble parsing it. Might have a try this weekend if i get a chance.


If you could get that working - you will be a god!

Ive tried but just dont have the experience/know how to do so.

What i assume needs done is...

1: A way to download the 'listings_all' file from nice.net.nz automatically at set intervals (every day or 3-4 days etc)

2: Then unzip the downloaded file to the BRP directory

3: Get the file working with BRP

4: Have instructions on how to setup with BRP & MCE


I hope this is do-able because I for one would much rather use this source, due to reliablilty and the Freeview guide listings.

Good Luck - I hope it works



illicit




4998 posts

Uber Geek
+1 received by user: 110

Trusted

  Reply # 89806 6-Oct-2007 12:56
Send private message

I have been thinking about this. Way before xmltvnz was available there was a xmltv script (Perl) that did some scraping etc. But it wasn't supported and stopped working after the sites changed. But I recall from reading the script, it did actually call some Perl functions to read a web site etc. So it would be pretty easy to write a Perl script to download the file from this server and use Windows task scheduler to run the script at some defined interval.

As for transforming the xml data into a format usable by the various PVR's that is just some simple coding. I might have a bash at it when I get the chance

Larry




System One: Popcorn Hour A200,  PS3 SuperSlim, NPVR and Plex Server running on Gigabyte Brix (Windows 10 Pro), Sony BDP-S390 BD player, Pioneer AVR, Raspberry Pi running Kodi and Plex, Panasonic 60" 3D plasma, Google Chromecast

System Two: Popcorn Hour A200 ,  Oppo BDP-80 BluRay Player with hardware mode to be region free, Vivitek HD1080P 1080P DLP projector with 100" screen. Harman Kardon HK AVR 254 7.1 receiver, Samsung 4K player, Google Chromecast

 


My Google+ page 

 

 

 

https://plus.google.com/+laurencechiu

 

 


553 posts

Ultimate Geek
+1 received by user: 15


  Reply # 89808 6-Oct-2007 13:25
Send private message

There is a monetary reward for those who get this working reliably........

81 posts

Master Geek


  Reply # 89944 7-Oct-2007 15:19
Send private message

After a quick look, the info from nice.net.nz is very close to the output of XMLTVNZ. Just doing a manual find and replace i have been able to get the data into media centre using BRP as normal. Now just need to find a way to automate it.

Anyone know who operates Nice.net.nz?

Hawkes Bay
8477 posts

Uber Geek
+1 received by user: 5

Mod Emeritus
Trusted
Lifetime subscriber

  Reply # 89946 7-Oct-2007 15:31
Send private message

upsilon: After a quick look, the info from nice.net.nz is very close to the output of XMLTVNZ. Just doing a manual find and replace i have been able to get the data into media centre using BRP as normal. Now just need to find a way to automate it.

Anyone know who operates Nice.net.nz?

Hadlee Rich









4998 posts

Uber Geek
+1 received by user: 110

Trusted

  Reply # 89950 7-Oct-2007 15:41
Send private message

Since this feed comes from the (I am guessing) Sky satellite and has to be unencrypted else perhaps the STB's can't read it, I wonder if it could ever be legally stopped? The web site could be shut down but it would be just as easy to host this file via bittorrents or via a ftp server a la the tivo slices

Might be the most reliable source to date and pretty much independent of site design.

Since as somebody notes it's pretty easy to transform the file into a form that most PVR's can read, automation of the download is next and I think that is pretty easy.




System One: Popcorn Hour A200,  PS3 SuperSlim, NPVR and Plex Server running on Gigabyte Brix (Windows 10 Pro), Sony BDP-S390 BD player, Pioneer AVR, Raspberry Pi running Kodi and Plex, Panasonic 60" 3D plasma, Google Chromecast

System Two: Popcorn Hour A200 ,  Oppo BDP-80 BluRay Player with hardware mode to be region free, Vivitek HD1080P 1080P DLP projector with 100" screen. Harman Kardon HK AVR 254 7.1 receiver, Samsung 4K player, Google Chromecast

 


My Google+ page 

 

 

 

https://plus.google.com/+laurencechiu

 

 


81 posts

Master Geek


  Reply # 89954 7-Oct-2007 16:16
Send private message

Infact no transformation is required of the xml file, just a modified ChannelInfo.xml file to include the correct channel id's used in the downloaded epg file

This is mine (i only have freeview)

<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<NewDataSet>
  <Channel>
    <name>One</name>
    <channelID>tv1.freeviewnz.tv</channelID>
    <virtualchannel>1</virtualchannel>
  </Channel>
  <Channel>
    <name>TV 2</name>
    <channelID>tv2.freeviewnz.tv</channelID>
    <virtualchannel>2</virtualchannel>
  </Channel>
  <Channel>
    <name>TV 3</name>
    <channelID>tv3.freeviewnz.tv</channelID>
    <virtualchannel>3</virtualchannel>
  </Channel>
  <Channel>
    <name>C4</name>
    <channelID>c4.freeviewnz.tv</channelID>
    <virtualchannel>4</virtualchannel>
  </Channel>
  <Channel>
    <name>TVNZ 6</name>
    <channelID>tvnz6.freeviewnz.tv</channelID>
    <virtualchannel>5</virtualchannel>
  </Channel>
  <Channel>
    <name>Stratos</name>
    <channelID>stratos.freeviewnz.tv</channelID>
    <virtualchannel>6</virtualchannel>
  </Channel>
  <Channel>
    <name>Maori TV</name>
    <channelID>maori-tv.freeviewnz.tv</channelID>
    <virtualchannel>7</virtualchannel>
  </Channel>
  <Channel>
    <name>SportExtra</name>
    <channelID>sportextra.freeviewnz.tv</channelID>
    <virtualchannel>8</virtualchannel>
  </Channel>
</NewDataSet>

 1 | 2 | 3 | 4
View this topic in a long page with up to 500 replies per page Create new topic



Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.


Geekzone Live »

Our community of supporters help make Geekzone possible. Click the button below to join them.

Support Geezone on PressPatron



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.