RustyGonad: Hey guys,

Been working through the "Program Categories NZL.ini" file, trying to add the correct category data the the Sky NZ feeds.

While this mostly works as it should, for example:

128=Sport General
129=sport ESPN
130=Sport Golf
131=Sport Soccer
132=Sport Other
133=Sport Rugby
134=Sport Athletics
135=Sport Motorsport
136=Sport Fishing
137=Sport Extreme Sports
138=Sport Horses
139=Sport Boxing
140=Sport Rugby League
141=Sport Cricket
142=Sport Cycling

- works pretty well exactly for sport.

However there are a number of clashes/anomolies with some of the other categories, which don't exist in the transmitted data from Sky (when compared to say a raw dump from DVBGuide), and the simple genres in that data ie Movies, Sport, Kids, Entertainment, Documentary, News etc.

This means that movies for example, are landing up with the same tag (for example 45), as some documentaries.

So effectively you end up with no separation between, say Monters vs Aliens (obviously a movie), and half the programs on say, the History Channel. Obviously this creates all sorts of colour clashes in Media Centre... Doco's showing purple etc.

The same goes for alot of other categories ie news/documentaries getting the same codes.

Not sure how your doing the genre/category classification, but something seems to be going wrong somewhere...

If possible it'd be great to just have access to the original broadcast categories, as they match up exactly with the colour range in Media Center.

Cheers,
Russell

SJB:

RustyGonad: Hey guys,

Been working through the "Program Categories NZL.ini" file, trying to add the correct category data the the Sky NZ feeds.

While this mostly works as it should, for example:

128=Sport General
129=sport ESPN
130=Sport Golf
131=Sport Soccer
132=Sport Other
133=Sport Rugby
134=Sport Athletics
135=Sport Motorsport
136=Sport Fishing
137=Sport Extreme Sports
138=Sport Horses
139=Sport Boxing
140=Sport Rugby League
141=Sport Cricket
142=Sport Cycling

- works pretty well exactly for sport.

However there are a number of clashes/anomolies with some of the other categories, which don't exist in the transmitted data from Sky (when compared to say a raw dump from DVBGuide), and the simple genres in that data ie Movies, Sport, Kids, Entertainment, Documentary, News etc.

This means that movies for example, are landing up with the same tag (for example 45), as some documentaries.

So effectively you end up with no separation between, say Monters vs Aliens (obviously a movie), and half the programs on say, the History Channel. Obviously this creates all sorts of colour clashes in Media Centre... Doco's showing purple etc.

The same goes for alot of other categories ie news/documentaries getting the same codes.

Not sure how your doing the genre/category classification, but something seems to be going wrong somewhere...

If possible it'd be great to just have access to the original broadcast categories, as they match up exactly with the colour range in Media Center.

Cheers,
Russell

If you want to see the actual category codes that are broadcast add Debug:LOGTITLES and the file EPG Titles.log contains the Cat ID which is used to look up the Categories file.

Is that any help?

Steve

RustyGonad:

SJB:

RustyGonad: Hey guys,

Been working through the "Program Categories NZL.ini" file, trying to add the correct category data the the Sky NZ feeds.

While this mostly works as it should, for example:

128=Sport General
129=sport ESPN
130=Sport Golf
131=Sport Soccer
132=Sport Other
133=Sport Rugby
134=Sport Athletics
135=Sport Motorsport
136=Sport Fishing
137=Sport Extreme Sports
138=Sport Horses
139=Sport Boxing
140=Sport Rugby League
141=Sport Cricket
142=Sport Cycling

- works pretty well exactly for sport.

However there are a number of clashes/anomolies with some of the other categories, which don't exist in the transmitted data from Sky (when compared to say a raw dump from DVBGuide), and the simple genres in that data ie Movies, Sport, Kids, Entertainment, Documentary, News etc.

This means that movies for example, are landing up with the same tag (for example 45), as some documentaries.

So effectively you end up with no separation between, say Monters vs Aliens (obviously a movie), and half the programs on say, the History Channel. Obviously this creates all sorts of colour clashes in Media Centre... Doco's showing purple etc.

The same goes for alot of other categories ie news/documentaries getting the same codes.

Not sure how your doing the genre/category classification, but something seems to be going wrong somewhere...

If possible it'd be great to just have access to the original broadcast categories, as they match up exactly with the colour range in Media Center.

Cheers,
Russell

If you want to see the actual category codes that are broadcast add Debug:LOGTITLES and the file EPG Titles.log contains the Cat ID which is used to look up the Categories file.

Is that any help?

Steve

Sort of - It helps alot to be able see all the Cat ID's in one place - so yes the log file is usefull, however it doesn't help wih the clashes in Cat ID's.

For example Cat ID 34 is used both in documentaries (eg Air Crash Invesigation) and movies (eg Robocop 3).  One is right, one isn't...  There's a few hundred other examples in any given grab...

Take Robocop 3 as an example

DVBGuide

 
   
    Action:This time the half-man, half-robot takes on ruthless developers and their mercenary army, which is trying to evict tenants from their homes. Starring: Robert Burke, Rip Torn. (WS) HD.
    Movies
 

EPGCollector

      start="20100804152000 +1200"
    stop="20100804170500 +1200"
    channel="22">
   
    Action:This time the half-man, half-robot takes on ruthless developers and their mercenary army, which is trying to evict tenants from their homes. Starring: Robert Burke, Rip Torn. (WS) HD.
    34
   
      M
   
   
      16:9
      HDTV
   
   
      Robert Burke
      Rip Torn
   
 

As explained Air Crash Investigation also gets 34...

There seems to be about 50-100 separate/unique category ID's...  While this in effect allows for a much greater level of category detail, if they're incorrect (which they are at the moment) it kinda makes the category info useless...

If I compare some of the examples with the raw output pulled out of DVBGuide, which I believe grabs the same data, there's less than 10 different genre/categories ie Movies, Sport, Entertainment, Kids, Documentaries, News, Education, etc. both the examples above get the correct category ie Air Crash Investigation gets tagged as a Education, and Robocop 3 gets tagged as a movie.

Hopefully that all makes sense...

Cheers,

kipster: Hi Steve,
I have tried to epg collecotr to download the MHEG5 data for Australia however I received no data. Here is the log.

C:\Program Files\EPG Collector>epgcollector /ini=7.ini
Started on 4/08/2010

============================ EPG Collector (Version 2.0.16) ====================
==========

Tuner info: Node type 0
Tuner info: Node type 1
Tuner info: Descriptor 00000000-0000-0000-0000-000000000000 71985f4c-1ca1-11d3-9
cc8-00c04f7971e0 0
Tuner info: Descriptor 00000000-0000-0000-0000-000000000000 2dac6e05-edbe-4b9c-b
387-1b6fad7d6495 1

Found tuner 1: FusionHDTV, BDA Tuner1 (Terrestrial)

Processing command line parameter: /ini=7.ini
Processing INI Category : GENERAL
Processing ini parameter: Output=c:\temp\tvguide.xml
Processing ini parameter: Tuner=1
Processing ini parameter: Timeouts=10,300
Processing ini parameter: TuningType=DVBT
Processing ini parameter: TuningFile=Australia.Vic - Melbourne.xml
Processing ini parameter: ScanningFrequency=177500,7,MHEG5
Processing INI Category : SATELLITE
Processing INI Category : STATIONS
Tuning to frequency 177500 on Terrestrial
Using tuner 1: FusionHDTV, BDA Tuner1
Signal acquired: lock is True quality is 90 strength is 5961335
Collecting station data......
Stopping station reader for frequency 177500 PID 0x11
Stations: 5 buffer space used: 2478
Found 5 stations on frequency 177500
Included station: 7 Digital        (4115,1283,1328 Service type 1)
Included station: 7 Digital 1      (4115,1283,1329 Service type 1)
Included station: 7TWO             (4115,1283,1330 Service type 1)
Included station: 7 Digital 3      (4115,1283,1331 Service type 1)
Included station: 7 HD Digital     (4115,1283,1332 Service type 1)
Added 5 stations for frequency 177500
Processing MHEG parser format parameter: Fields:5,10
Processing MHEG parser format parameter: Field:RootCRID,3
Processing MHEG parser format parameter: Field:ProgramCount,4
Processing MHEG parser format parameter: Field:EventID,0
Processing MHEG parser format parameter: Field:EventName,7
Processing MHEG parser format parameter: Field:StartTime,1
Processing MHEG parser format parameter: Field:EndTime,2
Processing MHEG parser format parameter: Field:ShortDescription,8
Processing MHEG parser format parameter: Field:ImageCount,9
Processing MHEG parser format parameter: Field:SeriesCRID,2
Processing MHEG parser format parameter: Field:ProgramCRID,6
EPG delivery system is MHEG5 on frequency 177500 PID 0x399
Collecting MHEG5 data.............................................
Data blocks: 389 buffer space used: 3254118
Stopping reader for frequency 177500 PID 0x399
Stopping section readers
Stopped section readers
Background worker thread finished
Stop request received
Stopping background worker thread
Stop request processed
Deleting any existing version of output file
Creating output file: c:\temp\tvguide.xml

============================ Stations With No Data =============================
=

Station: 7 Digital        (4115,1283,1328) No data
Station: 7 Digital 1      (4115,1283,1329) No data
Station: 7TWO             (4115,1283,1330) No data
Station: 7 Digital 3      (4115,1283,1331) No data
Station: 7 HD Digital     (4115,1283,1332) No data

============================ Output Data ==============================

Summary: Total Stations = 0 Total Gaps = 0 Total Overlaps = 0 Total Time = 00:02
:26.2843670
Finished - created 0 EPG entries
Exiting with code = 0


Plus the ini file
# See ReadMe.txt for detailed description of parameters

[GENERAL]
# Output - specifies the path of the output file. Default is XMLTV.xml in the executable directory.
Output=c:\temp\tvguide.xml

# Tuner - specifies number of tuner to use. Only needed if more than one tuner. Default is to use first available.
#       Run utility with command line /tuners to get list of tuners and numbers.
Tuner=1

# Timeouts - in seconds - optional - defaults are 10 and 300 respectively
# Param1 - maximum wait time to lock signal after tuning
# Param2 - length of time to collect data before changing frequency
Timeouts=10,300

# TuningFile & Type
# TuningType can be Satellite OR DVBT
# TuningFile specifies the name of the file currently used
TuningType=DVBT
TuningFile=Australia.Vic - Melbourne.xml
ScanningFrequency=177500,7,MHEG5


[SATELLITE]
# Dish - comment or remove whole line for terrestrial
# Param1 - LNB low band
# Param2 - LNB high band
# Param3 - LNB switch
# Default values = 9750000,10750000,11700000

# TV Stations - Excluded stations list - any station in this list WILL BE IGNORED
[STATIONS]


This happens with all the frequencies I try. Am I missing something.

Thanks
kip

SJB:

kipster: Hi Steve,
I have tried to epg collecotr to download the MHEG5 data for Australia however I received no data. Here is the log.

C:\Program Files\EPG Collector>epgcollector /ini=7.ini
Started on 4/08/2010

============================ EPG Collector (Version 2.0.16) ====================
==========

Tuner info: Node type 0
Tuner info: Node type 1
Tuner info: Descriptor 00000000-0000-0000-0000-000000000000 71985f4c-1ca1-11d3-9
cc8-00c04f7971e0 0
Tuner info: Descriptor 00000000-0000-0000-0000-000000000000 2dac6e05-edbe-4b9c-b
387-1b6fad7d6495 1

Found tuner 1: FusionHDTV, BDA Tuner1 (Terrestrial)

Processing command line parameter: /ini=7.ini
Processing INI Category : GENERAL
Processing ini parameter: Output=c:\temp\tvguide.xml
Processing ini parameter: Tuner=1
Processing ini parameter: Timeouts=10,300
Processing ini parameter: TuningType=DVBT
Processing ini parameter: TuningFile=Australia.Vic - Melbourne.xml
Processing ini parameter: ScanningFrequency=177500,7,MHEG5
Processing INI Category : SATELLITE
Processing INI Category : STATIONS
Tuning to frequency 177500 on Terrestrial
Using tuner 1: FusionHDTV, BDA Tuner1
Signal acquired: lock is True quality is 90 strength is 5961335
Collecting station data......
Stopping station reader for frequency 177500 PID 0x11
Stations: 5 buffer space used: 2478
Found 5 stations on frequency 177500
Included station: 7 Digital        (4115,1283,1328 Service type 1)
Included station: 7 Digital 1      (4115,1283,1329 Service type 1)
Included station: 7TWO             (4115,1283,1330 Service type 1)
Included station: 7 Digital 3      (4115,1283,1331 Service type 1)
Included station: 7 HD Digital     (4115,1283,1332 Service type 1)
Added 5 stations for frequency 177500
Processing MHEG parser format parameter: Fields:5,10
Processing MHEG parser format parameter: Field:RootCRID,3
Processing MHEG parser format parameter: Field:ProgramCount,4
Processing MHEG parser format parameter: Field:EventID,0
Processing MHEG parser format parameter: Field:EventName,7
Processing MHEG parser format parameter: Field:StartTime,1
Processing MHEG parser format parameter: Field:EndTime,2
Processing MHEG parser format parameter: Field:ShortDescription,8
Processing MHEG parser format parameter: Field:ImageCount,9
Processing MHEG parser format parameter: Field:SeriesCRID,2
Processing MHEG parser format parameter: Field:ProgramCRID,6
EPG delivery system is MHEG5 on frequency 177500 PID 0x399
Collecting MHEG5 data.............................................
Data blocks: 389 buffer space used: 3254118
Stopping reader for frequency 177500 PID 0x399
Stopping section readers
Stopped section readers
Background worker thread finished
Stop request received
Stopping background worker thread
Stop request processed
Deleting any existing version of output file
Creating output file: c:\temp\tvguide.xml

============================ Stations With No Data =============================
=

Station: 7 Digital        (4115,1283,1328) No data
Station: 7 Digital 1      (4115,1283,1329) No data
Station: 7TWO             (4115,1283,1330) No data
Station: 7 Digital 3      (4115,1283,1331) No data
Station: 7 HD Digital     (4115,1283,1332) No data

============================ Output Data ==============================

Summary: Total Stations = 0 Total Gaps = 0 Total Overlaps = 0 Total Time = 00:02
:26.2843670
Finished - created 0 EPG entries
Exiting with code = 0


Plus the ini file
# See ReadMe.txt for detailed description of parameters

[GENERAL]
# Output - specifies the path of the output file. Default is XMLTV.xml in the executable directory.
Output=c:\temp\tvguide.xml

# Tuner - specifies number of tuner to use. Only needed if more than one tuner. Default is to use first available.
#       Run utility with command line /tuners to get list of tuners and numbers.
Tuner=1

# Timeouts - in seconds - optional - defaults are 10 and 300 respectively
# Param1 - maximum wait time to lock signal after tuning
# Param2 - length of time to collect data before changing frequency
Timeouts=10,300

# TuningFile & Type
# TuningType can be Satellite OR DVBT
# TuningFile specifies the name of the file currently used
TuningType=DVBT
TuningFile=Australia.Vic - Melbourne.xml
ScanningFrequency=177500,7,MHEG5


[SATELLITE]
# Dish - comment or remove whole line for terrestrial
# Param1 - LNB low band
# Param2 - LNB high band
# Param3 - LNB switch
# Default values = 9750000,10750000,11700000

# TV Stations - Excluded stations list - any station in this list WILL BE IGNORED
[STATIONS]


This happens with all the frequencies I try. Am I missing something.

Thanks
kip

I'm going to PM you on this one.

Maybe DVBGuide gets it's data from EIT while the above is OpenTV. I didn't think there were any OpenTV grabbers for Windows until recently (except maybe an MP plugin).

I'd be surprised if the OpenTV collection was setting any other value than the one it received but I'll double check it. It's just a single field in the title data. If it was picking it up from the wrong place the way it analyzes the data means it would all be wrong.

The other thing is that someone in Oz came up with a Category.ini for their data and nobody has mentioned anything about it being wrong.

Try an EIT collection and see what that gives you.

Steve

RustyGonad:

Maybe DVBGuide gets it's data from EIT while the above is OpenTV. I didn't think there were any OpenTV grabbers for Windows until recently (except maybe an MP plugin).

I'd be surprised if the OpenTV collection was setting any other value than the one it received but I'll double check it. It's just a single field in the title data. If it was picking it up from the wrong place the way it analyzes the data means it would all be wrong.

The other thing is that someone in Oz came up with a Category.ini for their data and nobody has mentioned anything about it being wrong.

Try an EIT collection and see what that gives you.

Steve

If thats how its coming from Sky then there's not alot you can do...  Very suprised that they're supply that much detail in the categories.  They must seperate per channel on the MySky box, before adding categories, which would prevent the code clashes.

Not sure whether DVBGuide gets it data via OpenTV or EIT - it only needs a single freq to get the whole 7 days, so I suspect its using OpenTV, although don't quote me on that.

BTW - the EPGCollector EIT data is correct - it delivers a name based category, eg Movies without any clashes. 

I'll just do multiple grabs, from separate directories to split the channels/clashes.

Longer term is there any way you could say work in the channel number (optionally) into the Program Categories file/matching?  It'd provide another way of providing a unique category without having to do multiple grabs.

If not never mind, I'll just work around it...

Cheers,

kipster: Gday Steve,
I have modified my ini as per your pm. Attached is the latest logfile. When I used Frequencies instead of ScanningFrequencies no stations were found

Thanks
kip

edit: re-read pm. I have emailed logfile

SJB:

kipster: Gday Steve,
I have modified my ini as per your pm. Attached is the latest logfile. When I used Frequencies instead of ScanningFrequencies no stations were found

Thanks
kip

edit: re-read pm. I have emailed logfile

No email yet.