fix finnish rerun detection

[ikke@…]

Finnish re-run detection is broken. This patch originally done by tomi.orava@… bases on a "rule" that re-runs are marked having string "Uusinta .*" or Just "U" at the end. In english it's "Rerun" and "R". Sometimes it is marked like "Rerun from last week" or something, thats why regexp matches more than just "Uusinta".

I'll attach patch here. Also for the finnish users, I add here the cronscript that takes of the same stuff from xmltv fetched data. That includes crontab entry and a script.

Patch is against 21-fixes.

[ikke@…]

the patch against 21-fixes

[ikke@…]

script getting xmltv data and removing rerun marks

[anonymous]

I forgot to mention that I've been succesfully running this for a month now. It fixes the problem of mythtv recording same shows multiple times because description of the show episode differs due to "rerun" words in there.

Track did not accept cronjob file as attachement, but here's the line from /etc/cron.daily/mythfilldatabase:

sudo -u mythtv -H /stuff/videot/mythtv/.mythtv/mythfilldatabase_cleanup.sh --fetch --feed

[Stuart Auchterlonie]

The bulk of this patch is fine. However i'm not happy with putting a fixup in that is only keyed off NetworkID=0.

This is known to be used by numerous buggy providers, so we cannot use it without qualifying it some more.

This part needs updating

DVB-C Elisa Finland fix[ 0U << 16] = EITFixUp::kFixFI;

to include transportid and serviceid.

[Janne Grunau]

Replying to stuarta:

The bulk of this patch is fine. However i'm not happy with putting a fixup in that is only keyed off NetworkID=0.

This is known to be used by numerous buggy providers,

it is only used by buggy providers, the DVB standard doesn't allow that value.

DVB-C Elisa Finland fix[ 0U << 16] = EITFixUp::kFixFI;

to include transportid and serviceid.

I'm not sure if it's a good idea to have one fixup for every channel on that network. It doesn't ensure unique id's. I assume that it's common for buggy providers that the transport and service ids start at 0 too.

If the other ids look rather random it is still a bad idea since we have to udate the fixups for every channel change on the network.

I would say we can't unfortunately do fixups on broken networks.

[ikke@…]

Hi,

thanks for your attention. That network id is my bad, I have that. It was forgotten there, since I and my friend has different network ids so we just did not set it. Mine is 42249.

In Finland we have a set of channels that are open for everyone, about <10 of those. Those channels are delivered via local DVB-C operators and a national DVB-T provider (many network ids). But all networks have the same eit info, and the same xmltv source for that. The patch now works for all Finns now, and too bad it would run for all others as well ). I totally understand your point of narrowing down the amount of networks that the patch applies to.

I try to ask some friends to check their network id's. Anyone interested, do this:

$ mysql -u mythtv -pmythtv mythconverg mysql> select callsign,name,mplexid,serviceid from channel order by mplexid; mysql> select mplexid,transportid,networkid from dtv_multiplex;

Check network id for Finnish channels from the last command, the channels are mapped to mplexid from the first mysql output.

We would be interested of adding the major ones at least. My provider is Welho (ex HTV in capital area, 42249). National Yle would be interesting, and perhaps Elisa from the biggest DVB-C providers at least.

Of course the ​Welho info page has the wrong networkid there...

[ikke@…]

sorry, forgot line breaks for mysql commands, let's try again:

$ mysql -u mythtv -pmythtv mythconverg
mysql> select callsign,name,mplexid,serviceid from channel order by mplexid;
mysql> select mplexid,transportid,networkid from dtv_multiplex;

[anonymous]

OK, I got more info about some providers. Finnish national YLE dvb-t broadcasts have networkid 8438 at least in southern Finland, capital area:

{{{ DVB-T Espoo, Finland

fix[ 8438U << 16] = EITFixUp::kFixFI;

DVB-C Elisa Finland fix[ 0U << 16] = EITFixUp::kFixFI; fix[ 15U << 16] = EITFixUp::kFixFI;

}}}

The latter one, Elisa, is the kind you mentioned, one with bad networkid zero. Let's forget that one, everyone can patch it themselves who need it.

So all together, could you please add DVB-T YLE id 8438 and DVB-C Welho id 42249 for Finnish fixup call?

{{{ DVB-T Espoo, Finland

fix[ 8438U << 16] = EITFixUp::kFixFI; DVB-C Welho, Finland fix[ 42249U << 16] = EITFixUp::kFixFI;

}}}

[ikke@…]

patch with network ids with a number other than zero

[ikke@…]

welho channel and dvb multiplex tables to show patch numbers are ok

[ikke@…]

I just updated my mythtv, and while compiling I created a new version of the patch. This has now the broken Elisa network removed. I dumped my tables also so Janne can decide wether ids are too random.

[Stuart Auchterlonie]

It's not clean from the myth-eitfix-fi-netwid-fixed.patch which fixup reference relates to the now removed Elisa network. If it was i would remove that portion of the patch and commit it

Can you update this to reflect what is currently being broadcast?

Stuart

[ikke@…]

You don't need to modify the second patch (myth-eitfix-fi-netwid-fixed.patch) at all, I removed the Elisa for you and this is the result.

If you compare the patches you see the difference. I just completely removed the Elisa from the second patch. Otherwise they are identical.

[ikke@…]

One more change, additional blank removing added.

[ikke@…]

stuarta, we chatted today, and I told the patch can be applied as such. But I added one blank character into regexp. This is still OK to apply as such. I just compiled it against 20249 version of fixes and it compiled fine.

[Stuart Auchterlonie]

(In [20261]) Closes #5922. EITFixup for Finnish re-run detection.

Thanks to ikke for the patch.