Modify

Opened 3 years ago

Closed 3 years ago

Last modified 3 years ago

#10970 closed Bug Report - General (fixed)

Mythbackend failed recordings, deadlocks

Reported by: Peter Townsend <elpinkus@…> Owned by: Daniel Kristjansson <danielk@…>
Priority: minor Milestone: 0.26
Component: MythTV - General Version: Master Head
Severity: medium Keywords:
Cc: Ticket locked: no

Description

In the last week or so, my backend has been getting into a state where all recordings fail to start. Killing mythbackend and running it again makes things record again for a day or two.

This afternoon two recordings failed to start and mythbackend stopped responding through mythweb or the internal webserver.

I followed the instructions on the wiki for attaching gdb and generating a backtrace. Let me know what other information I can provide.

Running version v0.26-alpha-79-gb379de3. Possibly related to #10870.

Attachments (3)

mythbackend.tar.bz2 (261.9 KB) - added by Peter Townsend <elpinkus@…> 3 years ago.
Backend log
gdb.txt (103.6 KB) - added by Peter Townsend <elpinkus@…> 3 years ago.
Backtrace
version.txt (823 bytes) - added by Peter Townsend <elpinkus@…> 3 years ago.
--version output

Download all attachments as: .zip

Change History (10)

Changed 3 years ago by Peter Townsend <elpinkus@…>

Backend log

Changed 3 years ago by Peter Townsend <elpinkus@…>

Backtrace

Changed 3 years ago by Peter Townsend <elpinkus@…>

--version output

comment:1 Changed 3 years ago by danielk

  • Status changed from new to infoneeded_new

What is your "ulimit -u" output ?

Also, what is the output of "cat /proc/sys/vm/overcommit_memory" ?

comment:2 Changed 3 years ago by Daniel Thor Kristjansson <danielk@…>

In 9f0be65bfcf192191d8905012f173f80a19f66d5/mythtv:

Refs #10970. Don't print EOF as error if it's expected.

This isn't the cause of any issues, it's just a bit confusing when reading the logs.
When we close a DRB we are expecting a EOF so it's not an error when we see it..

comment:3 Changed 3 years ago by danielk

As far as I can tell this shouldn't be happening.

StreamHandler::Start() seems to be waiting for the thread to start. It's waiting for either _running or _error to be set. I don't see any way that DVBStreamHandler::run() can exit without setting either of those. It also seems like DVBStreamHandler::RunTS() is running a piece of code that would only be run after setting _running to true, however that could be in service of another stream. It is possible that MTHread::start() has called QThread::start(), but the thread was never started because we ran out of memory or we exceeded our process allocation. However, that shouldn't occur with any normally configured Linux system. Finally, while _running is not declared as volatile, the while loop that checks it calls a function outside the current translation unit so gcc should not optimise the check away since it can't know that _running isn't set by that call.

comment:4 Changed 3 years ago by Peter Townsend <elpinkus@…>

ulimit -u 31520

cat /proc/sys/vm/overcommit_memory 0

comment:5 Changed 3 years ago by Daniel Kristjansson <danielk@…>

  • Owner set to Daniel Kristjansson <danielk@…>
  • Resolution set to fixed
  • Status changed from infoneeded_new to closed

In 7d01e691d2bb58ed7dcbbdcca93ec06dc3a7381b/mythtv:

Fixes #10970. Fix StreamHandler? restart race.

We wait for _running to be set to false, but we need the thread to be
in the finish state or QThread::start() will exit silently without
starting the thread. Since we're calling QThread::wait() we don't
really need the while (_running) loop at all in either Start() or
Stop(), so I've removed it. This race probably dates back to the
pthread->QThread porting.

comment:6 Changed 3 years ago by danielk

  • Milestone changed from unknown to 0.26

comment:7 Changed 3 years ago by Daniel Kristjansson <danielk@…>

In eb52783e9f7ad232cbf4afb22dbc604898514e45/mythtv:

Fixes #10970. Fix StreamHandler? restart race.

We wait for _running to be set to false, but we need the thread to be
in the finish state or QThread::start() will exit silently without
starting the thread. Since we're calling QThread::wait() we don't
really need the while (_running) loop at all in either Start() or
Stop(), so I've removed it. This race probably dates back to the
pthread->QThread porting.
(cherry picked from commit 7d01e691d2bb58ed7dcbbdcca93ec06dc3a7381b)

Add Comment

Modify Ticket

Action
as closed The owner will remain Daniel Kristjansson <danielk@…>.
The resolution will be deleted. Next status will be 'new'.
Author


E-mail address and user name can be saved in the Preferences.

 
Note: See TracTickets for help on using tickets.