avfilter: Return more meaningful error codes