Unofficial VirtualDub Support Forums [Powered by IB Forums]

Printable Version of Topic
Click here to view this topic in its original format

Unofficial VirtualDub Support Forums > VirtualDub Filters and Filter Development > Creating New Msu Virtualdub Filter.

Posted by: diablo23q May 3 2011, 05:41 PM

Hello everyone!
I am studying in Moscow State University, Russia (sorry for crooked english), and now I have to start a project connected with video processing. Due to requirements it must contain interesting algorithms and must be needed to large group of people. So I'm asking you to help me decide what task to choose.

Now in detail:
Task must be in video processing area.
It will be VirtualDub filter as a result and it will be free to download from here: http://compression.ru/video/
It's desirable for task to be connected with following: stereo, 3d, depth maps, object detection, object tracking.

I will be glad to see any comments. If someone is intrested in development process - I'm ready to contact

Posted by: ale5000 May 3 2011, 07:20 PM

QUOTE (diablo23q @ May 3 2011, 06:41 PM)

It will be VirtualDub filter as a result and it will be free to download from here: http://compression.ru/video/

The development of the free filters in that site seems dead, do you have some informations?

Posted by: diablo23q May 3 2011, 07:30 PM

No, development is still in progress, at least updating some filters. If you'll give me a great idea there will be absolutley new free filter :)

Posted by: ale5000 May 3 2011, 08:43 PM

An idea => a sort of demosaic filter:
- [ QUOTE ] resizing to about 1/4 the orignal pixel distortion before the mosaic, sharpen, blur and then resize to orginal with anti-aliasing and it clears it up a lot [ /QUOTE ] (since this process decrease quality of the entire video it should detect the pixellated part, that can move in the video, and operate only on this part)
- Maybe also using "motion compensation for finding corresponding areas in neighbor frames" like this: http://www.infognition.com/articles/what_is_super_resolution.html
- Maybe the filter could also have options to load a set of external images that can help to improve quality of the reconstructed "parts", like some image of faces where the filter detect the most similar compared to the one inside the video and take particulars from it (in case there are censored faces in the video, but it should also adapt to other censored parts)

This idea require tracking of pixelated objects and maybe can be made compatible also to 3d censored videos (if there are) but I'm not sure about it.

PS: There have been several updates to the filtering support in VirtualDub and the MSU filters hadn't been updated for the new features of VirtualDub, also the last update to free filters was probably 2 years ago (also more then 5 years ago for many filters).

Posted by: diablo23q May 4 2011, 11:59 AM

Thanks a lot, I'll remember this idea. But it doesn't correlates with 3d and object detection as needed. Let's say I need a project right fom these areas.

Posted by: diablo23q May 12 2011, 10:58 AM

QUOTE

The development of the free filters in that site seems dead

And here comes an update: http://forums.virtualdub.org/index.php?act=ST&f=7&t=20029

Posted by: ale5000 May 12 2011, 10:50 PM

Good thing, do you think that also "MSU Subtitle Remover" will be updated?

Posted by: diablo23q May 15 2011, 08:00 PM

Sorry, I don't know exactly. Maybe you should ask in that thread.

Posted by: evropej May 23 2011, 04:00 PM

A deshaking application which involves object detection would be a great application.
Please consult deshaker as an example which is implemented pretty well.
If you need more details, please let me know.

Also, any way to update cartoon restore for new gpu's

Or in general, update some of the filters to utilize new technology?
I thought that site was dead for a long time.
What is the status of all the other filters in that site?

Posted by: diablo23q May 25 2011, 11:41 PM

QUOTE

If you need more details, please let me know.

Yep, can you tell me in detail what do you want to see?

QUOTE

Also, any way to update cartoon restore for new gpu's

Developing new gpu versions of some filters is in progress, as I know. I can ask about cartoon restore.

Posted by: evropej May 26 2011, 02:35 AM

There is a current filter out there called deshaker which reduces shaking or jitter in video.
http://www.guthspot.se/video/deshaker.htm

This filter is well implemented but still has its limitations.
First, its a two step process which makes processing multiple files or batch files a pain.
Second, the filter has issues with areas of low contrast.
Third, the image reconstruction can use some fine tuning.

I would like to see if we can make this technology more robust for instances of low contrast.
I believe the current implementation is done with pixel sums to match one area to another based on parameter information.
I believe that a second algorithm based on true image recognition would enhance the concept.

The benefit is for everyone since most portable devices have cameras on them.
The need to deshake videos is great and a simple application which is more robust would be a great project.

A second concept would be to correct for lens distortion.

Adobe photoshop has this type of filter which corrects for distortions due to say fish eye lenses.

It would be great if they could post some updates to the other filters.
I love the work you guys did and continually use the software.
What is the best way to contact someone?
I have tried the email but none ever answers.

Also, I always wanted to try the super resolution filter which is only available commercially.

Posted by: evropej Jun 1 2011, 02:27 AM

Do you have access to the files?
I see a deshaking software but only available for commercial use.
Thanks

Posted by: rjisinspired Jun 4 2011, 10:12 AM

I would love to see a program like deshaker which would also minimize or eliminate CMOS wobble. From what I had read about it that might be exceptionally difficult to do and if possible would be another slowdown in the processing.

Posted by: evropej Jun 4 2011, 01:46 PM

Msu already have deshaking software but only for commercial use. I would love to see and test it

Posted by: evropej Jun 16 2011, 03:40 PM

Bump
I am really curious about some of these filters, any input would be appreciated.

Posted by: diablo23q Jun 16 2011, 07:51 PM

Yes, I'm alive

Just too busy with exams.
Sorry, for now I can't give you any new information. In next 2 weeks I'll meet my supervisor and we'll talk about deshaker. So don't forget about this topic

Posted by: ale5000 Jun 20 2011, 01:25 AM

@diablo23q: Is it possible to add an english forum? (for all not-russian people)

Posted by: evropej Jun 21 2011, 02:41 PM

QUOTE (diablo23q @ Jun 16 2011, 07:51 PM)

Yes, I'm alive

Just too busy with exams.
Sorry, for now I can't give you any new information. In next 2 weeks I'll meet my supervisor and we'll talk about deshaker. So don't forget about this topic

I will keep bumping it up to remind everyone.
I am extremely interested in these products since they are some of the best filters out there.

Good luck with your exams

Posted by: evropej Jul 28 2011, 02:00 PM

Bump!

Any updates ?

Posted by: diablo23q Aug 6 2011, 01:02 AM

Hi guys! Now I'm working on new deinterlacer, after it's release on compression.ru I'll start my work on deshaker. So I'm not dead

Posted by: evropej Aug 9 2011, 09:49 PM

Nice seeing you back!

I see the site is getting a face lift. This is good news since I thought the project was dead for some time now.

Posted by: evropej Aug 16 2011, 03:51 PM

I would like to point out a feature request which I found is necessary for deshaking videos.

When the camera moves from point a to point b, it creates a different field of view.
Restricting this movement to the x axis for simplicity, creates a field of view which will either compress the left and dilate the right pixels or vice versa.
This type of distortion is amplified by cameras which don't have a wide angle lens.

A second feature would be to correct for motion blur.
I know Topaz Labs for Photopshop has a filter which corrects for blur created by motion.
Most cameras will blur the image when the camera moves due to shutter speeds or exposure time.
For example, sharpening can be applied to images when motion is detected.

I asked the developer of deshaker filter if he plans to implement the first feature and he stated not at this time.
Also, I mentioned possible coordinating with you on the effort but he stated again that external help on a student project is not permitted.

So I guess my last resort is to see if you would take this challenge on as part of your study.

These are the two deshaking features which are currently lacking and I would hope to see researched and mitigated.

Posted by: evropej Feb 24 2012, 02:11 PM

does this mean that you are working on this now?

Posted by: TlatoSMD Jun 26 2012, 08:06 PM

Bump!

Four filters still direly needed:

a.) A filter to remove that nasty, annoying colorful and monochrome RGB noise that's particularly strong in PAL and results from cross-talk from the luma to the chroma channel ("rainbow swirls") and vise versa ("dotcrawl"). It originates especially from poor isolation in analogue video cables. I know that MSU already has the algorithms for that as part of their Tuner TV Restore filter: http://compression.ru/video/tuner_tv_restore/index_en.html , but that's a commercial filter and all I need from that would be something to remove the crosstalk from chroma to luma and vice versa.

Tacosalad (aka The Fish?) wrote his Dotcrawl filter for this problem, but that's really for NTSC where the problem is much smaller, so it's not really useable for removing dotcrawl and rainbow swirls from PAL material (though it works as a nice general denoiser). Around 2005, I had an e-mail exchange with him and he said he had the basic layout for a PAL version figured out in his head, but he never got around to actually doing it. Other than that, I know that around 2000, a German university professor wrote a PAL-specific VDub filter for this, but his website is gone and the mirrored version I got from the large list at infocognition.com only crashes with modern versions of VDub without even previewing anything, probably because it was written more than 10 years ago. The second you hit "ok" to close the window with the used filters list, VDub crashes with it.

Any other noise filters ain't really specialized to remove crosstalk noise, so you gotta push the values really high to also catch at least a little of the crosstalk. Problem is, you're pretty much destroying the rest of the picture with that.

b.) An effective ghost removal filter.

c.) A filter particularly for removing the "ringing" around edges that occurs from MPEG or JPEG compressing. MSU Cartoon Restore does that, but it makes any live-action footage look bland, dull, and waxy. MSU Deblocking only catches the actual blocking artifacts, not the ringing.

d.) Finally, a fourth VDub filter I'd really like to see would be a VDub version of this: http://compression.ru/video/frame_rate_conversion/index_en_msu.html