i want to track the movement of the object that i detected using connected components.

In the attached image, I was able to detect an object of my interest. As the image i attached is the first frame of a video file, i want to track the movement of the object throughout the whole video. what method can I use to track the object?.

Answer 1

[Image Analyst]

Just threshold it to get a binary image. Then you can use bwboundaries() to get the outline of it, or you can use regionprops() to get the centroid of it. You can store those in an array where each element of the array is the centroid or boundary for that frame.

For example see the attached example and see how I keep track of hte color means for all the frames.

[Shabhrish Reddy Uddehal]

Hi Image Analyst,

I have tried the method you suggested, but it did not seem to work for my case as I am not able to find the Fluid(connected component in the image above) in every single frame. My problem is flickering, the image smallest.jpg is the frame at 10th second of the video and i was able to identify it using connnected components, but due to the flickering, the fluid is not visible in every frame and hence connected components does not contain the fluid. I want to first detect the fluid in every frame and then want to track it accordingly.

Can you recommend me on how to remove the flickering effect from different frames or setting the frames with equal brightness or contract so that there is no flickering effect.

I have attached the code below for real time edge detection on the video.

clc;  
close all;  
imtool close all;  
clear;
read_video = vision.VideoFileReader('9C09704m.avi');
write_video = vision.VideoFileWriter('R
eal_time_edge_detection_9C09704m.avi', ...
    'FrameRate',read_video.info.VideoFrameRate);
video_player = vision.VideoPlayer;


while ~isDone(read_video)
    frame = read_video();
    gray_image = rgb2gray(frame);
    [ a, thrsh] = edge(gray_image, 'Canny');
    edgee = edge(gray_image, 'Canny', thrsh * 3);
    open = bwareaopen(edgee, 380, 8);
    connected_components = bwconncomp(open)
    numPixels = cellfun(@numel,connected_components.PixelIdxList);
    L = labelmatrix(connected_components);
    video_player(label2rgb(L,'jet','w','shuffle'));
    write_video(open);
    pause(0.5)
end

release(video_player);
release(read_video) ;
release(write_video);

[Image Analyst]

I haven't seen your video and the image you attached isn't exactly clarifying. If there is no fluid detected in the frame, you can skip that frame

if isempty(connected_components)
    continue; % Skip to the bottom of the loop and continue with the next frame.
end

Don't use open as the name of your variable since that's the name of a built-in function. Call it "openedImage" or something other than "open".

[Shabhrish Reddy Uddehal]

Hi Image Analyst,

Thank you for your suggestion. I tired the approach you mentioned above and since the frames with the fluid missing is alot. I have to somehow reduce the flickering first and then implelment.

[Image Analyst]

OK. Good luck.