aligned video-patch with visible edges

Q&A about the latest versions
Post Reply
Tawrank
Posts: 6
Joined: Fri Feb 15, 2019 9:28 pm

aligned video-patch with visible edges

Post by Tawrank » Tue Feb 19, 2019 10:45 pm

hi, i followed the tutorial about aligning video, quite complicated, but i succeeded so far. the only problem is, when i pin the video to the panorama, i can see the harsh edges of the patch, due to different colour and brightness. i mean, the patch runs through different processes in ptgui, photoshop and pano2vr ... is it the final rendering that leads to these changes in colour ? the edges of the final patch are part of the extracted patch from the original panorama, not from the video, but at the end, both, the patch and the image sequence, run through the final rendering, to get the video. can anybody give me an advice how the problem could be eliminated ?

User avatar
Hopki
Gnome
Posts: 9003
Joined: Thu Jan 10, 2008 3:16 pm
Location: Layer de la Haye, Essex UK
Contact:

Re: aligned video-patch with visible edges

Post by Hopki » Tue Feb 19, 2019 11:43 pm

Hi,
We are looking at an alternative way of doing this.
The biggest problem with this is the colour match for image and a video.
It is also down to each browser which will process the videos and pictures so you will see differences between browser.
So even though you get it perfect for say Edge, it will probably look bad in Firefox.
It does depend on the scene, on how bad it looks.

It's not just Pano2VR I have seen some really bad examples on all players/tour builders that can do this.
As and when we have something we will blog about it.
Regards,
Hopki

User avatar
1uv3
Posts: 123
Joined: Thu Sep 20, 2018 10:18 pm

Re: aligned video-patch with visible edges

Post by 1uv3 » Wed Feb 20, 2019 6:30 am

Yeah, the best option I have found is minimal editing of the original pan, however, your patch image itself should always match up perfectly with the panorama with no color distortion other than maybe some of video that's showing through the patch.....but the patch edges should always match up to the panorama.
patch-fishtank.jpg
patch-fishtank.jpg (494.9 KiB) Viewed 224 times
Shot with a Pentax-K1 + HD8M-P 8mm f/3.5 HD Fisheye Lens

In that screenshot all of the tanks are showing through the patch leaving the edges of the patch to match up perfectly. Be sure that when you are editing the video/patch layer that you do not remove any of the patch layers edges.

It's tough to get the video to match if you've altered the original pan by running filters in photoshop or whatever you use for your image editing and forget about it if you shot the pan in low lighting taking bracketed images with a wide angle lens because the video will never contain the same amount of viable information as the raw images which makes it impossible to match up because the video is going to be grainy while the panorama is not.

Also, I've found it useful to use Photoshop's "curves" on the video layer image frame to match the image sequence with the patch the best I can before rendering the image sequence to a video file. You will first have to convert the image sequence to a "smart object". After you have converted it to a smart object the edits that you make to one frame with carry over to all the rest of the frames when you render the project.

There are a lot of variables but like I said in the beginning, minimal image editing for the panorama otherwise you will throw the color, contrast, white balance and everything else off and you won't be able to efficiently do the same to the video file because it just doesn't contain the same amount of info per frame.
Creative expression is the Universe's only way of experiencing every configurative atomic possibility capable within a finite Universe.

Tawrank
Posts: 6
Joined: Fri Feb 15, 2019 9:28 pm

Re: aligned video-patch with visible edges

Post by Tawrank » Wed Feb 20, 2019 11:38 am

@ Hopki: thanks for your reply, that is not satisfying but good to know. I could not explain that to my client, who would f.e. welcome the tour-visitors in the first node. looking forward to you finding a solution ...

@ 1uv3: hi there, as i explained it´s the patch edges, that do not match, although they should, as you mentioned it. that´s why i supposed, the colour distortion of the patch-edges happens in the final rendering. the differences between patch and video are evident to me, nevertheless thanks for your advices concerning that issue. by the way: when i do the first step, to create the image sequence, the imported video-layers (taken with a canon 5d mark3) look terrible in colour, without any profile. here i check around with the different coulour spaces to get already closer to the extracted patch, which i use later on. I will have another try today, but as Hopki said, up to now the problem can´t be fixed, for reason of the display in different browsers ...

User avatar
1uv3
Posts: 123
Joined: Thu Sep 20, 2018 10:18 pm

Re: aligned video-patch with visible edges

Post by 1uv3 » Wed Feb 20, 2019 5:07 pm

Hey there,

Maybe I am misunderstanding what you are talking about but if the edges of your patch aren't color matching the pano then something is going wrong in your process. I've tested across all browser platforms and have the same results with no detection that the patch is even there aside from the video playing and definitely cannot see where the pano ends and the patch begins.

Here is a short video to show you what I mean https://youtu.be/j6AZyEvWUzk

I didn't think about checking on the other browsers till afterwards but here are the screenshots:

Opera
opera.jpg
opera.jpg (442.65 KiB) Viewed 206 times
FF
firefix.jpg
firefix.jpg (428.03 KiB) Viewed 206 times
Safari
safari.jpg
safari.jpg (408.91 KiB) Viewed 206 times
Creative expression is the Universe's only way of experiencing every configurative atomic possibility capable within a finite Universe.

Tawrank
Posts: 6
Joined: Fri Feb 15, 2019 9:28 pm

Re: aligned video-patch with visible edges

Post by Tawrank » Thu Feb 21, 2019 12:03 pm

hey 1uv3,
no, you aren´t misunderstanding, i really have the problem, that the edges of the patch are visible, not matching with the pano. i checked to pin the extracted patch from ptgui directly to the pano, without merging with the video and everything was fine. after rendering the imagesequence together with the patch to create the final video, the problem exists. would you please tell me, which rendering-options you use. thank you for your examples, i am really wondering why your edges look that good, even in different browsers. when i compare the examples of the blacksmith on the gnome-site, in firefox and safari, i even see big differences ... i have no idea anymore, where my mistake lies, would be great, if you can help me to figure this out.

Tawrank
Posts: 6
Joined: Fri Feb 15, 2019 9:28 pm

Re: aligned video-patch with visible edges

Post by Tawrank » Thu Feb 21, 2019 2:17 pm

Hi once again,
just watched your video - no problem to follow every step, thank you for that ! i guess the problem is my Photoshop version, which is CS5 and has not the same possibilities like yours. F.e. I can´t choose the Adobe Media Encoder nor can i set a hook to Colour Manage. What i can do, is exporting the video as a QuickTime-movie - this must be the reason !

User avatar
1uv3
Posts: 123
Joined: Thu Sep 20, 2018 10:18 pm

Re: aligned video-patch with visible edges

Post by 1uv3 » Thu Feb 21, 2019 11:48 pm

Hi,

Quicktime could definitely be the culprit. I am going to pm you.

I found that only Photoshop CC 2017 works for the live pano process. I am using Windows version. For some reason, other Photoshops wouldn't even allow me to import videos for image sequencing and are also missing the check box that enables you to import the image sequence towards the final steps.
Creative expression is the Universe's only way of experiencing every configurative atomic possibility capable within a finite Universe.

Tawrank
Posts: 6
Joined: Fri Feb 15, 2019 9:28 pm

Re: aligned video-patch with visible edges

Post by Tawrank » Wed Mar 06, 2019 7:04 pm

Hi, i´m still working on it, so other questions are coming up, during the process ... I imported a video to photoshop in the first step and got an image-file with 268 layers, which means 10 seconds plus 18 frames of film, filmed with 25 fps. When i then exported these layers as an image-sequence i got only 223 images, means 45 images are lost. This must also be the reason, why f.e. spoken text is not synchron with movement of the mouth ... Did this happen to anyone else ? Greets !

User avatar
1uv3
Posts: 123
Joined: Thu Sep 20, 2018 10:18 pm

Re: aligned video-patch with visible edges

Post by 1uv3 » Thu Mar 07, 2019 5:52 am

I would just dump CS5 and go with CC 2017. It'll prolly fix all the issues you are having. Also, may want to use PTGUI 10.0.16. Those 2 program versions seem to be the most stable for live panos.

As for this question
This must also be the reason, why f.e. spoken text is not synchron with movement of the mouth ... Did this happen to anyone else ?
I am not sure about the missing frames but I know for a fact that after I have converted the sequence images into a video file that I have to add that video file into Premiere Pro along with the audio and the audio is always shorter than the video file so I have to stretch the audio file to match the video file otherwise the audio and video are out of sync.
Creative expression is the Universe's only way of experiencing every configurative atomic possibility capable within a finite Universe.

Tawrank
Posts: 6
Joined: Fri Feb 15, 2019 9:28 pm

Re: aligned video-patch with visible edges

Post by Tawrank » Fri Mar 08, 2019 4:28 pm

hey, thanks, i will go on next week ...

Post Reply

Who is online

Users browsing this forum: No registered users and 20 guests