Webread Giving different results than 'View Page Source' of website

I am using webread to extract the 'view page source' text of a youtube page using the following:

>> d = webread('https://www.youtube.com/channel/UCqqc1GmsuANsx3s3Y0C-BsQ/playlists?view=1&sort=dd&shelf_id=0')

However it returns text which is different from the view page source of that page. What am I doing wrong? I want to get the exact text as can be seen at 'view page source' of the page.

[Walter Roberson]

You are not setting up any HTTP headers. The destination is detecting that there is no browser header (or something like that) and is formatting the result for robot access:

<style name="www-roboto" >

[Milan Roy]

So, how do I resolve this?

Thanks

[Walter Roberson]

See weboptions()

In particular I suspect you will need to set UserAgent

[Milan Roy]

I did this:

opts = weboptions('UserAgent','Mozilla/5.0 (X11; Linux x86_64)');
d = webread('https://www.youtube.com/channel/UCqqc1GmsuANsx3s3Y0C-BsQ/playlists?view=1&sort=dd&shelf_id=0',opts)

However I am getting the same results.

[Walter Roberson]

Use a packet trace utility to see what headers your browser is sending, and duplicate them.

[Steven Lord]

In addition to what Walter wrote, you may be able to use the YouTube API to achieve your end goal without having to try to parse the raw HTML.