{"id":8528,"date":"2023-07-17T08:09:52","date_gmt":"2023-07-17T08:09:52","guid":{"rendered":"https:\/\/davelevy.info\/wiki\/?p=8528"},"modified":"2023-07-17T08:14:42","modified_gmt":"2023-07-17T08:14:42","slug":"python-remote-pages","status":"publish","type":"post","link":"https:\/\/davelevy.info\/wiki\/python-remote-pages\/","title":{"rendered":"Python &#038; remote pages"},"content":{"rendered":"\n<p>I did some more coding, this time to try and capture my ello feed. I have the string manipulation under control, mostly but in some cases, I wanted to look up data from another remote page. I looked at urllib and requests, but ello prohibit automated scraping; we&#8217;ll see if I solve it through <a href=\"https:\/\/davelevy.info\/wiki\/browser-scripting\/\">browser automation<\/a>. Here are some notes on <em>requests <\/em>and <em>urllib<\/em>. &#8230;<\/p>\n\n\n\n<!--more-->\n\n\n\n<h3 class=\"wp-block-heading\">Links<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Not urllib, https:\/\/pypi.org\/project\/requests\/<\/li>\n\n\n\n<li>Stackoverflow <a href=\"https:\/\/stackoverflow.com\/questions\/29048168\/login-on-a-site-using-urllib\">on urllib<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/docs.python.org\/3\/howto\/urllib2.html\">urllib <\/a>at python.org and at geeksforgeeks<\/li>\n<\/ul>\n\n\n\n<p>I also had to <a href=\"https:\/\/www.alt-codes.net\/smiley_alt_codes.php\">convert <\/a>some emoji&#8217;s to html<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I did some more coding, this time to try and capture my ello feed. I have the string manipulation under control, mostly but in some cases, I wanted to look up data from another remote page. I looked at urllib and requests, but ello prohibit automated scraping; we&#8217;ll see if I solve it through browser&#8230;<\/p>\n","protected":false},"author":1,"featured_media":8531,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":"","_share_on_mastodon":"0"},"categories":[3],"tags":[1955,45,1957,911,1956],"class_list":["post-8528","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-http","tag-python","tag-requests","tag-technology","tag-urllib"],"share_on_mastodon":{"url":"","error":""},"jetpack_featured_media_url":"https:\/\/davelevy.info\/wiki\/wp-content\/uploads\/2023\/07\/python-4creativeily-w1024.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/posts\/8528","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/comments?post=8528"}],"version-history":[{"count":2,"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/posts\/8528\/revisions"}],"predecessor-version":[{"id":8530,"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/posts\/8528\/revisions\/8530"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/media\/8531"}],"wp:attachment":[{"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/media?parent=8528"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/categories?post=8528"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/davelevy.info\/wiki\/wp-json\/wp\/v2\/tags?post=8528"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}