python - What method should I employ to extract keywords from a URL? -


i working on extraction of keywords. system takes url input , output supposed keywords describing contents of url. considering textual parts now. know methods can employ extracting keywords urls , how compare each other. suggestions , redirections welcome.

i think can use method

read site urllib ( http://docs.python.org/library/urllib2.html?highlight=urllib2#module-urllib2 ) , remove tags , create plane text of site

then check word used more. create top tens ( or count )


Comments

Post a Comment

Popular posts from this blog

c# - IMAP GMAIL getting folder list problem -

i working on imap , trying list of folders in gmail account. i able working yahoo mail, not gmail. here's code: byte[] commandbytes = system.text.encoding.ascii.getbytes((("$ xlist \"\" \"*\" \r\n")).tochararray()); i had tried list well, it's not working. doing wrong? you cannot have space between "*" , trailing \r\n .
Read more

PHP proxy to get XML: problem with URL arguments -

so need retrieve xml public api, app in flash , public service won't implement crossdomain.xml file. found php script online (below) proxy request url. works fine urls like: http://mysite.com/xml_proxy.php?url=http://rss.cnn.com/rss/cnn_topstories.rss but script seems either strip or ignore arguments on url, like: http://mysite.com/xml_proxy.php?url=http://publicapiserver.com?app_id=35235x&app_key=84x i'm php ignorant. there easy way have script process url arguments? much. here script: <?php $post_data = $http_raw_post_data; $header[] = "content-type: text/xml"; $header[] = "content-length: ".strlen($post_data); $ch = curl_init( $_get['url'] ); curl_setopt($ch, curlopt_returntransfer, 1); curl_setopt($ch, curlopt_timeout, 10); curl_setopt($ch, curlopt_httpheader, $header); if ( strlen($post_data)>0 ){ curl_setopt($ch, curlopt_post, 1); curl_setopt($ch, curlopt_postfields, $post_data); } $response = curl_exec($ch...
Read more