Curl php parser (advance) Imvu parser

airbender
by airbender · 5 posts
12 years ago in PHP
Posted 12 years ago · Author
right guys here is what i was able to come up with its not done 100% but thought some of you would like to see where im at
Code
<?php
    function get_date_time($timestamp = 0)
   {

    if ($timestamp)

    return date("Y-m-d H:i:s", $timestamp);

    else
    return gmdate("Y-m-d H:i:s");         
   }
   
  class IMVU
  {

    
      private $contents = null;
       public function __construct()
      {                 
          $curl = curl::getInstance();
         
          try {
             
              $curl->setopt_array(array(
                      CURLOPT_URL     => 'http://www.imvu.com/catalog/web_mypage.php?user=uruserid&preview=1',
                      CURLOPT_RETURNTRANSFER => true,
                      CURLOPT_HEADER  => false,
                      CURLOPT_USERAGENT => 'Mozilla/4.0 (compatible; MSIE 5.01; Windows NT 5.0)',
                      CURLOPT_REFERER => 'http://www.google.com/',
                      CURLOPT_TIMEOUT => '10'
              ));
             
              $this->contents = $curl->exec();
             
          } catch (Exception $e) {
              die($e->getMessage());
          }
      }


      public function scrape()
      {
          preg_match_all('/<table width="100%" border="0" cellspacing="0" cellpadding="0" id="aboutme_panel_body">/(.*?)<\/table>/si', $this->contents, $matches);
          if (count($matches[0]) == 1) {
             
              for ($i = 0; $i <= 1; $i++) {
                 
                  if (preg_match('|<b><span class="notranslate">(.*)</span></b>|U', $matches[0][$i], $nick)) {
                     
                      preg_match('/<font size="-1">Avatar since: <span class="notranslate">(.*)<\/span>/si', $matches[0][$i], $since);
                     
                      preg_match('|<i id="user_tagline"><span class="notranslate">(.*)</span>|U', $matches[0][$i], $tagline);
                     
                      preg_match_all('|<img width="160" height="220" src="(.*)"|U', $matches[0][$i], $image);
                     
                     
                      $pic   = (string)$image[1][0];   
                     
                      mysql_query("INSERT INTO `imvu` (`tagline`, `since`, `nick`)
                                   VALUES ('" . $tagline . "', '" . $since . "', '" . $nick . "')");
                     
                     
                     
                      if (!file_put_contents('imvu/pics/' . $nick . '.jpg', file_get_contents($pic))) {
                           throw new Exception('Couldn\'t write to imvu/pics directory.');
                      }
               
                  }
              }
          }
      }
  }




note make sure to edit this line
Code
CURLOPT_URL     => 'http://www.imvu.com/catalog/web_mypage.php?user=uruserid&preview=1',

replace uruserid with your user id i havent had a chance to test this yet but it should work ill be writing a way to disply it 2mor and also the db stuct for it
Posted 12 years ago · Author
Code
mysql_query("INSERT INTO `imvu` (`tagline`, `since`, `nick`)
                                   VALUES ('" . $tagline . "', '" . $since . "', '" . $nick . "')");

as you can see in the qry there its storing the tagline from your imvu profile the avatar since date and the nick im going to make it where it can pull everything off there or some suggestion for what you/anybody wants it to pull let me know had a long day at work today so will try to get the code to use it and db stuct and all up 2morz morning
Posted 12 years ago
You think you could make a script that allows you to mass download ap and ga Icons? I wrote an icon spider in vb.net that can crawl imvu and download icons in bulk but I haven't been able to figure out how to write a login with it yet so it doesn't support ap icons. Or maybe update mine to support logging in. Here's the code: viewtopic.php?f=109&t=8061


As for ideas on what to make, maybe you could write a php equivalent to this javascript code and fix it for Spring: viewtopic.php?f=103&t=8074 I didn't know enough javascript to help him.
Posted 10 years ago
I think I'll work on this one.
The trick should be to first submit a login form with AP enabled login data. As a response, the script should receive a cookie from IMVU. When crawling pages, the script can then send the cookie together with the request (manually, a PHP script won't do it automatically like a browser does by default), and access all pages that the user could see when logged in.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Sign in

Already have an account? Sign in here

SIGN IN NOW

Create an account

Sign up for a new account in our community. It's easy!

REGISTER A NEW ACCOUNT
Select a forum Protection     Help & Support     Introductions     Mafia News     IMVU News General Discussion     IMVU Lounge        IMVU Series / Roleplaying        Social Games     Mafia Market     Mafia Tools        Premium IMVU Tools        Off Topic Tools     Off Topic     Contests Creator Corner     Graphics Design        Photoshop        GIMP     Basic Creator Help     Catalog And Product Showcase     3D Meshing        3Ds Max        Sketchup        Blender Gangsters with Connections     White Hat Activities        Google Hacking        Trackers Programming Corner     Coding        Python        .Net (C#, VB, etc)        Flash        JAVA        Autoit        Batch        HTML & CSS        Javascript        PHP        Other        IMVU Homepage Codes           General           About me Panel           Messages Panel           Special Someone Panel           Visitors Panel           New Products Panel           Rankings Panel           Wishlist Panel           My Badges Panel           Outfits Panel           Url Panel           Groups Panel           Slideshow Panel           My Room Panel           Sandbox panel           Layouts     Help & Requests Free Credits     Approved Methods     Submit Methods Free Money     Approved Methods     Submit Methods Adult Corner     Get Mafia AP Here     AP Lounge        AP Social Games        Casual Dating Tips     IMVU Slave Market & Escorts