how to curl and proxy download

[musa]

hey,

i would like to know how this ( shimory DOT com ) works TECHNICALLY. i suppose first layer is cURL in order to grab the cookie and the downloading link (like http//srv43.fil3s0n1c.com/ef4888/dfeee/file.zip). but HOW is it possible to make the visitor download the file INSTANTLY (shimory does not even grabs the file through like wget() but deservs it immediatly to the visitor, kind of proxy, with a link like http://serv02.sh1m0ry.com/yourfiledearvisitor.zip).
i would like to know how to setup that kind of proxy/instant download.

i dont want to run same service (there so many like this nowadays) but i'm interested in this kind of bypass/workaround for a website i am already running.

is it full PHP or is there some kind of linux (mod_proxy, squid, etc) behind this?

thank you and sorry for my bad english.

looking for some code examples and/or tutorials. i can buy a good tuto up to $50

Musa,

musa Reviewed by musa on 20th Dec 2011. how to curl and proxy download hey, i would like to know how this ( shimory DOT com ) works TECHNICALLY. i suppose first layer is cURL in order to grab the cookie and the downloading link (like http//srv43.fil3s0n1c.com/ef4888/dfeee/file.zip). but HOW is it possible to make the visitor download the file INSTANTLY (shimory does not even grabs the file through like wget() but deservs it immediatly to the visitor, kind of proxy, with a link like http://serv02.sh1m0ry.com/yourfiledearvisitor.zip). i would like to know how to Rating: 5

[musa]

bump

[mRAza]

you need to check PHP: Streams.

here is how it works
1. user give link
2. make script to grab download link
3. stream that content to user.

on 2. you can save data into a file, like on that site its saving a link as (http://shimory.com/static/1234567), 1234567 is either in database or file saved on server, So when user visit that link it will call that ID, Which has file link saved, cookie information etc.

there are a lot of examples on PHP site to work with streams and one open source script for link generation i think named "Vinaleech"? I am not sure but try to search here and look at its code.

[santanu18]

This need an advance user to create the script.

You can refer my thread here:
http://www.besthostingforums.com/11-...ook-login.html

[musa]

thanks for the info mRaza, i'll take a look at these.

Santanu18 > i already consider myself an advanced php coder (+10 years of programming), and referring to your topic i don't need a script that grabs links from fast-debrid or so. i can do this by myself to be honest...
i want to make a script that connects to a remote website trough a cookie (i already coded this part), then gets the real download link (already coded this too). And then delivers the file to user INSTANTLY (i dont currently know how to make this, and that is what i will pay for).
what i am doing currently is grab the file to my dedicated server's hard disk drive via wget() then offer the file to the user a few minutes later...
i deliver the file via the x-sendfile mod and notice i already know about readfile and don't want to set up a readfile stream-octet as it consums too much ram/cpu (files i will deliver are between 100 and 300Mb).
if u can help in this then i'd be interested, drop me a pm...

sry for my bad english.

[Robin H]

The problem is you are using wget to download the file.
If you want to stream the file to your users, you have to:

1) Open the stream to the direct link.
2) Send the required headers ( such as the cookie ) | So now you're writing to the stream.
3) Read the response-headers. | Still the same stream, now you just read from it.
4) Send headers to client ( header() function )
5) Echo rest of response to the screen. | You're reading data from the stream in chunks

But note that PHP isn't the right/best language for this.

[musa]

any small exemple of this plz?

let's take filesonic as an exemple for the rest of this topic discussion.

1) and 2) Open the stream to the direct link. --> ok, opening the direct link (http://srv1337.filesonic.com/4546546...sired_file.rar) with php cURL and sending the authorized cookie.txt via CURLOPT_COOKIEFILE
3) why read the response header?
4) ok, sending headers as content-disposition attachment and force-download or stream-octet
5) this is what i don't know how to do. how to stream? how to chunks the data?

thank you.
i only know php. no perl/cgi/c etc

[Robin H]

3) - So you know what content-length to send to your client
4) Ok, + content-length
5) I've went through KWWH and it seems nobody posted this part. So I assume it's a secret.. So I keep my mouth shut. But I'll give you a place to start: http://www.php.net/manual/en/function.curl-setopt.php

[musa]

ok for the third point, grabbing the content-lenght is a good reason.

sending you a pm then, i already know much about the curl lib and the manual but dont get you about the stream...

[santanu18]

here's some example:

http://www.linksgenerator.info/rd/indexfc.php