PHP Curl post with non-english characters

[t3od0r]

I have a small problem with php curl post.

I am trying to post some turkish characters to a forum but aren't posted how it should be.

This is how i save the text:

fwrite($fpp,"\xEF\xBB\xBF");
fwrite($fpp, $row['template']);
fclose($fpp); 

and posting:

$this->curl = curl_init();
curl_setopt ( $this->curl, CURLOPT_URL, $this->vb_url . 'newthread.php?' . $url_vars );
curl_setopt ( $this->curl, CURLOPT_POST, true );
curl_setopt ( $this->curl, CURLOPT_POSTFIELDS, $post_fields );
curl_setopt ( $this->curl, CURLOPT_RETURNTRANSFER, true );
curl_setopt ( $this->curl, CURLOPT_CONNECTTIMEOUT,20);
curl_setopt ( $this->curl, CURLOPT_TIMEOUT,10);
curl_setopt ( $this->curl, CURLOPT_HEADER, true );
curl_setopt ( $this->curl, CURLOPT_FOLLOWLOCATION, 0);
curl_setopt ( $this->curl, CURLOPT_COOKIE, $this->cookie_name );
curl_setopt ( $this->curl, CURLOPT_COOKIEJAR, $this->cookie_name );
curl_setopt ( $this->curl, CURLOPT_COOKIEFILE, $this->cookie_name );
curl_setopt ( $this->curl, CURLOPT_USERAGENT, 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1');
$result = curl_exec ( $this->curl ); 

this is how it should be:

B?l?m resimleri, dizi indirme ve altyazı linkine aşağıdan ulaşabilirsiniz.

this is how it is posted:

Bölüm resimleri, dizi indirme ve altyaz? linkine a?a??dan ula?abilirsiniz.

Thanks

t3od0r Reviewed by t3od0r on 25th Feb 2012. PHP Curl post with non-english characters I have a small problem with php curl post. I am trying to post some turkish characters to a forum but aren't posted how it should be. This is how i save the text: fwrite($fpp,"\xEF\xBB\xBF"); fwrite($fpp, $row); fclose($fpp); and posting: Rating: 5

[deliteblogger]

I'm not quite sure but maybe setting CURLOPT_ENCODING could help.

[JmZ]

ok it seems you need to get the content type to post as UTF-8.

try:

curl_setopt($this->curl, CURLOPT_HTTPHEADER , array(
     'Content-Type: application/x-www-form-urlencoded; charset=utf-8',
));

*after* setting CURLOPT_POST and CURLOPT_POSTFIELDS.

[t3od0r]

If i use that i get
"Your submission could not be processed because a security token was missing"

[Halcyon]

^^ Ding dong. You need to store the session ID and pass it as a parameter while making that request.

[t3od0r]

i already do that, but if am using the httpheader i get that error, if i don't use it the script is posting.

$url_vars = $this->array_to_http(array(
            'do'    => 'newthread',
            'f'        => $forum_id,
        ));
                
$this->curl = curl_init();
curl_setopt($this->curl,CURLOPT_URL, $this->phpbb_url . 'newthread.php?' . $url_vars );
curl_setopt($this->curl,CURLOPT_RETURNTRANSFER, true);
curl_setopt($this->curl,CURLOPT_CONNECTTIMEOUT,"10");
curl_setopt($this->curl,CURLOPT_TIMEOUT,"10");
curl_setopt($this->curl, CURLOPT_HEADER, false );
curl_setopt($this->curl,CURLOPT_COOKIEFILE,$this->cookie_name );
$p= curl_exec($this->curl);
$error=curl_error($this->curl);
curl_close($this->curl);

preg_match('%name="securitytoken" value="(.*?)" />%',$p,$security123);
// Generate post string
        $post_fields = array(
            'sbutton'                => 'Submit New Thread',
            'do'                => 'postthread',
            'message'            => $message,
            'f'                    => $forum_id,
            'securitytoken' => $security123[1],
            'subject'            => $topic_title,
            'loggedinuser'      => '1',
            'wysiwyg'            => 0,
            'prefixid'            => '',
            
        );
        $url_vars = array(
            'do'    => 'postthread',
            'f'        => $forum_id,
        );
        //printr($post_fields);
        // Init curl
        $this->curl = curl_init();
        // Set options
        curl_setopt ( $this->curl, CURLOPT_URL, $this->phpbb_url . 'newthread.php?' . $url_vars );
        curl_setopt ( $this->curl, CURLOPT_POST, true );
        curl_setopt ( $this->curl, CURLOPT_POSTFIELDS, $post_fields );
        curl_setopt ( $this->curl, CURLOPT_RETURNTRANSFER, true );
        curl_setopt ( $this->curl, CURLOPT_CONNECTTIMEOUT,20);
        curl_setopt ( $this->curl, CURLOPT_TIMEOUT,10);
        curl_setopt ( $this->curl, CURLOPT_HEADER, true );
        curl_setopt ( $this->curl, CURLOPT_FOLLOWLOCATION, 1);
        curl_setopt ( $this->curl, CURLOPT_COOKIE, $this->cookie_name );
        curl_setopt ( $this->curl, CURLOPT_COOKIEJAR, $this->cookie_name );
        curl_setopt ( $this->curl, CURLOPT_COOKIEFILE, $this->cookie_name );
        curl_setopt ( $this->curl, CURLOPT_USERAGENT, 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.1) Gecko/20061204 Firefox/2.0.0.1'); 

[ajinkya9]

curl_setopt( $ch, CURLOPT_ENCODING, "UTF-8" );

http://www.sitepoint.com/forums/show...TF8-supporting

[t3od0r]

the same
Bölüm resimleri, dizi indirme ve altyaz? linkine a?Ÿa?Ÿ?dan ula?Ÿabilirsiniz.

[mRAza]

try this

$message = iconv("UTF-8","Windows-1252//IGNORE",$message); 

are you scraping turkish characters?

[t3od0r]

The text is ok now
The only problem is that i get a notice

Notice: iconv() [function.iconv]: Detected an illegal character in input string in

but is working

i read the rext from a txt file which i save it like this

$fh = fopen($file,'wb');
fwrite($fh,"\xEF\xBB\xBF");
fwrite($fh,$ppost);
fclose($fh);