hadoop - Reading compressed (.xz) file in Apache pig -


i trying read .xz file compressed using hadoop-xz codec using pig script.

the sample code tried is,

register hadoop-xz-1.4.jar set output.compression.enabled true; set output.compression.codec io.sensesecure.hadoop.xz.xzcodec;  msg = load 'pigtest/newxz.xz' using pigstorage(); store msg 'pigtest/output' using pigstorage(); dump msg;

the result still in compressed format. doing wrong or have use xzinputstream inside pig?

the running environment hortonworks sandbox 2.2 (hue)

depends on want do.

it seems want read xz file assume need setup input codec not output one.

i'm not pig user gather cannot handle custom compression (unlike hive , streaming example).


-

Comments

Post a Comment

Popular posts from this blog

javascript - Complete OpenIDConnect auth when requesting via Ajax -

the normal openidconnect server works like: you go a.com/secure-resource you 302 server your browser handles , sends identity server you login there it sends a.com via post you logged in on a.com , a.com/secure-resource on browser. however have scenario i'm trying solve need help. the user logged in on idserver the user logged in on a.com the user not logged in on b.com we need send ajax call web server b.com (from domain a.com ) b.com configured use openidconnect. but because request b.com via ajax, user cannot redirected idserver. (all in response 302 ) we can go ahead , handle 302 via ajax (i'm still not sure whether work, security-wise). but is there scenario in identityserver/openidconnect designed these situations? with identityserver in scenario setup server b.com use bearer token authentication, need use access token provided a.com in headers of ajax call $.ajax({ url: 'http://b.com', headers: { ...
Read more

apache - PHP Soap issue while content length is larger -

we have developed soap based webservice post data third party webservice. accepts 4 params. in 1 of parameters accepts xml string no size limit restriction put in place. the webservice works fine in local environment running on php 5.2 , apache2. works content length long 10 mb. in staging server running nginx , php fpm.we have updated max post size , max upload filesize in php.ini , client_max_body param in nginx.conf allow upto 50 mb. but webservice client keeps on loading in staging environment. gives 502 timeout , gives soap error. can me understand issue here?
Read more

c# - Replace text in MailItem Body -

i've added ribbon button in outlook explorer, creates new email selected email when clicked. works fine using mailitem.copy method. need replace text in message body different value. the problem email html/richtext formatted email , contain text formatting and/or pictures. , replacing text value in body property loses text formatting , pictures. so code below no good newmailitem.body = newmailitem.body.replace("old value", "new value"); and i've tried loading html , rtf value devexpress richeditcontrol , used richeditcontrol.document.replaceall method try , replace text occurrences. devexpress richeditcontrol changes/formats rtf / html value differently , causes message wrong when html / rtf set in mailitem. i've tried replacing text getting reference word document (see code below). doesn't work either. inspector inspector = newmailitem.getinspector; if (inspector.iswordmail()) { microsoft.office.interop.word.document worddocument...
Read more