From: Adam Akhtar <adamtemporary@...>
Date: 2009-04-15T22:19:39+09:00
Subject: reformatting a text file that has some binary in it

I have never worked with binary before and after trying to solve this
problem for 3 hours im turning to the community for help

i have a text file which has entries comprised of a key written in
binary and its values written in strings (you can see an exerpt below).

I need to parse the binary and transform it into human readable hex and
parse its associated info. My reg exps dont seem to be behaving and im
wondering if its me or if its this binary text that is causing mischief
somehow. Heres a sample item

20: 琮祺ｱ・・ｷ・G聊まd8:completei7e10:downloadedi2046e10:incompletei1ee


binary parts are always enclosed between "20:" and "d8:complete" where
the 8 can be any integer(s) e.g. 5 or 23.

str = File.open('textfile.txt' , 'r').readlines.join
str.gsub!(/(20:)(.*?)(d\d+:)/m) do |x|
$1 + $2.unpack('H*').join + $3
end

The above works for some but not all of the text. It seeems to go beyond
the "d8:complete" marker

Heres a bigger sample set if needs be. Any tips or pointers would be
greatly appreciated.


d8:completei2e10:downloadedi770e10:incompletei1ee20:
琮祺ｱ・・ｷ・G聊まd8:completei7e10:downloadedi2046e10:incompletei1ee20:
6皀ﾈ・ 涇jｭ・w・d8:completei0e10:downloadedi72602e10:incompletei1ee20:
}tｪｽh>･ﾓ送榎ﾗd8:completei3e10:downloadedi7718e10:incompletei2ee20: 架C
ﾋｳJ<ｨFﾗ0ﾉ犒Wd8:completei2e10:downloadedi617e10:incompletei0ee20:
incﾉ・U]~鼡鐐僘< d8:completei3e10:downloadedi533e10:incompletei0ee20:
ｩ<Z迚<0ｹ_!Y/ﾞ3d8:completei1e10:downloadedi281e10:incompletei0ee20:
6ﾕi叉・煤ｯ・ｵGd8:completei0e10:downloadedi216e10:incompletei1ee20:
Iﾈl談ｫｦ7Z&ﾚ・Kﾞ建ﾉEd8:completei4e10:downloadedi262e10:incompletei3ee20:
Smﾅｿﾎ怯ｿﾋｨh7r・醋d8:completei3e10:downloadedi787e10:incompletei0ee20:
Yjｽｩﾎd ﾋ  ﾖ]豆ud8:completei0e10:downloadedi154e10:incompletei1ee20:
bj・]VF・w仭鱧卍ﾉd8:completei10e10:downloadedi505e10:incompletei16ee20:
h・ﾍ棏\MDa3ﾍｺd8:completei2e10:downloadedi1050e10:incompletei2ee20:
hﾍ・ﾔ=ｩｿ敏陏｢巌d8:completei1e10:downloadedi57e10:incompletei2ee20:
mb‘<GSｷbｵｩqT・?d8:completei1e10:downloadedi3860e10:incompletei1ee20:
u≡axBﾆz<縊3d8:completei3e10:downloadedi700e10:incompletei7ee20:
u[約・ﾑ泱@2 ｳ4ｧﾄd8:completei0e10:downloadedi658e10:incompletei3ee20:
・・a・$ﾝ#・3!COd8:completei3e10:downloadedi304e10:incompletei0ee20:
槍・Gﾓ_廰偶Z､7}d8:completei3e10:downloadedi2285e10:incompletei2ee20:
入ｻ・｢ﾎGaｦ`qvBd8:completei6e10:downloadedi1061e10:incompletei5ee20:
牟ｴ?eｩｹｿ母・ｩﾄj・d8:completei3e10:downloadedi2902e10:incompletei1ee20:
ｾｵｯ・Mｴ_L宋ﾅ・ｰﾐld8:completei1e10:downloadedi147e10:incompletei1ee20:
ｨﾚY#億Uﾎ "ｰF絖bﾇawd8:completei6e10:downloadedi39010e10:incompletei2ee20:
ｩ・ｫﾋ2､1・tｽ稘8:completei7e10:downloadedi1835e10:incompletei0ee20:
ｮ3・・Lｻ  ｴ)ｻﾓ.G單8:completei2e10:downloadedi474e10:incompletei0ee20:
ｴ)PO霙
ｵｸｦ&・%L狎苧d8:completei4e10:downloadedi3674e10:incompletei0ee20:
ﾁﾞｭﾍE\GT瞹ﾟ・翡ｪｲｮd8:completei2e10:downloadedi328e10:incompletei0ee20:
ﾄ裔・(・隋K砡ｾﾈﾊｨﾂd8:completei43e10:downloadedi9665e10:incompletei31ee20:
ﾅ・篠ﾚ殱  0h・qgd8:completei3e10:downloadedi17686e10:incompletei0ee20:
ﾇBｺ嶂g・ｪ・・-/T・d8:completei5e10:downloadedi801e10:incompletei2ee20:
ﾍﾍ・4ﾔI・{-u)ﾏｱ・bd8:completei3e10:downloadedi4878e10:incompletei2ee20:
ﾑﾅﾈﾅ&､Obｼﾋ$・d8:completei4e10:downloadedi1499e10:incompletei0ee20:
ﾒ@i掃ｩt・aKﾘf箚.ﾆﾜd8:completei7e10:downloadedi1745e10:incompletei3ee20:
ﾗﾈ<ｼｴﾏ・B・i｣\,ｪEd8:completei0e10:downloadedi745e10:incompletei1ee20:
・橡態P暦Zｷﾔｴ吹2ﾈd8:completei1e10:downloadedi11865e10:incompletei7ee20:
・｡B<ﾃｹﾃﾜﾈﾟ
D
=ｲ・ｵ霙7舊d8:completei2e10:downloadedi9246e10:incompletei2ee20:
G[fJ・Y*d8:completei15e10:downloadedi3649e10:incompletei11ee20:・/XrﾚﾙJ
・XA
宀・d8:completei3e10:downloadedi323e10:incompletei0ee20:刕ｮ・ﾈｯｱ|
jetei4e10:downloadedi12601e10:incompletei0ee20:aｿ・ﾘ制ﾕ\ﾟ?@｡㌧8:completei3e10:downloadedi1005e10:incompletei0ee20:ctｵ@訣+@・
ﾂｧe5lﾏd8:completei0e10:downloadedi166e10:incompletei2ee20:cｶGlusｴBn､・]糾ｨ顕d8:completei1e10:downloadedi110e10:incompletei0ee20:j+s｢x｣・iｼ4!mG~d8:completei5e10:downloadedi6427e10:incompletei0ee20:|1S・Mﾅi贐ﾉ・
断/~d8:completei5e10:downloadedi865e10:incompletei2ee20:}lｶｧ/・2k+ｷB・冝8:completei4e10:downloadedi1032e10:incompletei0ee20:恵ｼｾu碣Pﾕ・kn冝8:completei1e10:downloadedi95e10:incompletei1ee20:孤ﾇgHﾏ・ｰπ｢Kﾍ6綜dd8:completei6e10:downloadedi14810e10:incompletei3ee20:袋ﾟkﾞｲLp・ﾑTｫ%8:completei3e10:downloadedi430e10:incompletei1ee20:愈W
ｭｳL罇瞭ｯ|ﾔ・8$d8:completei0e10:downloadedi69e10:incompletei1ee20:・ﾘb"mｨｳ釤・ｳｹ
8:completei8e10:downloadedi9526e10:incompletei0ee20:ｭﾚｷ4|ｺｪ聊・屮
lﾋEad8:completei15e10:downloadedi1775e10:incompletei9ee20:ｲﾔAﾌq敢kF毅{D・ﾍ
d8:completei5e10:downloadedi4154e10:incompletei1ee20:ｳ03・ｩ8e10:incompletei0ee20:ｩ
漸穆ﾔ+￤ﾉh・!d8:completei3e10:downloadedi2874e10:incompletei1ee20:ｩﾟl
,8H皺ﾈ溝椿kｬ{鹽8:completei55e10:downloadedi10735e10:incompletei82ee20:ｫﾎ~pﾍ・(Q㎞8?uL^4d8:completei2e10:downloadedi140e10:incompletei0ee20:ｯｨ症｢慙｡U､f・8:completei0e10:downloadedi368e10:incompletei3ee20:ｵﾎE・d1ｶｽ・qQBWd8:completei6e10:downloadedi7221e10:incompletei9ee20:ｻｺﾖ,ﾒtQ_ﾜﾏ`ﾃ(ﾊd8:completei3e10:downloadedi1536e10:incompletei21ee20:ﾋS・ﾁel%~ｼｭ,yﾛbd8:completei1e10:downloadedi111e10:incompletei1ee20:ﾎBd
・ｹ|e]･"､vTd8:completei2e10:downloadedi1096e10:incompletei1ee20:ﾕ・ｾ・$d8:completei1e10:downloadedi701e10:incompletei0ee20:ﾜzﾝｨ/ﾓ@g.3嗇=・ﾟd8:completei0e10:downloadedi512e10:incompletei1ee20:ﾞ鏝呷i15e10:downloadedi2161e10:incompletei8ee20:~虜Bｦ|ﾞﾌ0篷`hd8:completei0e10:downloadedi86e10:incompletei1ee20:話・!ﾛ\隆?・€ﾁｰrd8:completei1e10:downloadedi36732e10:incompletei0ee20:俑>(・l州=塘€・鶚租8:completei5e10:downloadedi8917e10:incompletei1ee20:・ｻJﾎ磨g讐F2頓@kd8:completei7e10:downloadedi1644e10:incompletei22ee20:､"&cB:TRﾚ}ta禰ｼ0+彭8:completei3e10:downloadedi418e10:incompletei0ee20:ｹ・村€ﾇ$NｫcｯP眷{ｽd8:completei8e10:downloadedi10297e10:incompletei10ee20:ﾅ斈>T・ｩ
ﾃﾝﾉ>ﾑ播8:completei0e10:downloadedi323e10:incompletei1ee20:ﾆ誨vｽ.s鍬■ｪe1+|<ｼGd8:completei0e10:downloadedi1412e10:incompletei1ee20:ﾑｬ煮肄n､c
・ｫ_蠻d8:completei2e10:downloadedi477e10:incompletei3ee20:禳""ｻRｵ紆・・@d8:completei0e10:downloadedi175e10:incompletei4ee20:・u倒擁Zﾐ8w擡>{ｦ嚇8:completei1e10:downloadedi5929e10:incompletei0ee20:隕ｯi7MY・v€Yd8:completei1e10:downloadedi212e10:incompletei1ee20:ﾙｷf苺・QfC渋+ﾛｮd8:completei1e10:downloadedi159e10:incompletei2ee20:・ｨ7ｩ・胙ﾞﾄﾎｧ竫

can anyone help
-- 
Posted via http://www.ruby-forum.com/.