650M process, huge stack trace
From:
"Evan Phoenix" <evan@...>
Date:
2006-05-11 18:54:55 UTC
List:
ruby-core #7862
I've been banging my head against the wall trying to figure out why
sometimes processes shoot up to using as much ram as possible
(currently, the process in question is using 650 MB).
I've attached a backtrace from the process. If anyone has any ideas,
please let me know.
I've looked at the ruby heaps, and it's currently used 8 heaps for a
total about about 30M worth of RVALUEs, so I'm fairly certain thats
not where the memory is going.
Thanks,
Evan Phoenix
--
When I do good, I feel good; when I do bad, I feel bad,
and that is my religion.
-- Abraham Lincoln (1809 - 1865)
Attachments (1)
huge.txt
(27.2 KB, text/plain)
(gdb) bt
#0 0xb7f4c727 in st_foreach (table=0xff48510, func=0xb7f03d40 <mark_entry>, arg=5) at st.c:482
#1 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#2 0xb7f03d58 in mark_entry (key=16314, value=5, lev=5) at gc.c:664
#3 0xb7f4c737 in st_foreach (table=0xff07d40, func=0xb7f03d40 <mark_entry>, arg=4) at st.c:482
#4 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#5 0xb7f0413c in gc_mark_children (ptr=2, lev=3) at gc.c:939
#6 0xb7f03d58 in mark_entry (key=32194, value=5, lev=5) at gc.c:664
#7 0xb7f4c737 in st_foreach (table=0xfd15e80, func=0xb7f03d40 <mark_entry>, arg=2) at st.c:482
#8 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#9 0xb7f042b5 in gc_mark_children (ptr=1, lev=1) at gc.c:990
#10 0xb7f03d14 in mark_locations_array (x=0xff89ce0, n=24541) at gc.c:642
#11 0xb7ef845e in thread_mark (th=0xfefa250) at eval.c:10001
#12 0xb7f041a3 in gc_mark_children (ptr=2923829600, lev=2) at gc.c:958
#13 0xb7f0413c in gc_mark_children (ptr=52, lev=1) at gc.c:939
#14 0xb7f03d14 in mark_locations_array (x=0x995df250, n=25683) at gc.c:642
#15 0xb7ef845e in thread_mark (th=0x122a2da8) at eval.c:10001
#16 0xb7f041a3 in gc_mark_children (ptr=2657085820, lev=5) at gc.c:958
#17 0xb7f0413c in gc_mark_children (ptr=1, lev=4) at gc.c:939
#18 0xb7f03d58 in mark_entry (key=29338, value=5, lev=5) at gc.c:664
#19 0xb7f4c737 in st_foreach (table=0x83fac28, func=0xb7f03d40 <mark_entry>, arg=3) at st.c:482
#20 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#21 0xb7f03d58 in mark_entry (key=55994, value=5, lev=5) at gc.c:664
#22 0xb7f4c737 in st_foreach (table=0x81110b0, func=0xb7f03d40 <mark_entry>, arg=2) at st.c:482
#23 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#24 0xb7f03dea in mark_keyvalue (key=5, value=5, lev=1) at gc.c:691
#25 0xb7f4c737 in st_foreach (table=0x8af5568, func=0xb7f03dc0 <mark_keyvalue>, arg=1) at st.c:482
#26 0xb7f03e34 in mark_hash (tbl=0xb, lev=5) at gc.c:701
#27 0xb7f04153 in gc_mark_children (ptr=3064838260, lev=1) at gc.c:945
#28 0xb7f03d58 in mark_entry (key=59537, value=5, lev=5) at gc.c:664
#29 0xb7f4c737 in st_foreach (table=0x8b93f20, func=0xb7f03d40 <mark_entry>, arg=0) at st.c:482
#30 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
---Type <return> to continue, or q <return> to quit---
#31 0xb7f03db7 in rb_mark_tbl (tbl=0x5) at gc.c:681
#32 0xb7ef82bd in thread_mark (th=0x8baf928) at eval.c:9993
#33 0xb7f041a3 in gc_mark_children (ptr=3064843140, lev=2) at gc.c:958
#34 0xb7f0413c in gc_mark_children (ptr=109, lev=1) at gc.c:939
#35 0xb7f03d14 in mark_locations_array (x=0x99658250, n=25683) at gc.c:642
#36 0xb7ef845e in thread_mark (th=0x122c0f30) at eval.c:10001
#37 0xb7f041a3 in gc_mark_children (ptr=2657044620, lev=5) at gc.c:958
#38 0xb7f0413c in gc_mark_children (ptr=1, lev=4) at gc.c:939
#39 0xb7f03d58 in mark_entry (key=29338, value=5, lev=5) at gc.c:664
#40 0xb7f4c737 in st_foreach (table=0x829ce60, func=0xb7f03d40 <mark_entry>, arg=3) at st.c:482
#41 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#42 0xb7f03d58 in mark_entry (key=55994, value=5, lev=5) at gc.c:664
#43 0xb7f4c737 in st_foreach (table=0x814a370, func=0xb7f03d40 <mark_entry>, arg=2) at st.c:482
#44 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#45 0xb7f03dea in mark_keyvalue (key=5, value=5, lev=1) at gc.c:691
#46 0xb7f4c737 in st_foreach (table=0x1256c580, func=0xb7f03dc0 <mark_keyvalue>, arg=1) at st.c:482
#47 0xb7f03e34 in mark_hash (tbl=0xb, lev=5) at gc.c:701
#48 0xb7f04153 in gc_mark_children (ptr=2656812640, lev=1) at gc.c:945
#49 0xb7f03d58 in mark_entry (key=59537, value=5, lev=5) at gc.c:664
#50 0xb7f4c737 in st_foreach (table=0x1256c5c8, func=0xb7f03d40 <mark_entry>, arg=0) at st.c:482
#51 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#52 0xb7f03db7 in rb_mark_tbl (tbl=0x5) at gc.c:681
#53 0xb7ef82bd in thread_mark (th=0x12560a68) at eval.c:9993
#54 0xb7f041a3 in gc_mark_children (ptr=2656838840, lev=9) at gc.c:958
#55 0xb7f0413c in gc_mark_children (ptr=1, lev=8) at gc.c:939
#56 0xb7f03d58 in mark_entry (key=29338, value=5, lev=5) at gc.c:664
#57 0xb7f4c737 in st_foreach (table=0x847fde8, func=0xb7f03d40 <mark_entry>, arg=7) at st.c:482
#58 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#59 0xb7f03d58 in mark_entry (key=56234, value=5, lev=5) at gc.c:664
#60 0xb7f4c737 in st_foreach (table=0x847faa8, func=0xb7f03d40 <mark_entry>, arg=6) at st.c:482
#61 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
---Type <return> to continue, or q <return> to quit---
#62 0xb7f03d58 in mark_entry (key=56258, value=5, lev=5) at gc.c:664
#63 0xb7f4c737 in st_foreach (table=0x81b74e8, func=0xb7f03d40 <mark_entry>, arg=5) at st.c:482
#64 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#65 0xb7f04099 in gc_mark_children (ptr=3077123160, lev=5) at gc.c:925
#66 0xb7f04266 in gc_mark_children (ptr=3077101860, lev=4) at gc.c:980
#67 0xb7f03d58 in mark_entry (key=52577, value=5, lev=5) at gc.c:664
#68 0xb7f4c737 in st_foreach (table=0x81b7420, func=0xb7f03d40 <mark_entry>, arg=3) at st.c:482
#69 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#70 0xb7f0408a in gc_mark_children (ptr=3077123000, lev=3) at gc.c:924
#71 0xb7f04266 in gc_mark_children (ptr=3077098380, lev=2) at gc.c:980
#72 0xb7f042b5 in gc_mark_children (ptr=5, lev=1) at gc.c:990
#73 0xb7f03fe7 in rb_gc_mark (ptr=5) at gc.c:754
#74 0xb7ef4ab6 in blk_mark (data=0x8429948) at eval.c:8069
#75 0xb7f041a3 in gc_mark_children (ptr=3076116820, lev=6) at gc.c:958
#76 0xb7f03d58 in mark_entry (key=51305, value=5, lev=5) at gc.c:664
#77 0xb7f4c737 in st_foreach (table=0x84292b0, func=0xb7f03d40 <mark_entry>, arg=4) at st.c:482
#78 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#79 0xb7f0408a in gc_mark_children (ptr=3076117440, lev=4) at gc.c:924
#80 0xb7f0405d in gc_mark_children (ptr=3076117520, lev=3) at gc.c:919
#81 0xb7f03d58 in mark_entry (key=21285, value=5, lev=5) at gc.c:664
#82 0xb7f4c737 in st_foreach (table=0x81f6930, func=0xb7f03d40 <mark_entry>, arg=2) at st.c:482
#83 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#84 0xb7f04099 in gc_mark_children (ptr=3078539960, lev=2) at gc.c:925
#85 0xb7f04266 in gc_mark_children (ptr=3076087400, lev=1) at gc.c:980
#86 0xb7f03fe7 in rb_gc_mark (ptr=5) at gc.c:754
#87 0xb7ef6455 in bm_mark (data=0x81c06c8) at eval.c:8824
#88 0xb7f041a3 in gc_mark_children (ptr=3077417020, lev=6) at gc.c:958
#89 0xb7f0413c in gc_mark_children (ptr=1, lev=5) at gc.c:939
#90 0xb7f03dea in mark_keyvalue (key=5, value=5, lev=4) at gc.c:691
#91 0xb7f4c737 in st_foreach (table=0x825dfb8, func=0xb7f03dc0 <mark_keyvalue>, arg=4) at st.c:482
#92 0xb7f03e34 in mark_hash (tbl=0xb, lev=5) at gc.c:701
---Type <return> to continue, or q <return> to quit---
#93 0xb7f04153 in gc_mark_children (ptr=3077428340, lev=4) at gc.c:945
#94 0xb7f03d58 in mark_entry (key=23978, value=5, lev=5) at gc.c:664
#95 0xb7f4c737 in st_foreach (table=0x825dfa0, func=0xb7f03d40 <mark_entry>, arg=3) at st.c:482
#96 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#97 0xb7f03d58 in mark_entry (key=18842, value=5, lev=5) at gc.c:664
#98 0xb7f4c737 in st_foreach (table=0x84213d8, func=0xb7f03d40 <mark_entry>, arg=2) at st.c:482
#99 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#100 0xb7f042b5 in gc_mark_children (ptr=1, lev=1) at gc.c:990
#101 0xb7f03fe7 in rb_gc_mark (ptr=5) at gc.c:754
#102 0xb7ef4ab6 in blk_mark (data=0x8203198) at eval.c:8069
#103 0xb7f041a3 in gc_mark_children (ptr=3077419760, lev=4) at gc.c:958
#104 0xb7f0413c in gc_mark_children (ptr=1, lev=3) at gc.c:939
#105 0xb7f0413c in gc_mark_children (ptr=2, lev=2) at gc.c:939
#106 0xb7f03dea in mark_keyvalue (key=5, value=5, lev=1) at gc.c:691
#107 0xb7f4c737 in st_foreach (table=0x8135d60, func=0xb7f03dc0 <mark_keyvalue>, arg=1) at st.c:482
#108 0xb7f03e34 in mark_hash (tbl=0xb, lev=5) at gc.c:701
#109 0xb7f04153 in gc_mark_children (ptr=3077419580, lev=1) at gc.c:945
#110 0xb7f03d58 in mark_entry (key=29066, value=5, lev=5) at gc.c:664
#111 0xb7f4c737 in st_foreach (table=0x807adf0, func=0xb7f03d40 <mark_entry>, arg=0) at st.c:482
#112 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#113 0xb7f03db7 in rb_mark_tbl (tbl=0x5) at gc.c:681
#114 0xb7f5c3aa in rb_mark_generic_ivar (obj=5) at variable.c:938
#115 0xb7f0452a in gc_mark_children (ptr=3077429140, lev=1) at gc.c:775
#116 0xb7f03d58 in mark_entry (key=23946, value=5, lev=5) at gc.c:664
#117 0xb7f4c737 in st_foreach (table=0x8329620, func=0xb7f03d40 <mark_entry>, arg=0) at st.c:482
#118 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#119 0xb7f03db7 in rb_mark_tbl (tbl=0x5) at gc.c:681
#120 0xb7f5c3aa in rb_mark_generic_ivar (obj=5) at variable.c:938
#121 0xb7f0452a in gc_mark_children (ptr=3077427580, lev=3) at gc.c:775
#122 0xb7f0413c in gc_mark_children (ptr=2, lev=2) at gc.c:939
#123 0xb7f042b5 in gc_mark_children (ptr=0, lev=1) at gc.c:990
---Type <return> to continue, or q <return> to quit---
#124 0xb7f03fe7 in rb_gc_mark (ptr=5) at gc.c:754
#125 0xb7ef8269 in thread_mark (th=0x8353198) at eval.c:9987
#126 0xb7f041a3 in gc_mark_children (ptr=3077038700, lev=14) at gc.c:958
#127 0xb7f03d58 in mark_entry (key=25234, value=5, lev=5) at gc.c:664
#128 0xb7f4c737 in st_foreach (table=0x81de7f0, func=0xb7f03d40 <mark_entry>, arg=13) at st.c:482
#129 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#130 0xb7f03d58 in mark_entry (key=25154, value=5, lev=5) at gc.c:664
#131 0xb7f4c737 in st_foreach (table=0x813f6b0, func=0xb7f03d40 <mark_entry>, arg=12) at st.c:482
#132 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#133 0xb7f04099 in gc_mark_children (ptr=3080731420, lev=12) at gc.c:925
#134 0xb7f03d58 in mark_entry (key=25149, value=5, lev=5) at gc.c:664
#135 0xb7f4c737 in st_foreach (table=0x8094d00, func=0xb7f03d40 <mark_entry>, arg=11) at st.c:482
#136 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#137 0xb7f04099 in gc_mark_children (ptr=3080828120, lev=11) at gc.c:925
#138 0xb7f04266 in gc_mark_children (ptr=3080736720, lev=10) at gc.c:980
#139 0xb7f03d58 in mark_entry (key=18705, value=5, lev=5) at gc.c:664
#140 0xb7f4c737 in st_foreach (table=0x813e520, func=0xb7f03d40 <mark_entry>, arg=9) at st.c:482
#141 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#142 0xb7f0408a in gc_mark_children (ptr=3080733260, lev=9) at gc.c:924
#143 0xb7f0405d in gc_mark_children (ptr=3080733220, lev=8) at gc.c:919
#144 0xb7f0413c in gc_mark_children (ptr=2, lev=7) at gc.c:939
#145 0xb7f03d58 in mark_entry (key=24861, value=5, lev=5) at gc.c:664
#146 0xb7f4c737 in st_foreach (table=0x813eea0, func=0xb7f03d40 <mark_entry>, arg=6) at st.c:482
#147 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#148 0xb7f04099 in gc_mark_children (ptr=3080732660, lev=6) at gc.c:925
#149 0xb7f04266 in gc_mark_children (ptr=3080732000, lev=5) at gc.c:980
#150 0xb7f03d58 in mark_entry (key=23817, value=5, lev=5) at gc.c:664
#151 0xb7f4c737 in st_foreach (table=0x813edd8, func=0xb7f03d40 <mark_entry>, arg=4) at st.c:482
#152 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#153 0xb7f0408a in gc_mark_children (ptr=3080732260, lev=4) at gc.c:924
#154 0xb7f0405d in gc_mark_children (ptr=3076087280, lev=3) at gc.c:919
---Type <return> to continue, or q <return> to quit---
#155 0xb7f0405d in gc_mark_children (ptr=3077430440, lev=2) at gc.c:919
#156 0xb7f042b5 in gc_mark_children (ptr=15, lev=1) at gc.c:990
#157 0xb7f03fe7 in rb_gc_mark (ptr=5) at gc.c:754
#158 0xb7ef4ab6 in blk_mark (data=0x824f8d8) at eval.c:8069
#159 0xb7f041a3 in gc_mark_children (ptr=3077281660, lev=11) at gc.c:958
#160 0xb7f03d58 in mark_entry (key=50793, value=5, lev=5) at gc.c:664
#161 0xb7f4c737 in st_foreach (table=0x804ab18, func=0xb7f03d40 <mark_entry>, arg=9) at st.c:482
#162 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#163 0xb7f0408a in gc_mark_children (ptr=3083963700, lev=9) at gc.c:924
#164 0xb7f04266 in gc_mark_children (ptr=3083895300, lev=8) at gc.c:980
#165 0xb7f03d58 in mark_entry (key=49577, value=5, lev=5) at gc.c:664
#166 0xb7f4c737 in st_foreach (table=0x804ad88, func=0xb7f03d40 <mark_entry>, arg=7) at st.c:482
#167 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#168 0xb7f0408a in gc_mark_children (ptr=3083963660, lev=7) at gc.c:924
#169 0xb7f03d58 in mark_entry (key=2937, value=5, lev=5) at gc.c:664
#170 0xb7f4c737 in st_foreach (table=0x804b080, func=0xb7f03d40 <mark_entry>, arg=6) at st.c:482
#171 0xb7f03d94 in mark_tbl (tbl=0xb, lev=5) at gc.c:674
#172 0xb7f04099 in gc_mark_children (ptr=3083963600, lev=6) at gc.c:925
#173 0xb7f0405d in gc_mark_children (ptr=3083954220, lev=5) at gc.c:919
#174 0xb7f0405d in gc_mark_children (ptr=3083954240, lev=4) at gc.c:919
#175 0xb7f0405d in gc_mark_children (ptr=3077238340, lev=3) at gc.c:919
#176 0xb7f04266 in gc_mark_children (ptr=3077238320, lev=2) at gc.c:980
#177 0xb7f04266 in gc_mark_children (ptr=3077238440, lev=1) at gc.c:980
#178 0xb7f04e1a in rb_gc_mark_frame (frame=0x5) at gc.c:1284
#179 0xb7f04fff in garbage_collect () at gc.c:1353
#180 0xb7f05079 in rb_gc () at gc.c:1440
#181 0xb7519f25 in mysqlres2obj (res=0x5) at mysql.c:177
#182 0xb7efd51b in call_cfunc (func=0xb751b560 <query>, recv=3076183580, len=5, argc=267683088, argv=0xbfb80948) at eval.c:5612
#183 0xb7eef863 in rb_call0 (klass=3076054380, recv=3076183580, id=18273, oid=5, argc=1, argv=0xbfb80948, body=0xb758d3f8, flags=0)
at eval.c:5766
#184 0xb7ef0326 in rb_call (klass=3076054380, recv=3076183580, mid=18273, argc=1, argv=0xbfb80948, scope=0) at eval.c:6000
---Type <return> to continue, or q <return> to quit---
#185 0xb7eea999 in rb_eval (self=3076183500, n=0x5) at ruby.h:640
#186 0xb7eea2d1 in rb_eval (self=3076183500, n=0x5) at eval.c:3618
#187 0xb7eeda09 in rb_yield_0 (val=6, self=3076183500, klass=0, flags=0, avalue=0) at eval.c:4948
#188 0xb7eeb109 in rb_eval (self=3076183340, n=0x5) at eval.c:3231
#189 0xb7eea19b in rb_eval (self=3076183340, n=0x5) at eval.c:3291
#190 0xb7eefa93 in rb_call0 (klass=3080738000, recv=3076183340, id=22265, oid=5, argc=0, argv=0x0, body=0xb7a0a3e0, flags=0) at eval.c:5906
#191 0xb7ef0326 in rb_call (klass=3080738000, recv=3076183340, mid=22265, argc=0, argv=0x0, scope=0) at eval.c:6000
#192 0xb7eea999 in rb_eval (self=3076183500, n=0x5) at ruby.h:640
#193 0xb7ee9c69 in rb_eval (self=3076183500, n=0x5) at eval.c:3155
#194 0xb7eeda09 in rb_yield_0 (val=3076183580, self=3076183500, klass=0, flags=0, avalue=0) at eval.c:4948
#195 0xb7eeb109 in rb_eval (self=3076183500, n=0x5) at eval.c:3231
#196 0xb7ee9fdd in rb_eval (self=3076183500, n=0x5) at eval.c:3242
#197 0xb7eefa93 in rb_call0 (klass=3076499900, recv=3076183500, id=9857, oid=5, argc=0, argv=0xbfb86c34, body=0xb7607068, flags=4)
at eval.c:5906
#198 0xb7ef0326 in rb_call (klass=3076499900, recv=3076183500, mid=9857, argc=3, argv=0xbfb86c28, scope=1) at eval.c:6000
#199 0xb7eea999 in rb_eval (self=3076183500, n=0x5) at ruby.h:640
#200 0xb7ee9c69 in rb_eval (self=3076183500, n=0x5) at eval.c:3155
#201 0xb7eec445 in rb_eval (self=3076183500, n=0x5) at eval.c:3371
#202 0xb7ee9fdd in rb_eval (self=3076183500, n=0x5) at eval.c:3242
#203 0xb7eefa93 in rb_call0 (klass=3076407640, recv=3076183500, id=39153, oid=5, argc=0, argv=0xbfb89b70, body=0xb761558c, flags=0)
at eval.c:5906
#204 0xb7ef0326 in rb_call (klass=3076407640, recv=3076183500, mid=39153, argc=2, argv=0xbfb89b68, scope=1) at eval.c:6000
#205 0xb7eea999 in rb_eval (self=3076183500, n=0x5) at ruby.h:640
#206 0xb7eea258 in rb_eval (self=3076183500, n=0x5) at eval.c:3608
#207 0xb7eefa93 in rb_call0 (klass=3076407640, recv=3076183500, id=3721, oid=5, argc=0, argv=0xbfb8b480, body=0xb7613a0c, flags=2)
at eval.c:5906
#208 0xb7ef0326 in rb_call (klass=3076407640, recv=3076183500, mid=3721, argc=2, argv=0xbfb8b478, scope=1) at eval.c:6000
#209 0xb7eea999 in rb_eval (self=3076183500, n=0x5) at ruby.h:640
#210 0xb7eefa93 in rb_call0 (klass=3076407640, recv=3076183500, id=51369, oid=5, argc=0, argv=0xbfb8c260, body=0xb7616cd4, flags=0)
at eval.c:5906
#211 0xb7ef0326 in rb_call (klass=3076407640, recv=3076183500, mid=51369, argc=2, argv=0xbfb8c258, scope=0) at eval.c:6000
---Type <return> to continue, or q <return> to quit---
#212 0xb7eea999 in rb_eval (self=3076243780, n=0x5) at ruby.h:640
#213 0xb7eea884 in rb_eval (self=3076243780, n=0x5) at eval.c:3421
#214 0xb7ee9c69 in rb_eval (self=3076243780, n=0x5) at eval.c:3155
#215 0xb7eefa93 in rb_call0 (klass=3077123000, recv=3076243780, id=48425, oid=5, argc=0, argv=0xbfb8e66c, body=0xb76aec28, flags=0)
at eval.c:5906
#216 0xb7ef0326 in rb_call (klass=3077123000, recv=3076243780, mid=48425, argc=1, argv=0xbfb8e668, scope=1) at eval.c:6000
#217 0xb7eea999 in rb_eval (self=3076243780, n=0x5) at ruby.h:640
#218 0xb7eefa93 in rb_call0 (klass=3077123000, recv=3076243780, id=3713, oid=5, argc=0, argv=0xbfb8f478, body=0xb76af3f8, flags=0)
at eval.c:5906
#219 0xb7ef0326 in rb_call (klass=3077123000, recv=3076243780, mid=3713, argc=4, argv=0xbfb8f468, scope=0) at eval.c:6000
#220 0xb7eea999 in rb_eval (self=3077403820, n=0x5) at ruby.h:640
#221 0xb7eea258 in rb_eval (self=3077403820, n=0x5) at eval.c:3608
#222 0xb7eefa93 in rb_call0 (klass=3076854140, recv=3077403820, id=3713, oid=5, argc=0, argv=0xbfb90d84, body=0xb765464c, flags=0)
at eval.c:5906
#223 0xb7ef0326 in rb_call (klass=3076854140, recv=3077403820, mid=3713, argc=3, argv=0xbfb90d78, scope=1) at eval.c:6000
#224 0xb7eea999 in rb_eval (self=3077403820, n=0x5) at ruby.h:640
#225 0xb7eea884 in rb_eval (self=3077403820, n=0x5) at eval.c:3421
#226 0xb7eefa93 in rb_call0 (klass=3076854140, recv=3077403820, id=21257, oid=5, argc=0, argv=0xbfb9267c, body=0xb7653ea4, flags=0)
at eval.c:5906
#227 0xb7ef0326 in rb_call (klass=3076854140, recv=3077403820, mid=21257, argc=1, argv=0xbfb92678, scope=0) at eval.c:6000
#228 0xb7eea999 in rb_eval (self=3076187180, n=0x5) at ruby.h:640
#229 0xb7eefa93 in rb_call0 (klass=3076193620, recv=3076187180, id=45345, oid=5, argc=0, argv=0xbfb9344c, body=0xb7708804, flags=0)
at eval.c:5906
#230 0xb7ef0326 in rb_call (klass=3076193620, recv=3076187180, mid=45345, argc=1, argv=0xbfb93448, scope=0) at eval.c:6000
#231 0xb7eea999 in rb_eval (self=3077415880, n=0x5) at ruby.h:640
#232 0xb7eea258 in rb_eval (self=3077415880, n=0x5) at eval.c:3608
#233 0xb7eefa93 in rb_call0 (klass=3077554460, recv=3077415880, id=22513, oid=5, argc=0, argv=0xbfb94d4c, body=0xb770d00c, flags=0)
at eval.c:5906
#234 0xb7ef0326 in rb_call (klass=3077554460, recv=3077415880, mid=22513, argc=1, argv=0xbfb94d48, scope=0) at eval.c:6000
#235 0xb7eea999 in rb_eval (self=3076510440, n=0x5) at ruby.h:640
#236 0xb7eea2d1 in rb_eval (self=3076510440, n=0x5) at eval.c:3618
---Type <return> to continue, or q <return> to quit---
#237 0xb7eeda09 in rb_yield_0 (val=2656800640, self=3076510440, klass=0, flags=1, avalue=2) at eval.c:4948
#238 0xb7efb477 in rb_thread_yield (arg=5, th=0x856de28) at eval.c:11832
#239 0xb7efb2bc in rb_thread_start_0 (fn=0xb7efb3b0 <rb_thread_yield>, arg=0x5, th=0x856de28) at eval.c:11750
#240 0xb7efb5ad in rb_thread_initialize (thread=5, args=5) at eval.c:11909
#241 0xb7efd51b in call_cfunc (func=0xb7efb540 <rb_thread_initialize>, recv=2656800760, len=5, argc=267683088, argv=0x0) at eval.c:5612
#242 0xb7eef863 in rb_call0 (klass=3083947980, recv=2656800760, id=2961, oid=5, argc=0, argv=0x0, body=0xb7d14f68, flags=2) at eval.c:5766
#243 0xb7ef0326 in rb_call (klass=3083947980, recv=2656800760, mid=2961, argc=0, argv=0x0, scope=1) at eval.c:6000
#244 0xb7ef08ae in rb_funcall2 (recv=267683088, mid=5, argc=5, argv=0x5) at ruby.h:640
#245 0xb7ef3559 in rb_obj_call_init (obj=5, argc=5, argv=0x5) at eval.c:7479
#246 0xb7efb4f3 in rb_thread_s_new (argc=5, argv=0x5, klass=3083947980) at eval.c:11863
#247 0xb7efd536 in call_cfunc (func=0xb7efb4b0 <rb_thread_s_new>, recv=3083947980, len=5, argc=267683088, argv=0x0) at eval.c:5615
#248 0xb7eef863 in rb_call0 (klass=3083947960, recv=3083947980, id=3345, oid=5, argc=0, argv=0x0, body=0xb7d14f90, flags=0) at eval.c:5766
#249 0xb7ef0326 in rb_call (klass=3083947960, recv=3083947980, mid=3345, argc=0, argv=0x0, scope=0) at eval.c:6000
#250 0xb7eea999 in rb_eval (self=3076510440, n=0x5) at ruby.h:640
#251 0xb7ee9c69 in rb_eval (self=3076510440, n=0x5) at eval.c:3155
#252 0xb7eeda09 in rb_yield_0 (val=2656807120, self=3076510440, klass=0, flags=0, avalue=0) at eval.c:4948
#253 0xb7ef59ee in proc_invoke (proc=3077711500, args=2656807120, self=6, klass=0) at ruby.h:640
#254 0xb7ef5ae7 in proc_call (proc=5, args=5) at eval.c:8537
#255 0xb7efd51b in call_cfunc (func=0xb7ef5ac0 <proc_call>, recv=3077711500, len=5, argc=267683088, argv=0xbfb98ce8) at eval.c:5612
#256 0xb7eef863 in rb_call0 (klass=3083900280, recv=3077711500, id=5225, oid=5, argc=1, argv=0xbfb98ce8, body=0xb7d094c4, flags=0)
at eval.c:5766
#257 0xb7ef0326 in rb_call (klass=3083900280, recv=3077711500, mid=5225, argc=1, argv=0xbfb98ce8, scope=0) at eval.c:6000
#258 0xb7eea999 in rb_eval (self=3077718660, n=0x5) at ruby.h:640
#259 0xb7ee9fdd in rb_eval (self=3077718660, n=0x5) at eval.c:3242
#260 0xb7eeda09 in rb_yield_0 (val=6, self=3077718660, klass=0, flags=0, avalue=0) at eval.c:4948
#261 0xb7eee194 in rb_f_loop () at eval.c:5092
#262 0xb7efd53e in call_cfunc (func=0xb7eee150 <rb_f_loop>, recv=3077718660, len=5, argc=267683088, argv=0x0) at eval.c:5618
#263 0xb7eef863 in rb_call0 (klass=3083963560, recv=3077718660, id=3937, oid=5, argc=0, argv=0x0, body=0xb7d1713c, flags=2) at eval.c:5766
#264 0xb7ef0326 in rb_call (klass=3083963560, recv=3077718660, mid=3937, argc=0, argv=0x0, scope=1) at eval.c:6000
#265 0xb7eea999 in rb_eval (self=3077718660, n=0x5) at ruby.h:640
#266 0xb7ee9c69 in rb_eval (self=3077718660, n=0x5) at eval.c:3155
---Type <return> to continue, or q <return> to quit---
#267 0xb7eefa93 in rb_call0 (klass=3078542280, recv=3077718660, id=31593, oid=5, argc=0, argv=0xbfb9c19c, body=0xb79f84d8, flags=2)
at eval.c:5906
#268 0xb7ef0326 in rb_call (klass=3078542280, recv=3077718660, mid=31593, argc=1, argv=0xbfb9c198, scope=1) at eval.c:6000
#269 0xb7eea999 in rb_eval (self=3077718660, n=0x5) at ruby.h:640
#270 0xb7eeda09 in rb_yield_0 (val=3077718660, self=3077718660, klass=0, flags=1, avalue=2) at eval.c:4948
#271 0xb7efb477 in rb_thread_yield (arg=5, th=0x84caf38) at eval.c:11832
#272 0xb7efb2bc in rb_thread_start_0 (fn=0xb7efb3b0 <rb_thread_yield>, arg=0x5, th=0x84caf38) at eval.c:11750
#273 0xb7efb5ad in rb_thread_initialize (thread=5, args=5) at eval.c:11909
#274 0xb7efd51b in call_cfunc (func=0xb7efb540 <rb_thread_initialize>, recv=3077715100, len=5, argc=267683088, argv=0xbfb9d818)
at eval.c:5612
#275 0xb7eef863 in rb_call0 (klass=3083947980, recv=3077715100, id=2961, oid=5, argc=1, argv=0xbfb9d818, body=0xb7d14f68, flags=2)
at eval.c:5766
#276 0xb7ef0326 in rb_call (klass=3083947980, recv=3077715100, mid=2961, argc=1, argv=0xbfb9d818, scope=1) at eval.c:6000
#277 0xb7ef08ae in rb_funcall2 (recv=267683088, mid=5, argc=5, argv=0x5) at ruby.h:640
#278 0xb7ef3559 in rb_obj_call_init (obj=5, argc=5, argv=0x5) at eval.c:7479
#279 0xb7efb4f3 in rb_thread_s_new (argc=5, argv=0x5, klass=3083947980) at eval.c:11863
#280 0xb7efd536 in call_cfunc (func=0xb7efb4b0 <rb_thread_s_new>, recv=3083947980, len=5, argc=267683088, argv=0xbfb9d818) at eval.c:5615
#281 0xb7eef863 in rb_call0 (klass=3083947960, recv=3083947980, id=3345, oid=5, argc=1, argv=0xbfb9d818, body=0xb7d14f90, flags=0)
at eval.c:5766
#282 0xb7ef0326 in rb_call (klass=3083947960, recv=3083947980, mid=3345, argc=1, argv=0xbfb9d818, scope=0) at eval.c:6000
#283 0xb7eea999 in rb_eval (self=3077718660, n=0x5) at ruby.h:640
#284 0xb7ee9c69 in rb_eval (self=3077718660, n=0x5) at eval.c:3155
#285 0xb7eea32a in rb_eval (self=3077718660, n=0x5) at eval.c:3628
#286 0xb7eefa93 in rb_call0 (klass=3078542280, recv=3077718660, id=2961, oid=5, argc=0, argv=0xbfb9ffac, body=0xb79fa968, flags=2)
at eval.c:5906
#287 0xb7ef0326 in rb_call (klass=3078542280, recv=3077718660, mid=2961, argc=1, argv=0xbfb9ffa8, scope=1) at eval.c:6000
#288 0xb7ef08ae in rb_funcall2 (recv=267683088, mid=5, argc=5, argv=0x5) at ruby.h:640
#289 0xb7ef3559 in rb_obj_call_init (obj=5, argc=5, argv=0x5) at eval.c:7479
#290 0xb7f1dfca in rb_class_new_instance (argc=5, argv=0x5, klass=5) at object.c:1567
#291 0xb7efd536 in call_cfunc (func=0xb7f1df90 <rb_class_new_instance>, recv=3078542280, len=5, argc=267683088, argv=0xbfb9ffa8)
at eval.c:5615
---Type <return> to continue, or q <return> to quit---
#292 0xb7eef863 in rb_call0 (klass=3083963660, recv=3078542280, id=3345, oid=5, argc=1, argv=0xbfb9ffa8, body=0xb7d17b28, flags=0)
at eval.c:5766
#293 0xb7ef0326 in rb_call (klass=3083963660, recv=3078542280, mid=3345, argc=1, argv=0xbfb9ffa8, scope=0) at eval.c:6000
#294 0xb7eea999 in rb_eval (self=3076510440, n=0x5) at ruby.h:640
#295 0xb7ee9c69 in rb_eval (self=3076510440, n=0x5) at eval.c:3155
#296 0xb7eea32a in rb_eval (self=3076510440, n=0x5) at eval.c:3628
#297 0xb7eefa93 in rb_call0 (klass=3078868880, recv=3076510440, id=5121, oid=5, argc=0, argv=0x0, body=0xb78727e4, flags=0) at eval.c:5906
#298 0xb7ef0326 in rb_call (klass=3078868880, recv=3076510440, mid=5121, argc=0, argv=0x0, scope=2) at eval.c:6000
#299 0xb7eea999 in rb_eval (self=3076510440, n=0x5) at ruby.h:640
#300 0xb7eefa93 in rb_call0 (klass=3078868880, recv=3076510440, id=2961, oid=5, argc=0, argv=0xbfba353c, body=0xb7a29c18, flags=2)
at eval.c:5906
#301 0xb7ef0326 in rb_call (klass=3078868880, recv=3076510440, mid=2961, argc=1, argv=0xbfba3538, scope=1) at eval.c:6000
#302 0xb7ef08ae in rb_funcall2 (recv=267683088, mid=5, argc=5, argv=0x5) at ruby.h:640
#303 0xb7ef3559 in rb_obj_call_init (obj=5, argc=5, argv=0x5) at eval.c:7479
#304 0xb7f1dfca in rb_class_new_instance (argc=5, argv=0x5, klass=5) at object.c:1567
#305 0xb7efd536 in call_cfunc (func=0xb7f1df90 <rb_class_new_instance>, recv=3078868880, len=5, argc=267683088, argv=0xbfba3538)
at eval.c:5615
#306 0xb7eef863 in rb_call0 (klass=3083963660, recv=3078868880, id=3345, oid=5, argc=1, argv=0xbfba3538, body=0xb7d17b28, flags=0)
at eval.c:5766
#307 0xb7ef0326 in rb_call (klass=3083963660, recv=3078868880, mid=3345, argc=1, argv=0xbfba3538, scope=0) at eval.c:6000
#308 0xb7eea999 in rb_eval (self=3077430440, n=0x5) at ruby.h:640
#309 0xb7eea32a in rb_eval (self=3077430440, n=0x5) at eval.c:3628
#310 0xb7eefa93 in rb_call0 (klass=3076087280, recv=3077430440, id=11857, oid=5, argc=0, argv=0x0, body=0xb7ab8418, flags=0) at eval.c:5906
#311 0xb7ef0326 in rb_call (klass=3076087280, recv=3077430440, mid=11857, argc=0, argv=0x0, scope=0) at eval.c:6000
#312 0xb7eea999 in rb_eval (self=3083958780, n=0x5) at ruby.h:640
#313 0xb7ee8e5b in rb_eval (self=3083958780, n=0x5) at eval.c:2897
#314 0xb7ee9fdd in rb_eval (self=3083958780, n=0x5) at eval.c:3242
#315 0xb7ef13ee in eval (self=3083958780, src=5, scope=3083895280, file=0x8083220 "bin/sald.rb", line=1) at eval.c:6394
#316 0xb7ef15f8 in rb_f_eval (argc=4, argv=0x5, self=3083963700) at eval.c:6511
#317 0xb7efd536 in call_cfunc (func=0xb7ef14f0 <rb_f_eval>, recv=3083963700, len=5, argc=267683088, argv=0xbfba7598) at eval.c:5615
#318 0xb7eef863 in rb_call0 (klass=3083963560, recv=3083963700, id=3913, oid=5, argc=4, argv=0xbfba7598, body=0xb7d1727c, flags=2)
---Type <return> to continue, or q <return> to quit---
at eval.c:5766
#319 0xb7ef0326 in rb_call (klass=3083963560, recv=3083963700, mid=3913, argc=4, argv=0xbfba7598, scope=1) at eval.c:6000
#320 0xb7ef06bc in vafuncall (recv=3083963700, mid=5, n=4, ar=0xbfba75d4) at ruby.h:640
#321 0xb7ef073c in rb_funcall (recv=5, mid=5, n=5) at eval.c:6094
#322 0x08048ac1 in ?? ()
#323 0xb7d18d34 in ?? ()
#324 0x00000f49 in ?? ()
#325 0x00000004 in ?? ()
#326 0xb7d051a8 in ?? ()
#327 0xb7d081f0 in ?? ()
#328 0xb7d051bc in ?? ()
#329 0x00000003 in ?? ()
#330 0x00000000 in ?? ()
#331 0x00000000 in ?? ()
#332 0x0804a008 in ?? ()
#333 0xb7fa8d00 in _dl_starting_up () from /lib/ld-linux.so