2012-10-11 13:43:42.059623 7f4414285780 0 ceph version 0.52 (commit:e48859474c4944d4ff201ddc9f5fd400e8898173), process ceph-osd, pid 338 2012-10-11 13:43:42.074612 7f4414285780 0 filestore(/data/osd.0) mount FIEMAP ioctl is NOT supported 2012-10-11 13:43:42.074632 7f4414285780 0 filestore(/data/osd.0) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option 2012-10-11 13:43:42.074856 7f4414285780 0 filestore(/data/osd.0) mount did NOT detect btrfs 2012-10-11 13:43:42.078440 7f4414285780 0 filestore(/data/osd.0) mount syncfs(2) syscall fully supported (by glibc and kernel) 2012-10-11 13:43:42.078607 7f4414285780 0 filestore(/data/osd.0) mount found snaps <> 2012-10-11 13:43:42.083826 7f4414285780 0 filestore(/data/osd.0) mount: enabling WRITEAHEAD journal mode: btrfs not detected 2012-10-11 13:43:42.084270 7f4414285780 1 journal _open /data/osd.0/journal fd 20: 1048576000 bytes, block size 131072 bytes, directio = 0, aio = 0 2012-10-11 13:43:42.084647 7f4414285780 1 journal _open /data/osd.0/journal fd 20: 1048576000 bytes, block size 131072 bytes, directio = 0, aio = 0 2012-10-11 13:43:42.085213 7f4414285780 1 journal close /data/osd.0/journal 2012-10-11 13:43:42.093305 7f4414285780 0 filestore(/data/osd.0) mount FIEMAP ioctl is NOT supported 2012-10-11 13:43:42.093320 7f4414285780 0 filestore(/data/osd.0) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option 2012-10-11 13:43:42.093467 7f4414285780 0 filestore(/data/osd.0) mount did NOT detect btrfs 2012-10-11 13:43:42.096317 7f4414285780 0 filestore(/data/osd.0) mount syncfs(2) syscall fully supported (by glibc and kernel) 2012-10-11 13:43:42.096426 7f4414285780 0 filestore(/data/osd.0) mount found snaps <> 2012-10-11 13:43:42.100054 7f4414285780 0 filestore(/data/osd.0) mount: enabling WRITEAHEAD journal mode: btrfs not detected 2012-10-11 13:43:42.100268 7f4414285780 1 journal _open /data/osd.0/journal fd 29: 1048576000 bytes, block size 131072 bytes, directio = 0, aio = 0 2012-10-11 13:43:42.100488 7f4414285780 1 journal _open /data/osd.0/journal fd 29: 1048576000 bytes, block size 131072 bytes, directio = 0, aio = 0 2012-10-11 13:43:53.681117 7f4402a29700 -1 *** Caught signal (Aborted) ** in thread 7f4402a29700 ceph version 0.52 (commit:e48859474c4944d4ff201ddc9f5fd400e8898173) 1: /usr/bin/ceph-osd() [0x71d86a] 2: (()+0xfcb0) [0x7f441372acb0] 3: (gsignal()+0x35) [0x7f4412304445] 4: (abort()+0x17b) [0x7f4412307bab] 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f4412c5469d] 6: (()+0xb5846) [0x7f4412c52846] 7: (()+0xb5873) [0x7f4412c52873] 8: (()+0xb596e) [0x7f4412c5296e] 9: (object_info_t::decode(ceph::buffer::list::iterator&)+0x5f1) [0x827ef1] 10: (object_info_t::object_info_t(ceph::buffer::list&)+0x184) [0x58ac44] 11: (ReplicatedPG::get_object_context(hobject_t const&, object_locator_t const&, bool)+0x145) [0x554fb5] 12: (ReplicatedPG::recover_object_replicas(hobject_t const&, eversion_t)+0xf0) [0x563ae0] 13: (ReplicatedPG::wait_for_degraded_object(hobject_t const&, std::tr1::shared_ptr)+0x17b) [0x564ffb] 14: (ReplicatedPG::do_op(std::tr1::shared_ptr)+0x9c0) [0x573d10] 15: (PG::do_request(std::tr1::shared_ptr)+0x140) [0x6460d0] 16: (OSD::dequeue_op(PG*)+0x2b2) [0x5ad642] 17: (ThreadPool::worker()+0x4da) [0x7b9aea] 18: (ThreadPool::WorkThread::entry()+0xd) [0x5ec7ed] 19: (()+0x7e9a) [0x7f4413722e9a] 20: (clone()+0x6d) [0x7f44123c1dbd] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -10000> 2012-10-11 13:43:50.715069 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.25 0x27a18b0)/0x27a18b0 -9999> 2012-10-11 13:43:50.715073 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9998> 2012-10-11 13:43:50.715074 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9997> 2012-10-11 13:43:50.715075 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3866 0x2f4d360 -9996> 2012-10-11 13:43:50.715077 7f4402a29700 5 journal submit_entry seq 3866 len 926 (0x2898180) -9995> 2012-10-11 13:43:50.715079 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9994> 2012-10-11 13:43:50.715080 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9993> 2012-10-11 13:43:50.715114 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.1b 0x1d71710)/0x1d71710 -9992> 2012-10-11 13:43:50.715117 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9991> 2012-10-11 13:43:50.715118 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9990> 2012-10-11 13:43:50.715119 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3867 0x2f4d240 -9989> 2012-10-11 13:43:50.715121 7f4402a29700 5 journal submit_entry seq 3867 len 926 (0x341ca20) -9988> 2012-10-11 13:43:50.715123 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9987> 2012-10-11 13:43:50.715124 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9986> 2012-10-11 13:43:50.715151 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.19 0x1d71680)/0x1d71680 -9985> 2012-10-11 13:43:50.715154 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9984> 2012-10-11 13:43:50.715155 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9983> 2012-10-11 13:43:50.715156 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3868 0x2f4d120 -9982> 2012-10-11 13:43:50.715159 7f4402a29700 5 journal submit_entry seq 3868 len 926 (0x2165210) -9981> 2012-10-11 13:43:50.715160 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9980> 2012-10-11 13:43:50.715161 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9979> 2012-10-11 13:43:50.715202 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.1a 0x27a16c0)/0x27a16c0 -9978> 2012-10-11 13:43:50.715206 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9977> 2012-10-11 13:43:50.715207 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9976> 2012-10-11 13:43:50.715208 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3869 0x2f4d000 -9975> 2012-10-11 13:43:50.715211 7f4402a29700 5 journal submit_entry seq 3869 len 926 (0x2ab5f60) -9974> 2012-10-11 13:43:50.715212 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9973> 2012-10-11 13:43:50.715214 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9972> 2012-10-11 13:43:50.715245 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.19 0x1d71770)/0x1d71770 -9971> 2012-10-11 13:43:50.715248 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9970> 2012-10-11 13:43:50.715249 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9969> 2012-10-11 13:43:50.715250 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3870 0x2f4df30 -9968> 2012-10-11 13:43:50.715253 7f4402a29700 5 journal submit_entry seq 3870 len 926 (0x2898060) -9967> 2012-10-11 13:43:50.715254 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9966> 2012-10-11 13:43:50.715255 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9965> 2012-10-11 13:43:50.715284 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.18 0x27a1720)/0x27a1720 -9964> 2012-10-11 13:43:50.715288 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9963> 2012-10-11 13:43:50.715289 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9962> 2012-10-11 13:43:50.715290 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3871 0x24b66c0 -9961> 2012-10-11 13:43:50.715292 7f4402a29700 5 journal submit_entry seq 3871 len 926 (0x341cf00) -9960> 2012-10-11 13:43:50.715294 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9959> 2012-10-11 13:43:50.715295 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9958> 2012-10-11 13:43:50.715325 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.18 0x1d717a0)/0x1d717a0 -9957> 2012-10-11 13:43:50.715328 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9956> 2012-10-11 13:43:50.715329 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9955> 2012-10-11 13:43:50.715330 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3872 0x24b6480 -9954> 2012-10-11 13:43:50.715333 7f4402a29700 5 journal submit_entry seq 3872 len 926 (0x341c9c0) -9953> 2012-10-11 13:43:50.715334 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9952> 2012-10-11 13:43:50.715335 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9951> 2012-10-11 13:43:50.715362 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.14 0x3176490)/0x3176490 -9950> 2012-10-11 13:43:50.715366 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9949> 2012-10-11 13:43:50.715367 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9948> 2012-10-11 13:43:50.715368 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3873 0x24b65a0 -9947> 2012-10-11 13:43:50.715370 7f4402a29700 5 journal submit_entry seq 3873 len 926 (0x210b690) -9946> 2012-10-11 13:43:50.715371 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9945> 2012-10-11 13:43:50.715373 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9944> 2012-10-11 13:43:50.715416 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.16 0x1d71670)/0x1d71670 -9943> 2012-10-11 13:43:50.715420 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9942> 2012-10-11 13:43:50.715421 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9941> 2012-10-11 13:43:50.715423 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3874 0x24b6b40 -9940> 2012-10-11 13:43:50.715425 7f4402a29700 5 journal submit_entry seq 3874 len 926 (0x2779d20) -9939> 2012-10-11 13:43:50.715427 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9938> 2012-10-11 13:43:50.715428 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9937> 2012-10-11 13:43:50.715456 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.17 0x27a1750)/0x27a1750 -9936> 2012-10-11 13:43:50.715459 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9935> 2012-10-11 13:43:50.715461 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9934> 2012-10-11 13:43:50.715461 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3875 0x24b6360 -9933> 2012-10-11 13:43:50.715464 7f4402a29700 5 journal submit_entry seq 3875 len 926 (0x2898270) -9932> 2012-10-11 13:43:50.715465 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9931> 2012-10-11 13:43:50.715466 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9930> 2012-10-11 13:43:50.715496 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.17 0x3176400)/0x3176400 -9929> 2012-10-11 13:43:50.715499 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9928> 2012-10-11 13:43:50.715500 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9927> 2012-10-11 13:43:50.715501 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3876 0x24b6c60 -9926> 2012-10-11 13:43:50.715504 7f4402a29700 5 journal submit_entry seq 3876 len 926 (0x341cc60) -9925> 2012-10-11 13:43:50.715505 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9924> 2012-10-11 13:43:50.715506 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9923> 2012-10-11 13:43:50.715534 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.15 0x27a17b0)/0x27a17b0 -9922> 2012-10-11 13:43:50.715537 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9921> 2012-10-11 13:43:50.715538 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9920> 2012-10-11 13:43:50.715539 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3877 0x24b6bd0 -9919> 2012-10-11 13:43:50.715542 7f4402a29700 5 journal submit_entry seq 3877 len 926 (0x341c060) -9918> 2012-10-11 13:43:50.715543 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9917> 2012-10-11 13:43:50.715544 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9916> 2012-10-11 13:43:50.715576 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.16 0x3176430)/0x3176430 -9915> 2012-10-11 13:43:50.715579 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9914> 2012-10-11 13:43:50.715580 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9913> 2012-10-11 13:43:50.715581 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3878 0x32503f0 -9912> 2012-10-11 13:43:50.715584 7f4402a29700 5 journal submit_entry seq 3878 len 926 (0x338eb40) -9911> 2012-10-11 13:43:50.715585 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9910> 2012-10-11 13:43:50.715587 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9909> 2012-10-11 13:43:50.718044 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.95 0x3176c60)/0x3176c60 -9908> 2012-10-11 13:43:50.718055 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9907> 2012-10-11 13:43:50.718057 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9906> 2012-10-11 13:43:50.718058 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3879 0x3250750 -9905> 2012-10-11 13:43:50.718063 7f4402a29700 5 journal submit_entry seq 3879 len 926 (0x2ffd0f0) -9904> 2012-10-11 13:43:50.718064 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9903> 2012-10-11 13:43:50.718066 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9902> 2012-10-11 13:43:50.718117 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.96 0x2adbf80)/0x2adbf80 -9901> 2012-10-11 13:43:50.718124 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9900> 2012-10-11 13:43:50.718125 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9899> 2012-10-11 13:43:50.718126 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3880 0x3250870 -9898> 2012-10-11 13:43:50.718129 7f4402a29700 5 journal submit_entry seq 3880 len 926 (0x2898240) -9897> 2012-10-11 13:43:50.718131 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9896> 2012-10-11 13:43:50.718133 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9895> 2012-10-11 13:43:50.718170 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.97 0x2130ff0)/0x2130ff0 -9894> 2012-10-11 13:43:50.718175 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9893> 2012-10-11 13:43:50.718177 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9892> 2012-10-11 13:43:50.718178 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3881 0x3250b40 -9891> 2012-10-11 13:43:50.718180 7f4402a29700 5 journal submit_entry seq 3881 len 926 (0x341cd50) -9890> 2012-10-11 13:43:50.718182 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9889> 2012-10-11 13:43:50.718183 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9888> 2012-10-11 13:43:50.718212 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.94 0x3176c90)/0x3176c90 -9887> 2012-10-11 13:43:50.718215 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9886> 2012-10-11 13:43:50.718216 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9885> 2012-10-11 13:43:50.718217 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3882 0x3250990 -9884> 2012-10-11 13:43:50.718220 7f4402a29700 5 journal submit_entry seq 3882 len 926 (0x341cae0) -9883> 2012-10-11 13:43:50.718222 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9882> 2012-10-11 13:43:50.718223 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9881> 2012-10-11 13:43:50.718257 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.9a epoch 8 query_epoch 8) v3 -- ?+0 0x28a5000 -9880> 2012-10-11 13:43:50.718303 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.9a 0x2130f60)/0x2130f60 -9879> 2012-10-11 13:43:50.718308 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9878> 2012-10-11 13:43:50.718309 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9877> 2012-10-11 13:43:50.718312 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3883 0x3250cf0 -9876> 2012-10-11 13:43:50.718315 7f4402a29700 5 journal submit_entry seq 3883 len 969 (0x280d960) -9875> 2012-10-11 13:43:50.718318 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9874> 2012-10-11 13:43:50.718319 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9873> 2012-10-11 13:43:50.718369 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.9f epoch 8 query_epoch 8) v3 -- ?+0 0x28a5500 -9872> 2012-10-11 13:43:50.718430 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.9f 0x24681d0)/0x24681d0 -9871> 2012-10-11 13:43:50.718456 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9870> 2012-10-11 13:43:50.718465 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9869> 2012-10-11 13:43:50.718473 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3884 0x32501b0 -9868> 2012-10-11 13:43:50.718483 7f4402a29700 5 journal submit_entry seq 3884 len 969 (0x21cfcf0) -9867> 2012-10-11 13:43:50.718491 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9866> 2012-10-11 13:43:50.718498 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9865> 2012-10-11 13:43:50.718550 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.a8 epoch 8 query_epoch 8) v3 -- ?+0 0x28a5a00 -9864> 2012-10-11 13:43:50.718635 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a8 0x2468020)/0x2468020 -9863> 2012-10-11 13:43:50.718650 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9862> 2012-10-11 13:43:50.718652 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9861> 2012-10-11 13:43:50.718654 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3885 0x3250630 -9860> 2012-10-11 13:43:50.718657 7f4402a29700 5 journal submit_entry seq 3885 len 969 (0x1dfbd50) -9859> 2012-10-11 13:43:50.718659 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9858> 2012-10-11 13:43:50.718661 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9857> 2012-10-11 13:43:50.718705 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.b2 epoch 8 query_epoch 8) v3 -- ?+0 0x296e000 -9856> 2012-10-11 13:43:50.718782 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.b2 0x2468240)/0x2468240 -9855> 2012-10-11 13:43:50.718796 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9854> 2012-10-11 13:43:50.718799 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9853> 2012-10-11 13:43:50.718800 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3886 0x2357ab0 -9852> 2012-10-11 13:43:50.718803 7f4402a29700 5 journal submit_entry seq 3886 len 969 (0x33a70f0) -9851> 2012-10-11 13:43:50.718806 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9850> 2012-10-11 13:43:50.718808 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9849> 2012-10-11 13:43:50.718837 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.b5 epoch 8 query_epoch 8) v3 -- ?+0 0x296e500 -9848> 2012-10-11 13:43:50.718916 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.b5 0x24685b0)/0x24685b0 -9847> 2012-10-11 13:43:50.718931 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9846> 2012-10-11 13:43:50.718938 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9845> 2012-10-11 13:43:50.718940 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3887 0x2357510 -9844> 2012-10-11 13:43:50.718944 7f4402a29700 5 journal submit_entry seq 3887 len 969 (0x2d196f0) -9843> 2012-10-11 13:43:50.718946 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9842> 2012-10-11 13:43:50.718947 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9841> 2012-10-11 13:43:50.718977 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.c1 epoch 8 query_epoch 8) v3 -- ?+0 0x296ea00 -9840> 2012-10-11 13:43:50.719046 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.c1 0x2468770)/0x2468770 -9839> 2012-10-11 13:43:50.719061 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9838> 2012-10-11 13:43:50.719070 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9837> 2012-10-11 13:43:50.719077 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3888 0x2357cf0 -9836> 2012-10-11 13:43:50.719086 7f4402a29700 5 journal submit_entry seq 3888 len 969 (0x3419bd0) -9835> 2012-10-11 13:43:50.719094 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9834> 2012-10-11 13:43:50.719100 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9833> 2012-10-11 13:43:50.719129 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.da epoch 8 query_epoch 8) v3 -- ?+0 0x296d000 -9832> 2012-10-11 13:43:50.719206 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.da 0x2468ac0)/0x2468ac0 -9831> 2012-10-11 13:43:50.719212 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9830> 2012-10-11 13:43:50.719214 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9829> 2012-10-11 13:43:50.719215 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3889 0x2357bd0 -9828> 2012-10-11 13:43:50.719218 7f4402a29700 5 journal submit_entry seq 3889 len 969 (0x3419de0) -9827> 2012-10-11 13:43:50.719220 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9826> 2012-10-11 13:43:50.719221 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9825> 2012-10-11 13:43:50.719250 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.db epoch 8 query_epoch 8) v3 -- ?+0 0x296d500 -9824> 2012-10-11 13:43:50.719305 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.db 0x2468a90)/0x2468a90 -9823> 2012-10-11 13:43:50.719318 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9822> 2012-10-11 13:43:50.719325 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9821> 2012-10-11 13:43:50.719332 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3890 0x23577e0 -9820> 2012-10-11 13:43:50.719341 7f4402a29700 5 journal submit_entry seq 3890 len 969 (0x33b0bd0) -9819> 2012-10-11 13:43:50.719350 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9818> 2012-10-11 13:43:50.719357 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9817> 2012-10-11 13:43:50.719391 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.9e epoch 8 query_epoch 8) v3 -- ?+0 0x296da00 -9816> 2012-10-11 13:43:50.719428 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.9e 0x2adbe00)/0x2adbe00 -9815> 2012-10-11 13:43:50.719440 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9814> 2012-10-11 13:43:50.719446 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9813> 2012-10-11 13:43:50.719454 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3891 0x2357900 -9812> 2012-10-11 13:43:50.719463 7f4402a29700 5 journal submit_entry seq 3891 len 969 (0x281f9c0) -9811> 2012-10-11 13:43:50.719471 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9810> 2012-10-11 13:43:50.719478 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9809> 2012-10-11 13:43:50.719513 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.a7 epoch 8 query_epoch 8) v3 -- ?+0 0x296c000 -9808> 2012-10-11 13:43:50.719556 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.a7 0x2e38050)/0x2e38050 -9807> 2012-10-11 13:43:50.719568 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9806> 2012-10-11 13:43:50.719576 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9805> 2012-10-11 13:43:50.719583 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3892 0x23573f0 -9804> 2012-10-11 13:43:50.719593 7f4402a29700 5 journal submit_entry seq 3892 len 1100 (0x281fd20) -9803> 2012-10-11 13:43:50.719601 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9802> 2012-10-11 13:43:50.719607 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 1100 -9801> 2012-10-11 13:43:50.719642 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.b1 epoch 8 query_epoch 8) v3 -- ?+0 0x296c500 -9800> 2012-10-11 13:43:50.719679 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.b1 0x2e38270)/0x2e38270 -9799> 2012-10-11 13:43:50.719690 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9798> 2012-10-11 13:43:50.719697 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9797> 2012-10-11 13:43:50.719704 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3893 0x23572d0 -9796> 2012-10-11 13:43:50.719714 7f4402a29700 5 journal submit_entry seq 3893 len 969 (0x2ed3ba0) -9795> 2012-10-11 13:43:50.719722 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9794> 2012-10-11 13:43:50.719729 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9793> 2012-10-11 13:43:50.719761 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.b4 epoch 8 query_epoch 8) v3 -- ?+0 0x296ca00 -9792> 2012-10-11 13:43:50.719837 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.b4 0x2e385e0)/0x2e385e0 -9791> 2012-10-11 13:43:50.719852 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9790> 2012-10-11 13:43:50.719859 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9789> 2012-10-11 13:43:50.719866 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3894 0x2357360 -9788> 2012-10-11 13:43:50.719876 7f4402a29700 5 journal submit_entry seq 3894 len 969 (0x2eb6c30) -9787> 2012-10-11 13:43:50.719884 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9786> 2012-10-11 13:43:50.719891 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9785> 2012-10-11 13:43:50.719926 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.c0 epoch 8 query_epoch 8) v3 -- ?+0 0x2bbd000 -9784> 2012-10-11 13:43:50.720002 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.c0 0x2e387a0)/0x2e387a0 -9783> 2012-10-11 13:43:50.720032 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9782> 2012-10-11 13:43:50.720040 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9781> 2012-10-11 13:43:50.720047 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3895 0x301d090 -9780> 2012-10-11 13:43:50.720057 7f4402a29700 5 journal submit_entry seq 3895 len 969 (0x314e930) -9779> 2012-10-11 13:43:50.720070 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9778> 2012-10-11 13:43:50.720076 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9777> 2012-10-11 13:43:50.720112 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.d9 epoch 8 query_epoch 8) v3 -- ?+0 0x2bbd500 -9776> 2012-10-11 13:43:50.720128 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3896 0x31c5240 -9775> 2012-10-11 13:43:50.720144 7f4402228700 5 journal submit_entry seq 3896 len 926 (0x1e86780) -9774> 2012-10-11 13:43:50.720152 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9773> 2012-10-11 13:43:50.720160 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9772> 2012-10-11 13:43:50.720174 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3897 0x2aa3630 -9771> 2012-10-11 13:43:50.720191 7f440532f700 5 journal submit_entry seq 3897 len 204 (0x2609720) -9770> 2012-10-11 13:43:50.720193 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(2.3c epoch 8 query_epoch 8) v3 -- ?+0 0x232a000 -9769> 2012-10-11 13:43:50.720200 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9768> 2012-10-11 13:43:50.720228 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9767> 2012-10-11 13:43:50.720328 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1360, time: 2012-10-11 13:43:50.720328, event: done, request: osd pg remove(epoch 7; pg0.d2; ) v1 -9771> 2012-10-11 13:43:50.720343 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.d9 0x2e38af0)/0x2e38af0 -9770> 2012-10-11 13:43:50.720424 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9769> 2012-10-11 13:43:50.720431 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9768> 2012-10-11 13:43:50.720433 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3898 0x301d510 -9767> 2012-10-11 13:43:50.720436 7f4402a29700 5 journal submit_entry seq 3898 len 969 (0x28638a0) -9766> 2012-10-11 13:43:50.720438 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9765> 2012-10-11 13:43:50.720439 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9764> 2012-10-11 13:43:50.720470 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.98 epoch 8 query_epoch 8) v3 -- ?+0 0x2bbda00 -9763> 2012-10-11 13:43:50.720410 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.3c 0x1d71c20)/0x1d71c20 -9762> 2012-10-11 13:43:50.720354 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 129666) -9761> 2012-10-11 13:43:50.720495 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9760> 2012-10-11 13:43:50.720570 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9759> 2012-10-11 13:43:50.720574 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3899 0x31c51b0 -9758> 2012-10-11 13:43:50.720579 7f4402228700 5 journal submit_entry seq 3899 len 926 (0x31a1ab0) -9757> 2012-10-11 13:43:50.720580 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9756> 2012-10-11 13:43:50.720582 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9755> 2012-10-11 13:43:50.720617 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(2.40 epoch 8 query_epoch 8) v3 -- ?+0 0x2a2fa00 -9754> 2012-10-11 13:43:50.720503 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 497 ==== pg_log(2.be epoch 7 query_epoch 7) v3 ==== 507+0+0 (3673382648 0 0) 0x311d500 con 0x2fe2280 -9753> 2012-10-11 13:43:50.720647 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1361, time: 2012-10-11 13:43:49.133942, event: header_read, request: pg_log(2.be epoch 7 query_epoch 7) v3 -9752> 2012-10-11 13:43:50.720654 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1361, time: 2012-10-11 13:43:49.133946, event: throttled, request: pg_log(2.be epoch 7 query_epoch 7) v3 -9751> 2012-10-11 13:43:50.720657 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1361, time: 2012-10-11 13:43:49.133954, event: all_read, request: pg_log(2.be epoch 7 query_epoch 7) v3 -9750> 2012-10-11 13:43:50.720664 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1361, time: 2012-10-11 13:43:50.720645, event: dispatched, request: pg_log(2.be epoch 7 query_epoch 7) v3 -9749> 2012-10-11 13:43:50.720668 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1361, time: 2012-10-11 13:43:50.720668, event: waiting_for_osdmap, request: pg_log(2.be epoch 7 query_epoch 7) v3 -9748> 2012-10-11 13:43:50.720674 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1361, time: 2012-10-11 13:43:50.720674, event: started, request: pg_log(2.be epoch 7 query_epoch 7) v3 -9747> 2012-10-11 13:43:50.720683 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1361, time: 2012-10-11 13:43:50.720683, event: done, request: pg_log(2.be epoch 7 query_epoch 7) v3 -9746> 2012-10-11 13:43:50.720690 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 129159) -9745> 2012-10-11 13:43:50.720693 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 842 ==== osd pg remove(epoch 7; pg0.de; ) v1 ==== 25+0+0 (1959874370 0 0) 0x29e6380 con 0x2fe2140 -9744> 2012-10-11 13:43:50.720700 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1362, time: 2012-10-11 13:43:48.729734, event: header_read, request: osd pg remove(epoch 7; pg0.de; ) v1 -9743> 2012-10-11 13:43:50.720704 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1362, time: 2012-10-11 13:43:48.729736, event: throttled, request: osd pg remove(epoch 7; pg0.de; ) v1 -9742> 2012-10-11 13:43:50.720708 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1362, time: 2012-10-11 13:43:48.729740, event: all_read, request: osd pg remove(epoch 7; pg0.de; ) v1 -9741> 2012-10-11 13:43:50.720711 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1362, time: 2012-10-11 13:43:50.720699, event: dispatched, request: osd pg remove(epoch 7; pg0.de; ) v1 -9740> 2012-10-11 13:43:50.720715 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1362, time: 2012-10-11 13:43:50.720715, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.de; ) v1 -9739> 2012-10-11 13:43:50.720737 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1362, time: 2012-10-11 13:43:50.720737, event: started, request: osd pg remove(epoch 7; pg0.de; ) v1 -9738> 2012-10-11 13:43:50.720749 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.de -9737> 2012-10-11 13:43:50.720818 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.98 0x2130f20)/0x2130f20 -9736> 2012-10-11 13:43:50.720951 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9735> 2012-10-11 13:43:50.720953 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9734> 2012-10-11 13:43:50.720954 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3900 0x22b9120 -9733> 2012-10-11 13:43:50.720960 7f4402a29700 5 journal submit_entry seq 3900 len 969 (0x280d8d0) -9732> 2012-10-11 13:43:50.720964 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9731> 2012-10-11 13:43:50.720966 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9730> 2012-10-11 13:43:50.720941 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.40 0x1d71e70)/0x1d71e70 -9729> 2012-10-11 13:43:50.720978 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9728> 2012-10-11 13:43:50.720987 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9727> 2012-10-11 13:43:50.720993 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3901 0x31c53f0 -9726> 2012-10-11 13:43:50.721004 7f4402228700 5 journal submit_entry seq 3901 len 926 (0x2dc3cf0) -9725> 2012-10-11 13:43:50.721029 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9724> 2012-10-11 13:43:50.721031 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9723> 2012-10-11 13:43:50.720997 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.9d epoch 8 query_epoch 8) v3 -- ?+0 0x2bbc000 -9722> 2012-10-11 13:43:50.721067 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(2.42 epoch 8 query_epoch 8) v3 -- ?+0 0x2a2f500 -9721> 2012-10-11 13:43:50.720841 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.de 0x2468a00)/0x2468a00 -9720> 2012-10-11 13:43:50.721100 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9719> 2012-10-11 13:43:50.721108 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9718> 2012-10-11 13:43:50.721116 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3902 0x22ff000 -9717> 2012-10-11 13:43:50.721125 7f440532f700 5 journal submit_entry seq 3902 len 204 (0x2609f60) -9716> 2012-10-11 13:43:50.721144 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9715> 2012-10-11 13:43:50.721170 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9714> 2012-10-11 13:43:50.721201 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1362, time: 2012-10-11 13:43:50.721200, event: done, request: osd pg remove(epoch 7; pg0.de; ) v1 -9713> 2012-10-11 13:43:50.721219 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 129134) -9712> 2012-10-11 13:43:50.721315 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.9d 0x2130d50)/0x2130d50 -9711> 2012-10-11 13:43:50.721393 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9710> 2012-10-11 13:43:50.721400 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9709> 2012-10-11 13:43:50.721402 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3903 0x22b91b0 -9708> 2012-10-11 13:43:50.721406 7f4402a29700 5 journal submit_entry seq 3903 len 969 (0x281fed0) -9707> 2012-10-11 13:43:50.721408 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9706> 2012-10-11 13:43:50.721409 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9705> 2012-10-11 13:43:50.721439 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.a6 epoch 8 query_epoch 8) v3 -- ?+0 0x2bbca00 -9704> 2012-10-11 13:43:50.721469 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.a6 0x2468130)/0x2468130 -9703> 2012-10-11 13:43:50.721473 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9702> 2012-10-11 13:43:50.721475 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9701> 2012-10-11 13:43:50.721476 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3904 0x2cda2d0 -9700> 2012-10-11 13:43:50.721479 7f4402a29700 5 journal submit_entry seq 3904 len 969 (0x281f690) -9699> 2012-10-11 13:43:50.721481 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9698> 2012-10-11 13:43:50.721482 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9697> 2012-10-11 13:43:50.721507 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.b0 epoch 8 query_epoch 8) v3 -- ?+0 0x2bbb000 -9696> 2012-10-11 13:43:50.721379 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.42 0x1d71f00)/0x1d71f00 -9695> 2012-10-11 13:43:50.721839 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9694> 2012-10-11 13:43:50.721849 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9693> 2012-10-11 13:43:50.721857 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3905 0x31c55a0 -9692> 2012-10-11 13:43:50.721867 7f4402228700 5 journal submit_entry seq 3905 len 926 (0x31a13f0) -9691> 2012-10-11 13:43:50.721870 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9690> 2012-10-11 13:43:50.721871 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9689> 2012-10-11 13:43:50.721904 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(2.48 epoch 8 query_epoch 8) v3 -- ?+0 0x2a2f000 -9688> 2012-10-11 13:43:50.721943 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.48 0x1d71e10)/0x1d71e10 -9687> 2012-10-11 13:43:50.721949 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9686> 2012-10-11 13:43:50.721950 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9685> 2012-10-11 13:43:50.721951 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3906 0x28acb40 -9684> 2012-10-11 13:43:50.721954 7f4402228700 5 journal submit_entry seq 3906 len 926 (0x20ad1b0) -9683> 2012-10-11 13:43:50.721956 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9682> 2012-10-11 13:43:50.721957 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9681> 2012-10-11 13:43:50.721984 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(2.4d epoch 8 query_epoch 8) v3 -- ?+0 0x2656a00 -9680> 2012-10-11 13:43:50.721259 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 498 ==== pg_log(2.c4 epoch 7 query_epoch 7) v3 ==== 507+0+0 (1946056591 0 0) 0x311d000 con 0x2fe2280 -9679> 2012-10-11 13:43:50.722012 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1363, time: 2012-10-11 13:43:49.133957, event: header_read, request: pg_log(2.c4 epoch 7 query_epoch 7) v3 -9678> 2012-10-11 13:43:50.722021 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1363, time: 2012-10-11 13:43:49.133960, event: throttled, request: pg_log(2.c4 epoch 7 query_epoch 7) v3 -9677> 2012-10-11 13:43:50.722025 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1363, time: 2012-10-11 13:43:49.133970, event: all_read, request: pg_log(2.c4 epoch 7 query_epoch 7) v3 -9676> 2012-10-11 13:43:50.722029 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1363, time: 2012-10-11 13:43:50.722010, event: dispatched, request: pg_log(2.c4 epoch 7 query_epoch 7) v3 -9675> 2012-10-11 13:43:50.722034 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1363, time: 2012-10-11 13:43:50.722034, event: waiting_for_osdmap, request: pg_log(2.c4 epoch 7 query_epoch 7) v3 -9674> 2012-10-11 13:43:50.722041 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1363, time: 2012-10-11 13:43:50.722041, event: started, request: pg_log(2.c4 epoch 7 query_epoch 7) v3 -9673> 2012-10-11 13:43:50.722051 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1363, time: 2012-10-11 13:43:50.722051, event: done, request: pg_log(2.c4 epoch 7 query_epoch 7) v3 -9672> 2012-10-11 13:43:50.722059 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 128627) -9671> 2012-10-11 13:43:50.722063 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 843 ==== osd pg remove(epoch 7; pg0.df; ) v1 ==== 25+0+0 (1038955109 0 0) 0x29e61c0 con 0x2fe2140 -9670> 2012-10-11 13:43:50.722072 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1364, time: 2012-10-11 13:43:48.729743, event: header_read, request: osd pg remove(epoch 7; pg0.df; ) v1 -9669> 2012-10-11 13:43:50.722077 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1364, time: 2012-10-11 13:43:48.729745, event: throttled, request: osd pg remove(epoch 7; pg0.df; ) v1 -9668> 2012-10-11 13:43:50.722081 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1364, time: 2012-10-11 13:43:48.729748, event: all_read, request: osd pg remove(epoch 7; pg0.df; ) v1 -9667> 2012-10-11 13:43:50.722086 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1364, time: 2012-10-11 13:43:50.722071, event: dispatched, request: osd pg remove(epoch 7; pg0.df; ) v1 -9666> 2012-10-11 13:43:50.722090 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1364, time: 2012-10-11 13:43:50.722090, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.df; ) v1 -9665> 2012-10-11 13:43:50.722096 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1364, time: 2012-10-11 13:43:50.722096, event: started, request: osd pg remove(epoch 7; pg0.df; ) v1 -9664> 2012-10-11 13:43:50.722100 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.df -9663> 2012-10-11 13:43:50.722116 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.df 0x2468dd0)/0x2468dd0 -9662> 2012-10-11 13:43:50.722120 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9661> 2012-10-11 13:43:50.722121 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9660> 2012-10-11 13:43:50.722122 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3907 0x2aa3ab0 -9659> 2012-10-11 13:43:50.722126 7f440532f700 5 journal submit_entry seq 3907 len 204 (0x26c1510) -9658> 2012-10-11 13:43:50.722128 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9657> 2012-10-11 13:43:50.722130 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9656> 2012-10-11 13:43:50.722147 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1364, time: 2012-10-11 13:43:50.722146, event: done, request: osd pg remove(epoch 7; pg0.df; ) v1 -9655> 2012-10-11 13:43:50.722156 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 128602) -9654> 2012-10-11 13:43:50.722160 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 499 ==== pg_log(2.cd epoch 7 query_epoch 7) v3 ==== 507+0+0 (310047999 0 0) 0x23cba00 con 0x2fe2280 -9653> 2012-10-11 13:43:50.722170 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1365, time: 2012-10-11 13:43:49.138035, event: header_read, request: pg_log(2.cd epoch 7 query_epoch 7) v3 -9652> 2012-10-11 13:43:50.722175 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1365, time: 2012-10-11 13:43:49.138046, event: throttled, request: pg_log(2.cd epoch 7 query_epoch 7) v3 -9651> 2012-10-11 13:43:50.722179 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1365, time: 2012-10-11 13:43:49.138062, event: all_read, request: pg_log(2.cd epoch 7 query_epoch 7) v3 -9650> 2012-10-11 13:43:50.722184 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1365, time: 2012-10-11 13:43:50.722169, event: dispatched, request: pg_log(2.cd epoch 7 query_epoch 7) v3 -9649> 2012-10-11 13:43:50.722188 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1365, time: 2012-10-11 13:43:50.722188, event: waiting_for_osdmap, request: pg_log(2.cd epoch 7 query_epoch 7) v3 -9648> 2012-10-11 13:43:50.722195 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1365, time: 2012-10-11 13:43:50.722195, event: started, request: pg_log(2.cd epoch 7 query_epoch 7) v3 -9647> 2012-10-11 13:43:50.722204 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1365, time: 2012-10-11 13:43:50.722203, event: done, request: pg_log(2.cd epoch 7 query_epoch 7) v3 -9646> 2012-10-11 13:43:50.722210 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 128095) -9645> 2012-10-11 13:43:50.722212 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 844 ==== osd pg remove(epoch 7; pg0.e0; ) v1 ==== 25+0+0 (217669526 0 0) 0x29e6000 con 0x2fe2140 -9644> 2012-10-11 13:43:50.722220 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1366, time: 2012-10-11 13:43:48.729751, event: header_read, request: osd pg remove(epoch 7; pg0.e0; ) v1 -9643> 2012-10-11 13:43:50.722228 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1366, time: 2012-10-11 13:43:48.729753, event: throttled, request: osd pg remove(epoch 7; pg0.e0; ) v1 -9642> 2012-10-11 13:43:50.722232 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1366, time: 2012-10-11 13:43:48.729756, event: all_read, request: osd pg remove(epoch 7; pg0.e0; ) v1 -9721> 2012-10-11 13:43:50.722236 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1366, time: 2012-10-11 13:43:50.722220, event: dispatched, request: osd pg remove(epoch 7; pg0.e0; ) v1 -9720> 2012-10-11 13:43:50.722240 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1366, time: 2012-10-11 13:43:50.722240, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.e0; ) v1 -9719> 2012-10-11 13:43:50.722246 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1366, time: 2012-10-11 13:43:50.722246, event: started, request: osd pg remove(epoch 7; pg0.e0; ) v1 -9718> 2012-10-11 13:43:50.722251 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.e0 -9717> 2012-10-11 13:43:50.722263 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.e0 0x2468da0)/0x2468da0 -9716> 2012-10-11 13:43:50.722267 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9715> 2012-10-11 13:43:50.722269 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9714> 2012-10-11 13:43:50.722271 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3908 0x311e990 -9713> 2012-10-11 13:43:50.722275 7f440532f700 5 journal submit_entry seq 3908 len 204 (0x26c1360) -9712> 2012-10-11 13:43:50.722276 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9711> 2012-10-11 13:43:50.722278 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9710> 2012-10-11 13:43:50.722293 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1366, time: 2012-10-11 13:43:50.722293, event: done, request: osd pg remove(epoch 7; pg0.e0; ) v1 -9709> 2012-10-11 13:43:50.722302 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 128070) -9708> 2012-10-11 13:43:50.722305 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 500 ==== pg_log(2.d1 epoch 7 query_epoch 7) v3 ==== 507+0+0 (618506916 0 0) 0x23cb500 con 0x2fe2280 -9707> 2012-10-11 13:43:50.722314 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1367, time: 2012-10-11 13:43:49.138068, event: header_read, request: pg_log(2.d1 epoch 7 query_epoch 7) v3 -9706> 2012-10-11 13:43:50.722319 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1367, time: 2012-10-11 13:43:49.138072, event: throttled, request: pg_log(2.d1 epoch 7 query_epoch 7) v3 -9705> 2012-10-11 13:43:50.722323 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1367, time: 2012-10-11 13:43:49.138083, event: all_read, request: pg_log(2.d1 epoch 7 query_epoch 7) v3 -9704> 2012-10-11 13:43:50.722327 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1367, time: 2012-10-11 13:43:50.722313, event: dispatched, request: pg_log(2.d1 epoch 7 query_epoch 7) v3 -9706> 2012-10-11 13:43:50.722331 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1367, time: 2012-10-11 13:43:50.722331, event: waiting_for_osdmap, request: pg_log(2.d1 epoch 7 query_epoch 7) v3 -9709> 2012-10-11 13:43:50.722338 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1367, time: 2012-10-11 13:43:50.722338, event: started, request: pg_log(2.d1 epoch 7 query_epoch 7) v3 -9708> 2012-10-11 13:43:50.722346 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1367, time: 2012-10-11 13:43:50.722346, event: done, request: pg_log(2.d1 epoch 7 query_epoch 7) v3 -9707> 2012-10-11 13:43:50.722353 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 127563) -9706> 2012-10-11 13:43:50.722355 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 845 ==== osd pg remove(epoch 7; pg0.e4; ) v1 ==== 25+0+0 (769973755 0 0) 0x29e4e00 con 0x2fe2140 -9705> 2012-10-11 13:43:50.722363 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1368, time: 2012-10-11 13:43:48.729758, event: header_read, request: osd pg remove(epoch 7; pg0.e4; ) v1 -9704> 2012-10-11 13:43:50.722369 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1368, time: 2012-10-11 13:43:48.729760, event: throttled, request: osd pg remove(epoch 7; pg0.e4; ) v1 -9704> 2012-10-11 13:43:50.722372 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1368, time: 2012-10-11 13:43:48.729764, event: all_read, request: osd pg remove(epoch 7; pg0.e4; ) v1 -9704> 2012-10-11 13:43:50.722377 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1368, time: 2012-10-11 13:43:50.722363, event: dispatched, request: osd pg remove(epoch 7; pg0.e4; ) v1 -9704> 2012-10-11 13:43:50.722382 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1368, time: 2012-10-11 13:43:50.722382, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.e4; ) v1 -9703> 2012-10-11 13:43:50.722387 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1368, time: 2012-10-11 13:43:50.722387, event: started, request: osd pg remove(epoch 7; pg0.e4; ) v1 -9702> 2012-10-11 13:43:50.722393 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.e4 -9701> 2012-10-11 13:43:50.722404 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.e4 0x2468ce0)/0x2468ce0 -9700> 2012-10-11 13:43:50.722408 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9699> 2012-10-11 13:43:50.722409 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9698> 2012-10-11 13:43:50.722410 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3909 0x2aa3240 -9697> 2012-10-11 13:43:50.722414 7f440532f700 5 journal submit_entry seq 3909 len 204 (0x26c11b0) -9696> 2012-10-11 13:43:50.722416 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9695> 2012-10-11 13:43:50.722418 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9694> 2012-10-11 13:43:50.722433 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1368, time: 2012-10-11 13:43:50.722433, event: done, request: osd pg remove(epoch 7; pg0.e4; ) v1 -9693> 2012-10-11 13:43:50.722443 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 127538) -9692> 2012-10-11 13:43:50.722446 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 501 ==== pg_log(2.d6 epoch 7 query_epoch 7) v3 ==== 507+0+0 (4171127119 0 0) 0x23cb000 con 0x2fe2280 -9691> 2012-10-11 13:43:50.722456 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1369, time: 2012-10-11 13:43:49.138086, event: header_read, request: pg_log(2.d6 epoch 7 query_epoch 7) v3 -9690> 2012-10-11 13:43:50.722461 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1369, time: 2012-10-11 13:43:49.138090, event: throttled, request: pg_log(2.d6 epoch 7 query_epoch 7) v3 -9689> 2012-10-11 13:43:50.722465 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1369, time: 2012-10-11 13:43:49.138098, event: all_read, request: pg_log(2.d6 epoch 7 query_epoch 7) v3 -9688> 2012-10-11 13:43:50.722469 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1369, time: 2012-10-11 13:43:50.722455, event: dispatched, request: pg_log(2.d6 epoch 7 query_epoch 7) v3 -9687> 2012-10-11 13:43:50.722473 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1369, time: 2012-10-11 13:43:50.722473, event: waiting_for_osdmap, request: pg_log(2.d6 epoch 7 query_epoch 7) v3 -9686> 2012-10-11 13:43:50.722480 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1369, time: 2012-10-11 13:43:50.722480, event: started, request: pg_log(2.d6 epoch 7 query_epoch 7) v3 -9685> 2012-10-11 13:43:50.722489 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1369, time: 2012-10-11 13:43:50.722489, event: done, request: pg_log(2.d6 epoch 7 query_epoch 7) v3 -9684> 2012-10-11 13:43:50.722495 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 127031) -9683> 2012-10-11 13:43:50.722497 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 846 ==== osd pg remove(epoch 7; pg0.e6; ) v1 ==== 25+0+0 (3214682037 0 0) 0x29e4c40 con 0x2fe2140 -9682> 2012-10-11 13:43:50.722505 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1370, time: 2012-10-11 13:43:48.729766, event: header_read, request: osd pg remove(epoch 7; pg0.e6; ) v1 -9681> 2012-10-11 13:43:50.722509 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1370, time: 2012-10-11 13:43:48.729769, event: throttled, request: osd pg remove(epoch 7; pg0.e6; ) v1 -9680> 2012-10-11 13:43:50.722514 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1370, time: 2012-10-11 13:43:48.729772, event: all_read, request: osd pg remove(epoch 7; pg0.e6; ) v1 -9679> 2012-10-11 13:43:50.722518 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1370, time: 2012-10-11 13:43:50.722505, event: dispatched, request: osd pg remove(epoch 7; pg0.e6; ) v1 -9678> 2012-10-11 13:43:50.722522 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1370, time: 2012-10-11 13:43:50.722522, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.e6; ) v1 -9677> 2012-10-11 13:43:50.722527 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1370, time: 2012-10-11 13:43:50.722527, event: started, request: osd pg remove(epoch 7; pg0.e6; ) v1 -9676> 2012-10-11 13:43:50.722532 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.e6 -9675> 2012-10-11 13:43:50.722544 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.e6 0x2468c80)/0x2468c80 -9674> 2012-10-11 13:43:50.722548 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9673> 2012-10-11 13:43:50.722549 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9672> 2012-10-11 13:43:50.722550 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3910 0x311e630 -9671> 2012-10-11 13:43:50.722553 7f440532f700 5 journal submit_entry seq 3910 len 204 (0x26c16f0) -9670> 2012-10-11 13:43:50.722555 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9669> 2012-10-11 13:43:50.722557 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9668> 2012-10-11 13:43:50.722570 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1370, time: 2012-10-11 13:43:50.722570, event: done, request: osd pg remove(epoch 7; pg0.e6; ) v1 -9667> 2012-10-11 13:43:50.722579 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 127006) -9666> 2012-10-11 13:43:50.722583 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 502 ==== pg_log(0.8 epoch 7 query_epoch 7) v3 ==== 507+0+0 (1953561330 0 0) 0x229ca00 con 0x2fe2280 -9665> 2012-10-11 13:43:50.722592 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1371, time: 2012-10-11 13:43:49.141460, event: header_read, request: pg_log(0.8 epoch 7 query_epoch 7) v3 -9664> 2012-10-11 13:43:50.722597 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1371, time: 2012-10-11 13:43:49.141470, event: throttled, request: pg_log(0.8 epoch 7 query_epoch 7) v3 -9663> 2012-10-11 13:43:50.722602 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1371, time: 2012-10-11 13:43:49.141485, event: all_read, request: pg_log(0.8 epoch 7 query_epoch 7) v3 -9662> 2012-10-11 13:43:50.722606 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1371, time: 2012-10-11 13:43:50.722591, event: dispatched, request: pg_log(0.8 epoch 7 query_epoch 7) v3 -9661> 2012-10-11 13:43:50.722611 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1371, time: 2012-10-11 13:43:50.722611, event: waiting_for_osdmap, request: pg_log(0.8 epoch 7 query_epoch 7) v3 -9660> 2012-10-11 13:43:50.722618 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1371, time: 2012-10-11 13:43:50.722618, event: started, request: pg_log(0.8 epoch 7 query_epoch 7) v3 -9659> 2012-10-11 13:43:50.722625 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1371, time: 2012-10-11 13:43:50.722625, event: done, request: pg_log(0.8 epoch 7 query_epoch 7) v3 -9658> 2012-10-11 13:43:50.722632 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 126499) -9657> 2012-10-11 13:43:50.722634 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 847 ==== osd pg remove(epoch 7; pg0.ff; ) v1 ==== 25+0+0 (820860924 0 0) 0x29e4a80 con 0x2fe2140 -9656> 2012-10-11 13:43:50.722641 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1372, time: 2012-10-11 13:43:48.729774, event: header_read, request: osd pg remove(epoch 7; pg0.ff; ) v1 -9655> 2012-10-11 13:43:50.722645 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1372, time: 2012-10-11 13:43:48.729776, event: throttled, request: osd pg remove(epoch 7; pg0.ff; ) v1 -9654> 2012-10-11 13:43:50.722649 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1372, time: 2012-10-11 13:43:48.729780, event: all_read, request: osd pg remove(epoch 7; pg0.ff; ) v1 -9653> 2012-10-11 13:43:50.722652 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1372, time: 2012-10-11 13:43:50.722640, event: dispatched, request: osd pg remove(epoch 7; pg0.ff; ) v1 -9652> 2012-10-11 13:43:50.722656 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1372, time: 2012-10-11 13:43:50.722656, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.ff; ) v1 -9651> 2012-10-11 13:43:50.722661 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1372, time: 2012-10-11 13:43:50.722661, event: started, request: osd pg remove(epoch 7; pg0.ff; ) v1 -9650> 2012-10-11 13:43:50.722665 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.ff -9649> 2012-10-11 13:43:50.722676 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.ff 0x27a13d0)/0x27a13d0 -9648> 2012-10-11 13:43:50.722679 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9647> 2012-10-11 13:43:50.722680 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9646> 2012-10-11 13:43:50.722681 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3911 0x2aa3360 -9645> 2012-10-11 13:43:50.722683 7f440532f700 5 journal submit_entry seq 3911 len 204 (0x26c1d80) -9644> 2012-10-11 13:43:50.722685 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9643> 2012-10-11 13:43:50.722686 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9642> 2012-10-11 13:43:50.722701 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1372, time: 2012-10-11 13:43:50.722701, event: done, request: osd pg remove(epoch 7; pg0.ff; ) v1 -9641> 2012-10-11 13:43:50.722712 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 126474) -9640> 2012-10-11 13:43:50.722714 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 503 ==== pg_log(0.e8 epoch 7 query_epoch 7) v3 ==== 507+0+0 (455092993 0 0) 0x229c500 con 0x2fe2280 -9639> 2012-10-11 13:43:50.722724 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1373, time: 2012-10-11 13:43:49.141491, event: header_read, request: pg_log(0.e8 epoch 7 query_epoch 7) v3 -9639> 2012-10-11 13:43:50.722729 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1373, time: 2012-10-11 13:43:49.141495, event: throttled, request: pg_log(0.e8 epoch 7 query_epoch 7) v3 -9639> 2012-10-11 13:43:50.722733 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1373, time: 2012-10-11 13:43:49.141503, event: all_read, request: pg_log(0.e8 epoch 7 query_epoch 7) v3 -9639> 2012-10-11 13:43:50.722736 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1373, time: 2012-10-11 13:43:50.722723, event: dispatched, request: pg_log(0.e8 epoch 7 query_epoch 7) v3 -9640> 2012-10-11 13:43:50.722741 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1373, time: 2012-10-11 13:43:50.722741, event: waiting_for_osdmap, request: pg_log(0.e8 epoch 7 query_epoch 7) v3 -9640> 2012-10-11 13:43:50.722747 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1373, time: 2012-10-11 13:43:50.722747, event: started, request: pg_log(0.e8 epoch 7 query_epoch 7) v3 -9639> 2012-10-11 13:43:50.722756 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1373, time: 2012-10-11 13:43:50.722756, event: done, request: pg_log(0.e8 epoch 7 query_epoch 7) v3 -9638> 2012-10-11 13:43:50.722762 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 125967) -9638> 2012-10-11 13:43:50.722765 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 848 ==== osd pg remove(epoch 7; pg1.6; ) v1 ==== 25+0+0 (1855001220 0 0) 0x29e48c0 con 0x2fe2140 -9637> 2012-10-11 13:43:50.722773 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1374, time: 2012-10-11 13:43:48.729782, event: header_read, request: osd pg remove(epoch 7; pg1.6; ) v1 -9636> 2012-10-11 13:43:50.722777 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1374, time: 2012-10-11 13:43:48.729785, event: throttled, request: osd pg remove(epoch 7; pg1.6; ) v1 -9635> 2012-10-11 13:43:50.722780 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1374, time: 2012-10-11 13:43:48.729788, event: all_read, request: osd pg remove(epoch 7; pg1.6; ) v1 -9634> 2012-10-11 13:43:50.722784 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1374, time: 2012-10-11 13:43:50.722772, event: dispatched, request: osd pg remove(epoch 7; pg1.6; ) v1 -9634> 2012-10-11 13:43:50.722788 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1374, time: 2012-10-11 13:43:50.722788, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.6; ) v1 -9633> 2012-10-11 13:43:50.722792 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1374, time: 2012-10-11 13:43:50.722792, event: started, request: osd pg remove(epoch 7; pg1.6; ) v1 -9633> 2012-10-11 13:43:50.722796 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.6 -9633> 2012-10-11 13:43:50.722808 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.6 0x27a1280)/0x27a1280 -9632> 2012-10-11 13:43:50.722811 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9631> 2012-10-11 13:43:50.722812 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9630> 2012-10-11 13:43:50.722813 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3912 0x24b6750 -9629> 2012-10-11 13:43:50.722815 7f440532f700 5 journal submit_entry seq 3912 len 200 (0x27d2930) -9628> 2012-10-11 13:43:50.722817 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9627> 2012-10-11 13:43:50.722818 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 200 -9626> 2012-10-11 13:43:50.722832 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1374, time: 2012-10-11 13:43:50.722832, event: done, request: osd pg remove(epoch 7; pg1.6; ) v1 -9625> 2012-10-11 13:43:50.722841 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 125942) -9624> 2012-10-11 13:43:50.722845 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 504 ==== pg_log(0.ee epoch 7 query_epoch 7) v3 ==== 507+0+0 (3419416439 0 0) 0x229c000 con 0x2fe2280 -9623> 2012-10-11 13:43:50.722855 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1375, time: 2012-10-11 13:43:49.142384, event: header_read, request: pg_log(0.ee epoch 7 query_epoch 7) v3 -9622> 2012-10-11 13:43:50.722860 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1375, time: 2012-10-11 13:43:49.142393, event: throttled, request: pg_log(0.ee epoch 7 query_epoch 7) v3 -9621> 2012-10-11 13:43:50.722864 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1375, time: 2012-10-11 13:43:49.142406, event: all_read, request: pg_log(0.ee epoch 7 query_epoch 7) v3 -9620> 2012-10-11 13:43:50.722869 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1375, time: 2012-10-11 13:43:50.722854, event: dispatched, request: pg_log(0.ee epoch 7 query_epoch 7) v3 -9619> 2012-10-11 13:43:50.722874 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1375, time: 2012-10-11 13:43:50.722874, event: waiting_for_osdmap, request: pg_log(0.ee epoch 7 query_epoch 7) v3 -9618> 2012-10-11 13:43:50.722880 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1375, time: 2012-10-11 13:43:50.722880, event: started, request: pg_log(0.ee epoch 7 query_epoch 7) v3 -9617> 2012-10-11 13:43:50.722888 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1375, time: 2012-10-11 13:43:50.722888, event: done, request: pg_log(0.ee epoch 7 query_epoch 7) v3 -9616> 2012-10-11 13:43:50.722895 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 125435) -9615> 2012-10-11 13:43:50.722898 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 849 ==== osd pg remove(epoch 7; pg1.e; ) v1 ==== 25+0+0 (749344350 0 0) 0x29e4700 con 0x2fe2140 -9614> 2012-10-11 13:43:50.722976 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.4d 0x3176790)/0x3176790 -9613> 2012-10-11 13:43:50.722999 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9612> 2012-10-11 13:43:50.723001 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9611> 2012-10-11 13:43:50.723002 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3913 0x28aca20 -9610> 2012-10-11 13:43:50.723006 7f4402228700 5 journal submit_entry seq 3913 len 926 (0x32e8d50) -9609> 2012-10-11 13:43:50.723007 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9608> 2012-10-11 13:43:50.723009 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9607> 2012-10-11 13:43:50.723059 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(0.5d epoch 8 query_epoch 8) v3 -- ?+0 0x2656500 -9606> 2012-10-11 13:43:50.723089 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.5d 0x2130350)/0x2130350 -9605> 2012-10-11 13:43:50.723093 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9604> 2012-10-11 13:43:50.723094 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9603> 2012-10-11 13:43:50.723095 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3914 0x28accf0 -9602> 2012-10-11 13:43:50.723098 7f4402228700 5 journal submit_entry seq 3914 len 926 (0x292e270) -9601> 2012-10-11 13:43:50.723100 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9600> 2012-10-11 13:43:50.723101 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9599> 2012-10-11 13:43:50.723125 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(0.5e epoch 8 query_epoch 8) v3 -- ?+0 0x2656000 -9598> 2012-10-11 13:43:50.722985 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b0 0x3176db0)/0x3176db0 -9597> 2012-10-11 13:43:50.723150 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9596> 2012-10-11 13:43:50.723156 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9595> 2012-10-11 13:43:50.723157 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3915 0x2cdaa20 -9594> 2012-10-11 13:43:50.723162 7f4402a29700 5 journal submit_entry seq 3915 len 969 (0x338e690) -9593> 2012-10-11 13:43:50.723164 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9592> 2012-10-11 13:43:50.723166 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9591> 2012-10-11 13:43:50.723193 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.b3 epoch 8 query_epoch 8) v3 -- ?+0 0x244e000 -9590> 2012-10-11 13:43:50.723263 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.5e 0x2130320)/0x2130320 -9589> 2012-10-11 13:43:50.723291 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b3 0x3176d20)/0x3176d20 -9588> 2012-10-11 13:43:50.723307 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9587> 2012-10-11 13:43:50.723314 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9586> 2012-10-11 13:43:50.723321 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3916 0x2cda900 -9585> 2012-10-11 13:43:50.723352 7f4402a29700 5 journal submit_entry seq 3916 len 969 (0x23c7ae0) -9584> 2012-10-11 13:43:50.723361 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9583> 2012-10-11 13:43:50.723369 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9582> 2012-10-11 13:43:50.723388 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9581> 2012-10-11 13:43:50.723443 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.bf epoch 8 query_epoch 8) v3 -- ?+0 0x2014a00 -9580> 2012-10-11 13:43:50.723465 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9579> 2012-10-11 13:43:50.723478 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3917 0x28ac480 -9578> 2012-10-11 13:43:50.723488 7f4402228700 5 journal submit_entry seq 3917 len 926 (0x292e3f0) -9577> 2012-10-11 13:43:50.723496 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9576> 2012-10-11 13:43:50.723503 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9575> 2012-10-11 13:43:50.723537 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(0.67 epoch 8 query_epoch 8) v3 -- ?+0 0x2fc7a00 -9574> 2012-10-11 13:43:50.723632 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.67 0x2130480)/0x2130480 -9573> 2012-10-11 13:43:50.723660 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.bf 0x3176f70)/0x3176f70 -9572> 2012-10-11 13:43:50.723676 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9571> 2012-10-11 13:43:50.723683 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9570> 2012-10-11 13:43:50.723690 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3918 0x2cda6c0 -9569> 2012-10-11 13:43:50.723700 7f4402a29700 5 journal submit_entry seq 3918 len 969 (0x23c7ba0) -9568> 2012-10-11 13:43:50.723708 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9567> 2012-10-11 13:43:50.723717 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9566> 2012-10-11 13:43:50.723721 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9565> 2012-10-11 13:43:50.723736 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9564> 2012-10-11 13:43:50.723771 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.d8 epoch 8 query_epoch 8) v3 -- ?+0 0x2014500 -9563> 2012-10-11 13:43:50.723786 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3919 0x28acc60 -9562> 2012-10-11 13:43:50.723802 7f4402228700 5 journal submit_entry seq 3919 len 926 (0x322ede0) -9561> 2012-10-11 13:43:50.723810 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9560> 2012-10-11 13:43:50.723817 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9559> 2012-10-11 13:43:50.723849 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(0.68 epoch 8 query_epoch 8) v3 -- ?+0 0x2fc7500 -9558> 2012-10-11 13:43:50.723882 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.d8 0x25cf180)/0x25cf180 -9557> 2012-10-11 13:43:50.723907 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9556> 2012-10-11 13:43:50.723918 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9555> 2012-10-11 13:43:50.723925 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3920 0x2cda3f0 -9554> 2012-10-11 13:43:50.723936 7f4402a29700 5 journal submit_entry seq 3920 len 969 (0x3419ed0) -9553> 2012-10-11 13:43:50.723944 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9552> 2012-10-11 13:43:50.723950 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9551> 2012-10-11 13:43:50.723951 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1376, time: 2012-10-11 13:43:48.729790, event: header_read, request: osd pg remove(epoch 7; pg1.e; ) v1 -9550> 2012-10-11 13:43:50.723958 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1376, time: 2012-10-11 13:43:48.729792, event: throttled, request: osd pg remove(epoch 7; pg1.e; ) v1 -9549> 2012-10-11 13:43:50.723977 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1376, time: 2012-10-11 13:43:48.729806, event: all_read, request: osd pg remove(epoch 7; pg1.e; ) v1 -9548> 2012-10-11 13:43:50.723981 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1376, time: 2012-10-11 13:43:50.723949, event: dispatched, request: osd pg remove(epoch 7; pg1.e; ) v1 -9547> 2012-10-11 13:43:50.723984 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.96 0x2130ce0)/0x2130ce0 -9546> 2012-10-11 13:43:50.723987 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9545> 2012-10-11 13:43:50.723985 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1376, time: 2012-10-11 13:43:50.723985, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.e; ) v1 -9544> 2012-10-11 13:43:50.723988 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9543> 2012-10-11 13:43:50.723989 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3921 0x2cda240 -9542> 2012-10-11 13:43:50.723990 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1376, time: 2012-10-11 13:43:50.723990, event: started, request: osd pg remove(epoch 7; pg1.e; ) v1 -9541> 2012-10-11 13:43:50.723993 7f4402a29700 5 journal submit_entry seq 3921 len 926 (0x26c10f0) -9540> 2012-10-11 13:43:50.723995 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9539> 2012-10-11 13:43:50.723995 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.e -9538> 2012-10-11 13:43:50.723996 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9537> 2012-10-11 13:43:50.724009 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.e 0x27a1500)/0x27a1500 -9536> 2012-10-11 13:43:50.724012 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9535> 2012-10-11 13:43:50.724014 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9534> 2012-10-11 13:43:50.724015 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3922 0x2aa3990 -9533> 2012-10-11 13:43:50.724017 7f440532f700 5 journal submit_entry seq 3922 len 200 (0x28270c0) -9532> 2012-10-11 13:43:50.724019 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9531> 2012-10-11 13:43:50.724020 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 200 -9530> 2012-10-11 13:43:50.724031 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.8c 0x2130b10)/0x2130b10 -9529> 2012-10-11 13:43:50.724034 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9528> 2012-10-11 13:43:50.724035 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9527> 2012-10-11 13:43:50.724036 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3923 0x2cda360 -9526> 2012-10-11 13:43:50.724039 7f4402a29700 5 journal submit_entry seq 3923 len 926 (0x26096f0) -9525> 2012-10-11 13:43:50.724041 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9524> 2012-10-11 13:43:50.724043 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9523> 2012-10-11 13:43:50.724040 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1376, time: 2012-10-11 13:43:50.724040, event: done, request: osd pg remove(epoch 7; pg1.e; ) v1 -9522> 2012-10-11 13:43:50.724050 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 125410) -9521> 2012-10-11 13:43:50.724053 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 505 ==== pg_log(0.f0 epoch 7 query_epoch 7) v3 ==== 507+0+0 (1554839839 0 0) 0x28f7a00 con 0x2fe2280 -9520> 2012-10-11 13:43:50.724062 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1377, time: 2012-10-11 13:43:49.145300, event: header_read, request: pg_log(0.f0 epoch 7 query_epoch 7) v3 -9519> 2012-10-11 13:43:50.724066 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1377, time: 2012-10-11 13:43:49.145308, event: throttled, request: pg_log(0.f0 epoch 7 query_epoch 7) v3 -9518> 2012-10-11 13:43:50.724070 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1377, time: 2012-10-11 13:43:49.145321, event: all_read, request: pg_log(0.f0 epoch 7 query_epoch 7) v3 -9517> 2012-10-11 13:43:50.724072 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.8b 0x2adbd90)/0x2adbd90 -9516> 2012-10-11 13:43:50.724075 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9515> 2012-10-11 13:43:50.724074 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1377, time: 2012-10-11 13:43:50.724061, event: dispatched, request: pg_log(0.f0 epoch 7 query_epoch 7) v3 -9514> 2012-10-11 13:43:50.724076 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9513> 2012-10-11 13:43:50.724078 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3924 0x2cda510 -9512> 2012-10-11 13:43:50.724078 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1377, time: 2012-10-11 13:43:50.724078, event: waiting_for_osdmap, request: pg_log(0.f0 epoch 7 query_epoch 7) v3 -9511> 2012-10-11 13:43:50.724081 7f4402a29700 5 journal submit_entry seq 3924 len 926 (0x314ede0) -9510> 2012-10-11 13:43:50.724082 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9509> 2012-10-11 13:43:50.724084 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9508> 2012-10-11 13:43:50.724084 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1377, time: 2012-10-11 13:43:50.724084, event: started, request: pg_log(0.f0 epoch 7 query_epoch 7) v3 -9507> 2012-10-11 13:43:50.724092 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1377, time: 2012-10-11 13:43:50.724092, event: done, request: pg_log(0.f0 epoch 7 query_epoch 7) v3 -9506> 2012-10-11 13:43:50.724097 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 124903) -9505> 2012-10-11 13:43:50.724099 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 850 ==== osd pg remove(epoch 7; pg1.b7; ) v1 ==== 25+0+0 (2598016490 0 0) 0x29e4540 con 0x2fe2140 -9504> 2012-10-11 13:43:50.724106 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1378, time: 2012-10-11 13:43:48.854768, event: header_read, request: osd pg remove(epoch 7; pg1.b7; ) v1 -9503> 2012-10-11 13:43:50.724110 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1378, time: 2012-10-11 13:43:48.854783, event: throttled, request: osd pg remove(epoch 7; pg1.b7; ) v1 -9502> 2012-10-11 13:43:50.724114 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1378, time: 2012-10-11 13:43:48.854792, event: all_read, request: osd pg remove(epoch 7; pg1.b7; ) v1 -9501> 2012-10-11 13:43:50.724118 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1378, time: 2012-10-11 13:43:50.724105, event: dispatched, request: osd pg remove(epoch 7; pg1.b7; ) v1 -9500> 2012-10-11 13:43:50.724121 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1378, time: 2012-10-11 13:43:50.724121, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.b7; ) v1 -9499> 2012-10-11 13:43:50.724126 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1378, time: 2012-10-11 13:43:50.724126, event: started, request: osd pg remove(epoch 7; pg1.b7; ) v1 -9498> 2012-10-11 13:43:50.724130 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.b7 -9497> 2012-10-11 13:43:50.724142 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.b7 0x2e38550)/0x2e38550 -9496> 2012-10-11 13:43:50.724145 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9495> 2012-10-11 13:43:50.724146 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9494> 2012-10-11 13:43:50.724147 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3925 0x24b6990 -9493> 2012-10-11 13:43:50.724150 7f440532f700 5 journal submit_entry seq 3925 len 204 (0x28811b0) -9492> 2012-10-11 13:43:50.724151 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9491> 2012-10-11 13:43:50.724153 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9490> 2012-10-11 13:43:50.724154 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.80 0x3176b70)/0x3176b70 -9489> 2012-10-11 13:43:50.724158 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9488> 2012-10-11 13:43:50.724160 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9487> 2012-10-11 13:43:50.724161 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3926 0x2cda1b0 -9486> 2012-10-11 13:43:50.724164 7f4402a29700 5 journal submit_entry seq 3926 len 926 (0x341cf90) -9485> 2012-10-11 13:43:50.724166 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9484> 2012-10-11 13:43:50.724167 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9483> 2012-10-11 13:43:50.724167 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1378, time: 2012-10-11 13:43:50.724166, event: done, request: osd pg remove(epoch 7; pg1.b7; ) v1 -9482> 2012-10-11 13:43:50.724175 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124878) -9481> 2012-10-11 13:43:50.724177 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 506 ==== pg_log(0.f2 epoch 7 query_epoch 7) v3 ==== 507+0+0 (2666671911 0 0) 0x28f7500 con 0x2fe2280 -9480> 2012-10-11 13:43:50.724186 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1379, time: 2012-10-11 13:43:49.157431, event: header_read, request: pg_log(0.f2 epoch 7 query_epoch 7) v3 -9479> 2012-10-11 13:43:50.724190 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1379, time: 2012-10-11 13:43:49.157446, event: throttled, request: pg_log(0.f2 epoch 7 query_epoch 7) v3 -9478> 2012-10-11 13:43:50.724193 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1379, time: 2012-10-11 13:43:49.157464, event: all_read, request: pg_log(0.f2 epoch 7 query_epoch 7) v3 -9477> 2012-10-11 13:43:50.724197 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.82 0x2130960)/0x2130960 -9476> 2012-10-11 13:43:50.724197 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1379, time: 2012-10-11 13:43:50.724185, event: dispatched, request: pg_log(0.f2 epoch 7 query_epoch 7) v3 -9475> 2012-10-11 13:43:50.724200 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9474> 2012-10-11 13:43:50.724202 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9473> 2012-10-11 13:43:50.724203 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3927 0x2cda750 -9472> 2012-10-11 13:43:50.724201 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1379, time: 2012-10-11 13:43:50.724201, event: waiting_for_osdmap, request: pg_log(0.f2 epoch 7 query_epoch 7) v3 -9471> 2012-10-11 13:43:50.724207 7f4402a29700 5 journal submit_entry seq 3927 len 926 (0x341ca50) -9470> 2012-10-11 13:43:50.724209 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9469> 2012-10-11 13:43:50.724207 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1379, time: 2012-10-11 13:43:50.724207, event: started, request: pg_log(0.f2 epoch 7 query_epoch 7) v3 -9468> 2012-10-11 13:43:50.724210 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9467> 2012-10-11 13:43:50.724216 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1379, time: 2012-10-11 13:43:50.724216, event: done, request: pg_log(0.f2 epoch 7 query_epoch 7) v3 -9466> 2012-10-11 13:43:50.724222 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 124371) -9465> 2012-10-11 13:43:50.724224 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 851 ==== osd pg remove(epoch 7; pg1.ba; ) v1 ==== 25+0+0 (2965401210 0 0) 0x29e4380 con 0x2fe2140 -9464> 2012-10-11 13:43:50.724231 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1380, time: 2012-10-11 13:43:48.854799, event: header_read, request: osd pg remove(epoch 7; pg1.ba; ) v1 -9463> 2012-10-11 13:43:50.724235 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1380, time: 2012-10-11 13:43:48.854801, event: throttled, request: osd pg remove(epoch 7; pg1.ba; ) v1 -9462> 2012-10-11 13:43:50.724239 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1380, time: 2012-10-11 13:43:48.854805, event: all_read, request: osd pg remove(epoch 7; pg1.ba; ) v1 -9461> 2012-10-11 13:43:50.724242 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.8a 0x3176c10)/0x3176c10 -9460> 2012-10-11 13:43:50.724245 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9459> 2012-10-11 13:43:50.724242 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1380, time: 2012-10-11 13:43:50.724230, event: dispatched, request: osd pg remove(epoch 7; pg1.ba; ) v1 -9458> 2012-10-11 13:43:50.724246 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9457> 2012-10-11 13:43:50.724247 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3928 0x2cda480 -9456> 2012-10-11 13:43:50.724247 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1380, time: 2012-10-11 13:43:50.724247, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.ba; ) v1 -9455> 2012-10-11 13:43:50.724251 7f4402a29700 5 journal submit_entry seq 3928 len 926 (0x26c1990) -9454> 2012-10-11 13:43:50.724252 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9453> 2012-10-11 13:43:50.724254 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9452> 2012-10-11 13:43:50.724251 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1380, time: 2012-10-11 13:43:50.724251, event: started, request: osd pg remove(epoch 7; pg1.ba; ) v1 -9451> 2012-10-11 13:43:50.724259 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.ba -9450> 2012-10-11 13:43:50.724270 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ba 0x2e384c0)/0x2e384c0 -9449> 2012-10-11 13:43:50.724273 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9448> 2012-10-11 13:43:50.724274 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9447> 2012-10-11 13:43:50.724275 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3929 0x2e55120 -9446> 2012-10-11 13:43:50.724278 7f440532f700 5 journal submit_entry seq 3929 len 204 (0x2f0e390) -9445> 2012-10-11 13:43:50.724279 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9444> 2012-10-11 13:43:50.724280 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9443> 2012-10-11 13:43:50.724282 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.81 0x2adbb70)/0x2adbb70 -9442> 2012-10-11 13:43:50.724286 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9441> 2012-10-11 13:43:50.724287 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9440> 2012-10-11 13:43:50.724288 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3930 0x2cdaea0 -9439> 2012-10-11 13:43:50.724291 7f4402a29700 5 journal submit_entry seq 3930 len 926 (0x2876f60) -9438> 2012-10-11 13:43:50.724293 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9437> 2012-10-11 13:43:50.724294 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9436> 2012-10-11 13:43:50.724294 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1380, time: 2012-10-11 13:43:50.724294, event: done, request: osd pg remove(epoch 7; pg1.ba; ) v1 -9435> 2012-10-11 13:43:50.724302 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124346) -9434> 2012-10-11 13:43:50.724304 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 507 ==== pg_log(0.f3 epoch 7 query_epoch 7) v3 ==== 507+0+0 (1482433313 0 0) 0x28f7000 con 0x2fe2280 -9433> 2012-10-11 13:43:50.724312 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1381, time: 2012-10-11 13:43:49.157472, event: header_read, request: pg_log(0.f3 epoch 7 query_epoch 7) v3 -9432> 2012-10-11 13:43:50.724316 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1381, time: 2012-10-11 13:43:49.157475, event: throttled, request: pg_log(0.f3 epoch 7 query_epoch 7) v3 -9431> 2012-10-11 13:43:50.724320 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1381, time: 2012-10-11 13:43:49.157484, event: all_read, request: pg_log(0.f3 epoch 7 query_epoch 7) v3 -9430> 2012-10-11 13:43:50.724324 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.7d 0x2130910)/0x2130910 -9429> 2012-10-11 13:43:50.724323 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1381, time: 2012-10-11 13:43:50.724311, event: dispatched, request: pg_log(0.f3 epoch 7 query_epoch 7) v3 -9428> 2012-10-11 13:43:50.724327 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9427> 2012-10-11 13:43:50.724328 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9426> 2012-10-11 13:43:50.724329 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3931 0x2cda630 -9425> 2012-10-11 13:43:50.724327 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1381, time: 2012-10-11 13:43:50.724327, event: waiting_for_osdmap, request: pg_log(0.f3 epoch 7 query_epoch 7) v3 -9424> 2012-10-11 13:43:50.724332 7f4402a29700 5 journal submit_entry seq 3931 len 926 (0x1e869c0) -9423> 2012-10-11 13:43:50.724334 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9422> 2012-10-11 13:43:50.724335 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9421> 2012-10-11 13:43:50.724333 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1381, time: 2012-10-11 13:43:50.724333, event: started, request: pg_log(0.f3 epoch 7 query_epoch 7) v3 -9420> 2012-10-11 13:43:50.724341 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1381, time: 2012-10-11 13:43:50.724341, event: done, request: pg_log(0.f3 epoch 7 query_epoch 7) v3 -9419> 2012-10-11 13:43:50.724346 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 123839) -9418> 2012-10-11 13:43:50.724348 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 852 ==== osd pg remove(epoch 7; pg1.ca; ) v1 ==== 25+0+0 (599181669 0 0) 0x29e41c0 con 0x2fe2140 -9417> 2012-10-11 13:43:50.724354 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1382, time: 2012-10-11 13:43:48.854807, event: header_read, request: osd pg remove(epoch 7; pg1.ca; ) v1 -9416> 2012-10-11 13:43:50.724358 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1382, time: 2012-10-11 13:43:48.854810, event: throttled, request: osd pg remove(epoch 7; pg1.ca; ) v1 -9415> 2012-10-11 13:43:50.724363 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.7f 0x21309f0)/0x21309f0 -9414> 2012-10-11 13:43:50.724363 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1382, time: 2012-10-11 13:43:48.854813, event: all_read, request: osd pg remove(epoch 7; pg1.ca; ) v1 -9413> 2012-10-11 13:43:50.724366 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9412> 2012-10-11 13:43:50.724368 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9411> 2012-10-11 13:43:50.724369 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3932 0x2cdae10 -9410> 2012-10-11 13:43:50.724366 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1382, time: 2012-10-11 13:43:50.724354, event: dispatched, request: osd pg remove(epoch 7; pg1.ca; ) v1 -9409> 2012-10-11 13:43:50.724372 7f4402a29700 5 journal submit_entry seq 3932 len 926 (0x341cfc0) -9408> 2012-10-11 13:43:50.724371 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1382, time: 2012-10-11 13:43:50.724371, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.ca; ) v1 -9407> 2012-10-11 13:43:50.724373 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9406> 2012-10-11 13:43:50.724375 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9405> 2012-10-11 13:43:50.724375 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1382, time: 2012-10-11 13:43:50.724375, event: started, request: osd pg remove(epoch 7; pg1.ca; ) v1 -9404> 2012-10-11 13:43:50.724380 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.ca -9403> 2012-10-11 13:43:50.724394 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ca 0x2e389c0)/0x2e389c0 -9402> 2012-10-11 13:43:50.724397 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9401> 2012-10-11 13:43:50.724398 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9400> 2012-10-11 13:43:50.724399 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3933 0x2a26ab0 -9399> 2012-10-11 13:43:50.724401 7f440532f700 5 journal submit_entry seq 3933 len 204 (0x2f0e9f0) -9400> 2012-10-11 13:43:50.724403 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9399> 2012-10-11 13:43:50.724403 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.7e 0x2adb800)/0x2adb800 -9399> 2012-10-11 13:43:50.724404 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9399> 2012-10-11 13:43:50.724407 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9400> 2012-10-11 13:43:50.724409 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9399> 2012-10-11 13:43:50.724410 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3934 0x2cdabd0 -9398> 2012-10-11 13:43:50.724412 7f4402a29700 5 journal submit_entry seq 3934 len 926 (0x341ca80) -9398> 2012-10-11 13:43:50.724414 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9397> 2012-10-11 13:43:50.724415 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9396> 2012-10-11 13:43:50.724421 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1382, time: 2012-10-11 13:43:50.724421, event: done, request: osd pg remove(epoch 7; pg1.ca; ) v1 -9395> 2012-10-11 13:43:50.724430 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 123814) -9394> 2012-10-11 13:43:50.724432 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 508 ==== osd pg remove(epoch 7; pg1.af; ) v1 ==== 25+0+0 (1553438852 0 0) 0x1ed71c0 con 0x2fe2280 -9393> 2012-10-11 13:43:50.724440 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1383, time: 2012-10-11 13:43:49.232312, event: header_read, request: osd pg remove(epoch 7; pg1.af; ) v1 -9392> 2012-10-11 13:43:50.724436 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.7 epoch 8 query_epoch 7) v3 -- ?+0 0x2f66a00 -9392> 2012-10-11 13:43:50.724444 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1383, time: 2012-10-11 13:43:49.232329, event: throttled, request: osd pg remove(epoch 7; pg1.af; ) v1 -9393> 2012-10-11 13:43:50.724447 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1383, time: 2012-10-11 13:43:49.232339, event: all_read, request: osd pg remove(epoch 7; pg1.af; ) v1 -9392> 2012-10-11 13:43:50.724451 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1383, time: 2012-10-11 13:43:50.724439, event: dispatched, request: osd pg remove(epoch 7; pg1.af; ) v1 -9391> 2012-10-11 13:43:50.724455 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1383, time: 2012-10-11 13:43:50.724455, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.af; ) v1 -9390> 2012-10-11 13:43:50.724460 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1383, time: 2012-10-11 13:43:50.724459, event: started, request: osd pg remove(epoch 7; pg1.af; ) v1 -9389> 2012-10-11 13:43:50.724464 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.af -9388> 2012-10-11 13:43:50.724475 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.af 0x2e382d0)/0x2e382d0 -9387> 2012-10-11 13:43:50.724478 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9386> 2012-10-11 13:43:50.724479 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9385> 2012-10-11 13:43:50.724480 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3935 0x2a26480 -9384> 2012-10-11 13:43:50.724483 7f440532f700 5 journal submit_entry seq 3935 len 204 (0x2fafae0) -9383> 2012-10-11 13:43:50.724484 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9382> 2012-10-11 13:43:50.724486 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9381> 2012-10-11 13:43:50.724485 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.f4 epoch 8 query_epoch 7) v3 -- ?+0 0x2f64000 -9380> 2012-10-11 13:43:50.724502 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1383, time: 2012-10-11 13:43:50.724502, event: done, request: osd pg remove(epoch 7; pg1.af; ) v1 -9379> 2012-10-11 13:43:50.724510 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 123789) -9378> 2012-10-11 13:43:50.724512 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 853 ==== osd pg remove(epoch 7; pg1.d1; ) v1 ==== 25+0+0 (1052722018 0 0) 0x29e4000 con 0x2fe2140 -9377> 2012-10-11 13:43:50.724520 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1384, time: 2012-10-11 13:43:48.854816, event: header_read, request: osd pg remove(epoch 7; pg1.d1; ) v1 -9376> 2012-10-11 13:43:50.724524 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1384, time: 2012-10-11 13:43:48.854818, event: throttled, request: osd pg remove(epoch 7; pg1.d1; ) v1 -9375> 2012-10-11 13:43:50.724528 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1384, time: 2012-10-11 13:43:48.854823, event: all_read, request: osd pg remove(epoch 7; pg1.d1; ) v1 -9374> 2012-10-11 13:43:50.724531 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1384, time: 2012-10-11 13:43:50.724519, event: dispatched, request: osd pg remove(epoch 7; pg1.d1; ) v1 -9373> 2012-10-11 13:43:50.724536 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1384, time: 2012-10-11 13:43:50.724536, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.d1; ) v1 -9372> 2012-10-11 13:43:50.724540 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1384, time: 2012-10-11 13:43:50.724540, event: started, request: osd pg remove(epoch 7; pg1.d1; ) v1 -9371> 2012-10-11 13:43:50.724544 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.d1 -9370> 2012-10-11 13:43:50.724556 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.d1 0x2e38870)/0x2e38870 -9369> 2012-10-11 13:43:50.724558 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9368> 2012-10-11 13:43:50.724560 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9367> 2012-10-11 13:43:50.724561 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3936 0x2a266c0 -9366> 2012-10-11 13:43:50.724563 7f440532f700 5 journal submit_entry seq 3936 len 204 (0x2eb61b0) -9365> 2012-10-11 13:43:50.724565 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9364> 2012-10-11 13:43:50.724566 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9363> 2012-10-11 13:43:50.723942 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.68 0x2130450)/0x2130450 -9362> 2012-10-11 13:43:50.724584 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1384, time: 2012-10-11 13:43:50.724583, event: done, request: osd pg remove(epoch 7; pg1.d1; ) v1 -9361> 2012-10-11 13:43:50.724593 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 123764) -9360> 2012-10-11 13:43:50.724595 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 509 ==== osd pg remove(epoch 7; pg1.aa; ) v1 ==== 25+0+0 (884369358 0 0) 0x1ed7000 con 0x2fe2280 -9359> 2012-10-11 13:43:50.724603 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1385, time: 2012-10-11 13:43:49.232345, event: header_read, request: osd pg remove(epoch 7; pg1.aa; ) v1 -9358> 2012-10-11 13:43:50.724608 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1385, time: 2012-10-11 13:43:49.232347, event: throttled, request: osd pg remove(epoch 7; pg1.aa; ) v1 -9357> 2012-10-11 13:43:50.724612 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1385, time: 2012-10-11 13:43:49.232351, event: all_read, request: osd pg remove(epoch 7; pg1.aa; ) v1 -9356> 2012-10-11 13:43:50.724617 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1385, time: 2012-10-11 13:43:50.724602, event: dispatched, request: osd pg remove(epoch 7; pg1.aa; ) v1 -9355> 2012-10-11 13:43:50.724621 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1385, time: 2012-10-11 13:43:50.724621, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.aa; ) v1 -9354> 2012-10-11 13:43:50.724628 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1385, time: 2012-10-11 13:43:50.724627, event: started, request: osd pg remove(epoch 7; pg1.aa; ) v1 -9353> 2012-10-11 13:43:50.724633 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.aa -9352> 2012-10-11 13:43:50.724625 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9351> 2012-10-11 13:43:50.724643 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9350> 2012-10-11 13:43:50.724652 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3937 0x1e41b40 -9349> 2012-10-11 13:43:50.724663 7f4402228700 5 journal submit_entry seq 3937 len 926 (0x322e4e0) -9348> 2012-10-11 13:43:50.724669 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9347> 2012-10-11 13:43:50.724671 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9346> 2012-10-11 13:43:50.724703 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(1.5c epoch 8 query_epoch 8) v3 -- ?+0 0x2fc7000 -9345> 2012-10-11 13:43:50.724735 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.5c 0x2adb260)/0x2adb260 -9344> 2012-10-11 13:43:50.724739 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9343> 2012-10-11 13:43:50.724740 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9342> 2012-10-11 13:43:50.724741 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3938 0x1e41f30 -9341> 2012-10-11 13:43:50.724744 7f4402228700 5 journal submit_entry seq 3938 len 926 (0x292e210) -9340> 2012-10-11 13:43:50.724746 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9339> 2012-10-11 13:43:50.724747 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9338> 2012-10-11 13:43:50.724772 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(1.5d epoch 8 query_epoch 8) v3 -- ?+0 0x1ee9a00 -9337> 2012-10-11 13:43:50.724800 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.5d 0x2adb230)/0x2adb230 -9336> 2012-10-11 13:43:50.724804 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9335> 2012-10-11 13:43:50.724805 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9334> 2012-10-11 13:43:50.724806 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3939 0x1e41a20 -9333> 2012-10-11 13:43:50.724809 7f4402228700 5 journal submit_entry seq 3939 len 926 (0x292e090) -9332> 2012-10-11 13:43:50.724810 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9331> 2012-10-11 13:43:50.724812 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9330> 2012-10-11 13:43:50.724834 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(1.66 epoch 8 query_epoch 8) v3 -- ?+0 0x1ee9500 -9329> 2012-10-11 13:43:50.724865 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.66 0x2adb480)/0x2adb480 -9328> 2012-10-11 13:43:50.724868 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9327> 2012-10-11 13:43:50.724869 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9326> 2012-10-11 13:43:50.724870 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3940 0x1e41240 -9325> 2012-10-11 13:43:50.724873 7f4402228700 5 journal submit_entry seq 3940 len 926 (0x3419450) -9324> 2012-10-11 13:43:50.724875 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9323> 2012-10-11 13:43:50.724876 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9322> 2012-10-11 13:43:50.724898 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(1.67 epoch 8 query_epoch 8) v3 -- ?+0 0x1ee9000 -9321> 2012-10-11 13:43:50.724928 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.67 0x2adb450)/0x2adb450 -9320> 2012-10-11 13:43:50.724932 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9319> 2012-10-11 13:43:50.724933 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9318> 2012-10-11 13:43:50.724934 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3941 0x1e415a0 -9317> 2012-10-11 13:43:50.724937 7f4402228700 5 journal submit_entry seq 3941 len 926 (0x30a1c00) -9316> 2012-10-11 13:43:50.724938 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9315> 2012-10-11 13:43:50.724940 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9314> 2012-10-11 13:43:50.724964 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(2.5b epoch 8 query_epoch 8) v3 -- ?+0 0x2fb3a00 -9313> 2012-10-11 13:43:50.724993 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.5b 0x2130170)/0x2130170 -9312> 2012-10-11 13:43:50.724996 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9311> 2012-10-11 13:43:50.724998 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9310> 2012-10-11 13:43:50.724999 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3942 0x1e41750 -9309> 2012-10-11 13:43:50.725002 7f4402228700 5 journal submit_entry seq 3942 len 926 (0x2ab5150) -9308> 2012-10-11 13:43:50.725004 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9307> 2012-10-11 13:43:50.725005 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9306> 2012-10-11 13:43:50.725028 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(2.5c epoch 8 query_epoch 8) v3 -- ?+0 0x2fb3500 -9305> 2012-10-11 13:43:50.725056 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.5c 0x2130250)/0x2130250 -9304> 2012-10-11 13:43:50.725060 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9303> 2012-10-11 13:43:50.725061 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9302> 2012-10-11 13:43:50.725062 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3943 0x1e41e10 -9301> 2012-10-11 13:43:50.725065 7f4402228700 5 journal submit_entry seq 3943 len 926 (0x292e420) -9300> 2012-10-11 13:43:50.725067 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9299> 2012-10-11 13:43:50.725068 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9298> 2012-10-11 13:43:50.725091 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(2.65 epoch 8 query_epoch 8) v3 -- ?+0 0x2fb3000 -9297> 2012-10-11 13:43:50.725119 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.65 0x21305b0)/0x21305b0 -9296> 2012-10-11 13:43:50.725123 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9295> 2012-10-11 13:43:50.725124 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9294> 2012-10-11 13:43:50.725125 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3944 0x22b9ab0 -9293> 2012-10-11 13:43:50.725128 7f4402228700 5 journal submit_entry seq 3944 len 926 (0x322e420) -9292> 2012-10-11 13:43:50.725130 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9291> 2012-10-11 13:43:50.725131 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9290> 2012-10-11 13:43:50.725154 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(2.66 epoch 8 query_epoch 8) v3 -- ?+0 0x2633a00 -9289> 2012-10-11 13:43:50.725182 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.66 0x21302e0)/0x21302e0 -9288> 2012-10-11 13:43:50.725185 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9287> 2012-10-11 13:43:50.725186 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9286> 2012-10-11 13:43:50.725187 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3945 0x22b9ea0 -9285> 2012-10-11 13:43:50.725191 7f4402228700 5 journal submit_entry seq 3945 len 926 (0x2ffdea0) -9284> 2012-10-11 13:43:50.725192 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9283> 2012-10-11 13:43:50.725194 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9282> 2012-10-11 13:43:50.725228 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.57 0x3176880)/0x3176880 -9281> 2012-10-11 13:43:50.725233 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9280> 2012-10-11 13:43:50.725234 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9279> 2012-10-11 13:43:50.725235 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3946 0x22b9cf0 -9278> 2012-10-11 13:43:50.725238 7f4402228700 5 journal submit_entry seq 3946 len 926 (0x1ee57b0) -9277> 2012-10-11 13:43:50.725240 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9276> 2012-10-11 13:43:50.725242 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9275> 2012-10-11 13:43:50.724644 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.aa 0x2e383c0)/0x2e383c0 -9274> 2012-10-11 13:43:50.725275 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9273> 2012-10-11 13:43:50.725278 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9272> 2012-10-11 13:43:50.725281 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3947 0x2a267e0 -9271> 2012-10-11 13:43:50.725284 7f440532f700 5 journal submit_entry seq 3947 len 204 (0x2ffd1b0) -9270> 2012-10-11 13:43:50.725286 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9269> 2012-10-11 13:43:50.725287 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9268> 2012-10-11 13:43:50.725309 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1385, time: 2012-10-11 13:43:50.725309, event: done, request: osd pg remove(epoch 7; pg1.aa; ) v1 -9267> 2012-10-11 13:43:50.725324 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 123739) -9266> 2012-10-11 13:43:50.725327 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 854 ==== osd pg remove(epoch 7; pg1.dd; ) v1 ==== 25+0+0 (1570358741 0 0) 0x1eb4e00 con 0x2fe2140 -9265> 2012-10-11 13:43:50.725338 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1386, time: 2012-10-11 13:43:48.854825, event: header_read, request: osd pg remove(epoch 7; pg1.dd; ) v1 -9264> 2012-10-11 13:43:50.725344 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1386, time: 2012-10-11 13:43:48.854827, event: throttled, request: osd pg remove(epoch 7; pg1.dd; ) v1 -9263> 2012-10-11 13:43:50.725348 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1386, time: 2012-10-11 13:43:48.854832, event: all_read, request: osd pg remove(epoch 7; pg1.dd; ) v1 -9262> 2012-10-11 13:43:50.725352 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1386, time: 2012-10-11 13:43:50.725337, event: dispatched, request: osd pg remove(epoch 7; pg1.dd; ) v1 -9261> 2012-10-11 13:43:50.725357 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1386, time: 2012-10-11 13:43:50.725357, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.dd; ) v1 -9260> 2012-10-11 13:43:50.725363 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1386, time: 2012-10-11 13:43:50.725363, event: started, request: osd pg remove(epoch 7; pg1.dd; ) v1 -9259> 2012-10-11 13:43:50.725368 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.dd -9258> 2012-10-11 13:43:50.725384 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.dd 0x2e38a30)/0x2e38a30 -9257> 2012-10-11 13:43:50.725389 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9256> 2012-10-11 13:43:50.725390 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9264> 2012-10-11 13:43:50.725391 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3948 0x3074ab0 -9263> 2012-10-11 13:43:50.725395 7f440532f700 5 journal submit_entry seq 3948 len 204 (0x2e65720) -9262> 2012-10-11 13:43:50.725396 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9261> 2012-10-11 13:43:50.725398 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9260> 2012-10-11 13:43:50.725412 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1386, time: 2012-10-11 13:43:50.725412, event: done, request: osd pg remove(epoch 7; pg1.dd; ) v1 -9259> 2012-10-11 13:43:50.725422 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 123714) -9258> 2012-10-11 13:43:50.725426 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 510 ==== osd pg remove(epoch 7; pg1.a8; ) v1 ==== 25+0+0 (2798558592 0 0) 0x31ace00 con 0x2fe2280 -9257> 2012-10-11 13:43:50.725435 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1387, time: 2012-10-11 13:43:49.232354, event: header_read, request: osd pg remove(epoch 7; pg1.a8; ) v1 -9256> 2012-10-11 13:43:50.725440 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1387, time: 2012-10-11 13:43:49.232356, event: throttled, request: osd pg remove(epoch 7; pg1.a8; ) v1 -9256> 2012-10-11 13:43:50.725445 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1387, time: 2012-10-11 13:43:49.232374, event: all_read, request: osd pg remove(epoch 7; pg1.a8; ) v1 -9255> 2012-10-11 13:43:50.725449 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1387, time: 2012-10-11 13:43:50.725433, event: dispatched, request: osd pg remove(epoch 7; pg1.a8; ) v1 -9254> 2012-10-11 13:43:50.725454 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1387, time: 2012-10-11 13:43:50.725454, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.a8; ) v1 -9253> 2012-10-11 13:43:50.725460 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1387, time: 2012-10-11 13:43:50.725460, event: started, request: osd pg remove(epoch 7; pg1.a8; ) v1 -9252> 2012-10-11 13:43:50.725482 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.a8 -9251> 2012-10-11 13:43:50.725506 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.4e 0x2130060)/0x2130060 -9250> 2012-10-11 13:43:50.725512 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9249> 2012-10-11 13:43:50.725515 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9248> 2012-10-11 13:43:50.725518 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3949 0x22b9c60 -9247> 2012-10-11 13:43:50.725521 7f4402228700 5 journal submit_entry seq 3949 len 926 (0x2b10000) -9246> 2012-10-11 13:43:50.725525 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9245> 2012-10-11 13:43:50.725526 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9244> 2012-10-11 13:43:50.725511 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.a8 0x2e38020)/0x2e38020 -9243> 2012-10-11 13:43:50.725541 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9242> 2012-10-11 13:43:50.725548 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9241> 2012-10-11 13:43:50.725555 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3950 0x3074750 -9240> 2012-10-11 13:43:50.725560 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.4c 0x31767c0)/0x31767c0 -9239> 2012-10-11 13:43:50.725568 7f440532f700 5 journal submit_entry seq 3950 len 204 (0x3056720) -9238> 2012-10-11 13:43:50.727436 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 549 (123714 -> 124263) -9237> 2012-10-11 13:43:50.727469 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 549 (124263 -> 124812) -9236> 2012-10-11 13:43:50.727557 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.b3 epoch 8 query_epoch 7) v3 -- ?+0 0x2f64500 -9235> 2012-10-11 13:43:50.727607 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.0 epoch 8 query_epoch 8) v3 -- ?+0 0x2f64a00 -9234> 2012-10-11 13:43:50.727638 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.0 0x1d71280)/0x1d71280 -9233> 2012-10-11 13:43:50.725565 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9232> 2012-10-11 13:43:50.727652 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9231> 2012-10-11 13:43:50.727657 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9230> 2012-10-11 13:43:50.727666 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9229> 2012-10-11 13:43:50.727674 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9228> 2012-10-11 13:43:50.727680 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3951 0x22b9b40 -9227> 2012-10-11 13:43:50.727697 7f4402228700 5 journal submit_entry seq 3951 len 926 (0x2827750) -9226> 2012-10-11 13:43:50.727693 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1387, time: 2012-10-11 13:43:50.727693, event: done, request: osd pg remove(epoch 7; pg1.a8; ) v1 -9225> 2012-10-11 13:43:50.727706 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9224> 2012-10-11 13:43:50.727713 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9223> 2012-10-11 13:43:50.727714 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124787) -9222> 2012-10-11 13:43:50.727721 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9221> 2012-10-11 13:43:50.727726 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 855 ==== osd pg remove(epoch 7; pg1.de; ) v1 ==== 25+0+0 (2262647484 0 0) 0x1eb4c40 con 0x2fe2140 -9220> 2012-10-11 13:43:50.727739 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1388, time: 2012-10-11 13:43:48.854834, event: header_read, request: osd pg remove(epoch 7; pg1.de; ) v1 -9219> 2012-10-11 13:43:50.727745 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1388, time: 2012-10-11 13:43:48.854836, event: throttled, request: osd pg remove(epoch 7; pg1.de; ) v1 -9218> 2012-10-11 13:43:50.727750 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1388, time: 2012-10-11 13:43:48.854839, event: all_read, request: osd pg remove(epoch 7; pg1.de; ) v1 -9217> 2012-10-11 13:43:50.727755 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1388, time: 2012-10-11 13:43:50.727737, event: dispatched, request: osd pg remove(epoch 7; pg1.de; ) v1 -9216> 2012-10-11 13:43:50.727760 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1388, time: 2012-10-11 13:43:50.727760, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.de; ) v1 -9215> 2012-10-11 13:43:50.727767 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1388, time: 2012-10-11 13:43:50.727767, event: started, request: osd pg remove(epoch 7; pg1.de; ) v1 -9214> 2012-10-11 13:43:50.727772 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.de -9213> 2012-10-11 13:43:50.727787 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.4d 0x2adb130)/0x2adb130 -9212> 2012-10-11 13:43:50.727799 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9211> 2012-10-11 13:43:50.727788 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.de 0x2e38a00)/0x2e38a00 -9210> 2012-10-11 13:43:50.727800 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9209> 2012-10-11 13:43:50.727803 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9208> 2012-10-11 13:43:50.727806 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9207> 2012-10-11 13:43:50.727794 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3952 0x2cdab40 -9206> 2012-10-11 13:43:50.727815 7f4402a29700 5 journal submit_entry seq 3952 len 963 (0x29c6660) -9205> 2012-10-11 13:43:50.727818 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9204> 2012-10-11 13:43:50.727821 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -9203> 2012-10-11 13:43:50.727849 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.1 epoch 8 query_epoch 8) v3 -- ?+0 0x28a7000 -9202> 2012-10-11 13:43:50.727883 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.1 0x1d71260)/0x1d71260 -9201> 2012-10-11 13:43:50.727888 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9200> 2012-10-11 13:43:50.727890 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9199> 2012-10-11 13:43:50.727891 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3953 0x31cbc60 -9198> 2012-10-11 13:43:50.727894 7f4402a29700 5 journal submit_entry seq 3953 len 963 (0x2553c00) -9197> 2012-10-11 13:43:50.727896 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9196> 2012-10-11 13:43:50.727897 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -9195> 2012-10-11 13:43:50.727922 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.a epoch 8 query_epoch 8) v3 -- ?+0 0x28a7500 -9194> 2012-10-11 13:43:50.727951 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a 0x1d714c0)/0x1d714c0 -9193> 2012-10-11 13:43:50.727956 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9192> 2012-10-11 13:43:50.727957 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9191> 2012-10-11 13:43:50.727958 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3954 0x2cdac60 -9190> 2012-10-11 13:43:50.727961 7f4402a29700 5 journal submit_entry seq 3954 len 963 (0x2f0ec90) -9189> 2012-10-11 13:43:50.727964 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9188> 2012-10-11 13:43:50.727966 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -9187> 2012-10-11 13:43:50.727990 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.b epoch 8 query_epoch 8) v3 -- ?+0 0x28a7a00 -9186> 2012-10-11 13:43:50.728018 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.b 0x1d71490)/0x1d71490 -9185> 2012-10-11 13:43:50.728024 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9184> 2012-10-11 13:43:50.728025 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9183> 2012-10-11 13:43:50.728026 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3955 0x3250000 -9182> 2012-10-11 13:43:50.728030 7f4402a29700 5 journal submit_entry seq 3955 len 963 (0x296f2d0) -9181> 2012-10-11 13:43:50.728032 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9180> 2012-10-11 13:43:50.728034 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -9179> 2012-10-11 13:43:50.728063 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.c epoch 8 query_epoch 8) v3 -- ?+0 0x28a6000 -9178> 2012-10-11 13:43:50.728092 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.c 0x1d71460)/0x1d71460 -9177> 2012-10-11 13:43:50.728096 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9176> 2012-10-11 13:43:50.728098 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9175> 2012-10-11 13:43:50.728099 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3956 0x3250120 -9174> 2012-10-11 13:43:50.728102 7f4402a29700 5 journal submit_entry seq 3956 len 963 (0x2a16b10) -9173> 2012-10-11 13:43:50.728104 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9172> 2012-10-11 13:43:50.728106 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -9171> 2012-10-11 13:43:50.728134 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.e1 epoch 8 query_epoch 8) v3 -- ?+0 0x28a6500 -9170> 2012-10-11 13:43:50.728163 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.e1 0x2468d70)/0x2468d70 -9169> 2012-10-11 13:43:50.728168 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9168> 2012-10-11 13:43:50.728169 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9167> 2012-10-11 13:43:50.728170 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3957 0x250e090 -9166> 2012-10-11 13:43:50.728173 7f4402a29700 5 journal submit_entry seq 3957 len 969 (0x2c78c90) -9165> 2012-10-11 13:43:50.728175 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9164> 2012-10-11 13:43:50.728177 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9163> 2012-10-11 13:43:50.728201 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.e2 epoch 8 query_epoch 8) v3 -- ?+0 0x28a6a00 -9162> 2012-10-11 13:43:50.728229 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.e2 0x2468d40)/0x2468d40 -9161> 2012-10-11 13:43:50.728234 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9160> 2012-10-11 13:43:50.728236 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9159> 2012-10-11 13:43:50.728237 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3958 0x250ef30 -9158> 2012-10-11 13:43:50.728241 7f4402a29700 5 journal submit_entry seq 3958 len 969 (0x2c1ff60) -9157> 2012-10-11 13:43:50.728243 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9156> 2012-10-11 13:43:50.728246 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9155> 2012-10-11 13:43:50.728274 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.e9 epoch 8 query_epoch 8) v3 -- ?+0 0x2014000 -9154> 2012-10-11 13:43:50.728303 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.e9 0x2468ff0)/0x2468ff0 -9153> 2012-10-11 13:43:50.728308 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9152> 2012-10-11 13:43:50.728309 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9151> 2012-10-11 13:43:50.728310 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3959 0x250e990 -9160> 2012-10-11 13:43:50.728313 7f4402a29700 5 journal submit_entry seq 3959 len 969 (0x3235900) -9159> 2012-10-11 13:43:50.728316 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9158> 2012-10-11 13:43:50.728317 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9157> 2012-10-11 13:43:50.728342 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.ec epoch 8 query_epoch 8) v3 -- ?+0 0x28caa00 -9156> 2012-10-11 13:43:50.728374 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.ec 0x2468f60)/0x2468f60 -9155> 2012-10-11 13:43:50.728379 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9154> 2012-10-11 13:43:50.728380 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9153> 2012-10-11 13:43:50.728381 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3960 0x250e480 -9152> 2012-10-11 13:43:50.728386 7f4402a29700 5 journal submit_entry seq 3960 len 969 (0x1fee540) -9151> 2012-10-11 13:43:50.728388 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9150> 2012-10-11 13:43:50.728390 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9149> 2012-10-11 13:43:50.728416 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.ed epoch 8 query_epoch 8) v3 -- ?+0 0x28ca500 -9148> 2012-10-11 13:43:50.728447 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.ed 0x2468f30)/0x2468f30 -9147> 2012-10-11 13:43:50.728452 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9146> 2012-10-11 13:43:50.728454 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9145> 2012-10-11 13:43:50.728456 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3961 0x250ea20 -9144> 2012-10-11 13:43:50.728460 7f4402a29700 5 journal submit_entry seq 3961 len 969 (0x28a87e0) -9143> 2012-10-11 13:43:50.728462 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9144> 2012-10-11 13:43:50.728464 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9148> 2012-10-11 13:43:50.728491 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.f8 epoch 8 query_epoch 8) v3 -- ?+0 0x28ca000 -9147> 2012-10-11 13:43:50.728520 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.f8 0x27a1120)/0x27a1120 -9146> 2012-10-11 13:43:50.728525 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9146> 2012-10-11 13:43:50.728526 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9145> 2012-10-11 13:43:50.728529 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3962 0x250e3f0 -9144> 2012-10-11 13:43:50.728532 7f4402a29700 5 journal submit_entry seq 3962 len 969 (0x320bdb0) -9143> 2012-10-11 13:43:50.728534 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9142> 2012-10-11 13:43:50.728536 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9141> 2012-10-11 13:43:50.728561 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.fd epoch 8 query_epoch 8) v3 -- ?+0 0x2e3da00 -9140> 2012-10-11 13:43:50.728589 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.fd 0x27a1030)/0x27a1030 -9141> 2012-10-11 13:43:50.728594 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9140> 2012-10-11 13:43:50.728595 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9139> 2012-10-11 13:43:50.728596 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3963 0x2a26d80 -9138> 2012-10-11 13:43:50.728600 7f4402a29700 5 journal submit_entry seq 3963 len 969 (0x30561e0) -9137> 2012-10-11 13:43:50.728603 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9136> 2012-10-11 13:43:50.728604 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9135> 2012-10-11 13:43:50.728632 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.0 epoch 8 query_epoch 8) v3 -- ?+0 0x2e3d500 -9134> 2012-10-11 13:43:50.728660 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.0 0x27a13a0)/0x27a13a0 -9133> 2012-10-11 13:43:50.728665 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9132> 2012-10-11 13:43:50.728667 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9131> 2012-10-11 13:43:50.728668 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3964 0x2a26990 -9130> 2012-10-11 13:43:50.728671 7f4402a29700 5 journal submit_entry seq 3964 len 963 (0x20ad090) -9129> 2012-10-11 13:43:50.728674 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9128> 2012-10-11 13:43:50.728675 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -9127> 2012-10-11 13:43:50.728699 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.9 epoch 8 query_epoch 8) v3 -- ?+0 0x2e3d000 -9126> 2012-10-11 13:43:50.728728 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.9 0x27a15f0)/0x27a15f0 -9125> 2012-10-11 13:43:50.728733 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9124> 2012-10-11 13:43:50.728734 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9123> 2012-10-11 13:43:50.728737 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3965 0x2a26b40 -9122> 2012-10-11 13:43:50.728740 7f4402a29700 5 journal submit_entry seq 3965 len 963 (0x20adae0) -9121> 2012-10-11 13:43:50.728742 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9120> 2012-10-11 13:43:50.728744 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -9119> 2012-10-11 13:43:50.728768 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.a epoch 8 query_epoch 8) v3 -- ?+0 0x2445a00 -9118> 2012-10-11 13:43:50.728796 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.a 0x27a15c0)/0x27a15c0 -9117> 2012-10-11 13:43:50.728801 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9116> 2012-10-11 13:43:50.728804 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9115> 2012-10-11 13:43:50.728806 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3966 0x2a26cf0 -9114> 2012-10-11 13:43:50.728809 7f4402a29700 5 journal submit_entry seq 3966 len 963 (0x2922a20) -9113> 2012-10-11 13:43:50.728811 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9112> 2012-10-11 13:43:50.728813 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -9111> 2012-10-11 13:43:50.728839 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.b epoch 8 query_epoch 8) v3 -- ?+0 0x2445500 -9110> 2012-10-11 13:43:50.728874 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.b 0x27a1590)/0x27a1590 -9109> 2012-10-11 13:43:50.728887 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3967 0x22b9750 -9108> 2012-10-11 13:43:50.728879 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9107> 2012-10-11 13:43:50.728892 7f4402228700 5 journal submit_entry seq 3967 len 926 (0x28980f0) -9106> 2012-10-11 13:43:50.728897 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9105> 2012-10-11 13:43:50.728917 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9104> 2012-10-11 13:43:50.728922 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9103> 2012-10-11 13:43:50.728930 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3968 0x3074870 -9102> 2012-10-11 13:43:50.728939 7f440532f700 5 journal submit_entry seq 3968 len 204 (0x2e65ae0) -9101> 2012-10-11 13:43:50.728941 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9100> 2012-10-11 13:43:50.728942 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9099> 2012-10-11 13:43:50.728959 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.38 0x3176670)/0x3176670 -9098> 2012-10-11 13:43:50.728964 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9097> 2012-10-11 13:43:50.728966 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9096> 2012-10-11 13:43:50.728968 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3969 0x2bd6120 -9095> 2012-10-11 13:43:50.728966 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1388, time: 2012-10-11 13:43:50.728966, event: done, request: osd pg remove(epoch 7; pg1.de; ) v1 -9094> 2012-10-11 13:43:50.728972 7f4402228700 5 journal submit_entry seq 3969 len 926 (0x341cc90) -9093> 2012-10-11 13:43:50.728974 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9092> 2012-10-11 13:43:50.728975 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9091> 2012-10-11 13:43:50.728977 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124762) -9090> 2012-10-11 13:43:50.728982 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 511 ==== osd pg remove(epoch 7; pg1.a5; ) v1 ==== 25+0+0 (2362730000 0 0) 0x31acc40 con 0x2fe2280 -9089> 2012-10-11 13:43:50.728992 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1389, time: 2012-10-11 13:43:49.232378, event: header_read, request: osd pg remove(epoch 7; pg1.a5; ) v1 -9088> 2012-10-11 13:43:50.728997 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.39 0x27a1cf0)/0x27a1cf0 -9087> 2012-10-11 13:43:50.729001 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9086> 2012-10-11 13:43:50.728998 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1389, time: 2012-10-11 13:43:49.232381, event: throttled, request: osd pg remove(epoch 7; pg1.a5; ) v1 -9085> 2012-10-11 13:43:50.729002 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9084> 2012-10-11 13:43:50.729003 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3970 0x2bd65a0 -9083> 2012-10-11 13:43:50.729002 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1389, time: 2012-10-11 13:43:49.232384, event: all_read, request: osd pg remove(epoch 7; pg1.a5; ) v1 -9082> 2012-10-11 13:43:50.729007 7f4402228700 5 journal submit_entry seq 3970 len 926 (0x341cb40) -9081> 2012-10-11 13:43:50.729006 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1389, time: 2012-10-11 13:43:50.728991, event: dispatched, request: osd pg remove(epoch 7; pg1.a5; ) v1 -9080> 2012-10-11 13:43:50.729009 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9079> 2012-10-11 13:43:50.729011 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9078> 2012-10-11 13:43:50.729010 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1389, time: 2012-10-11 13:43:50.729010, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.a5; ) v1 -9077> 2012-10-11 13:43:50.729015 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1389, time: 2012-10-11 13:43:50.729015, event: started, request: osd pg remove(epoch 7; pg1.a5; ) v1 -9076> 2012-10-11 13:43:50.729020 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.a5 -9075> 2012-10-11 13:43:50.729034 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.3a 0x1d71d30)/0x1d71d30 -9074> 2012-10-11 13:43:50.729041 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9073> 2012-10-11 13:43:50.729040 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3971 0x2a262d0 -9072> 2012-10-11 13:43:50.729044 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9071> 2012-10-11 13:43:50.729047 7f4402a29700 5 journal submit_entry seq 3971 len 1094 (0x25a30f0) -9070> 2012-10-11 13:43:50.729051 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9069> 2012-10-11 13:43:50.729052 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 1094 -9068> 2012-10-11 13:43:50.729061 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3972 0x2bd67e0 -9067> 2012-10-11 13:43:50.729067 7f4402228700 5 journal submit_entry seq 3972 len 926 (0x341cf60) -9066> 2012-10-11 13:43:50.729070 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9065> 2012-10-11 13:43:50.729072 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9064> 2012-10-11 13:43:50.729087 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.da epoch 8 query_epoch 8) v3 -- ?+0 0x2445000 -9063> 2012-10-11 13:43:50.729112 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.68 0x21303d0)/0x21303d0 -9062> 2012-10-11 13:43:50.729118 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9061> 2012-10-11 13:43:50.729119 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9060> 2012-10-11 13:43:50.729120 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3973 0x2bd6b40 -9059> 2012-10-11 13:43:50.729120 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.da 0x2e38ac0)/0x2e38ac0 -9058> 2012-10-11 13:43:50.729124 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9057> 2012-10-11 13:43:50.729129 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9056> 2012-10-11 13:43:50.729124 7f4402228700 5 journal submit_entry seq 3973 len 926 (0x1e86930) -9055> 2012-10-11 13:43:50.729035 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.a5 0x2e380b0)/0x2e380b0 -9054> 2012-10-11 13:43:50.729136 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9062> 2012-10-11 13:43:50.729141 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9061> 2012-10-11 13:43:50.729145 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9060> 2012-10-11 13:43:50.729150 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9059> 2012-10-11 13:43:50.729152 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3974 0x3074900 -9058> 2012-10-11 13:43:50.729155 7f440532f700 5 journal submit_entry seq 3974 len 204 (0x3056f30) -9057> 2012-10-11 13:43:50.729158 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9056> 2012-10-11 13:43:50.729159 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9055> 2012-10-11 13:43:50.729169 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.6a 0x2130720)/0x2130720 -9055> 2012-10-11 13:43:50.729173 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9054> 2012-10-11 13:43:50.729175 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9053> 2012-10-11 13:43:50.729176 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3975 0x2bd6cf0 -9052> 2012-10-11 13:43:50.729180 7f4402228700 5 journal submit_entry seq 3975 len 926 (0x314e0f0) -9051> 2012-10-11 13:43:50.729182 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9050> 2012-10-11 13:43:50.729177 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1389, time: 2012-10-11 13:43:50.729177, event: done, request: osd pg remove(epoch 7; pg1.a5; ) v1 -9049> 2012-10-11 13:43:50.729184 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9048> 2012-10-11 13:43:50.729192 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124737) -9047> 2012-10-11 13:43:50.729195 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 856 ==== osd pg remove(epoch 7; pg1.df; ) v1 ==== 25+0+0 (3487645595 0 0) 0x1eb4a80 con 0x2fe2140 -9046> 2012-10-11 13:43:50.729205 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1390, time: 2012-10-11 13:43:48.854842, event: header_read, request: osd pg remove(epoch 7; pg1.df; ) v1 -9045> 2012-10-11 13:43:50.729210 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1390, time: 2012-10-11 13:43:48.854844, event: throttled, request: osd pg remove(epoch 7; pg1.df; ) v1 -9044> 2012-10-11 13:43:50.729214 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1390, time: 2012-10-11 13:43:48.854848, event: all_read, request: osd pg remove(epoch 7; pg1.df; ) v1 -9043> 2012-10-11 13:43:50.729217 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.69 0x2adb7f0)/0x2adb7f0 -9042> 2012-10-11 13:43:50.729220 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9041> 2012-10-11 13:43:50.729222 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9040> 2012-10-11 13:43:50.729219 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1390, time: 2012-10-11 13:43:50.729204, event: dispatched, request: osd pg remove(epoch 7; pg1.df; ) v1 -9039> 2012-10-11 13:43:50.729223 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3976 0x2f21510 -9038> 2012-10-11 13:43:50.729226 7f4402228700 5 journal submit_entry seq 3976 len 926 (0x216e570) -9037> 2012-10-11 13:43:50.729232 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9036> 2012-10-11 13:43:50.729224 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1390, time: 2012-10-11 13:43:50.729224, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.df; ) v1 -9035> 2012-10-11 13:43:50.729234 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9034> 2012-10-11 13:43:50.729239 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1390, time: 2012-10-11 13:43:50.729239, event: started, request: osd pg remove(epoch 7; pg1.df; ) v1 -9033> 2012-10-11 13:43:50.729244 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.df -9032> 2012-10-11 13:43:50.729267 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.df 0x2e38dd0)/0x2e38dd0 -9031> 2012-10-11 13:43:50.729272 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9030> 2012-10-11 13:43:50.729274 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9029> 2012-10-11 13:43:50.729276 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3977 0x3074510 -9028> 2012-10-11 13:43:50.729277 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.61 0x21305a0)/0x21305a0 -9027> 2012-10-11 13:43:50.729279 7f440532f700 5 journal submit_entry seq 3977 len 204 (0x2e65480) -9026> 2012-10-11 13:43:50.729284 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -9025> 2012-10-11 13:43:50.729295 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -9024> 2012-10-11 13:43:50.729297 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -9023> 2012-10-11 13:43:50.729300 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -9022> 2012-10-11 13:43:50.729309 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3978 0x2a265a0 -9021> 2012-10-11 13:43:50.729315 7f4402a29700 5 journal submit_entry seq 3978 len 969 (0x23884e0) -9020> 2012-10-11 13:43:50.729318 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9019> 2012-10-11 13:43:50.729319 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9018> 2012-10-11 13:43:50.729319 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1390, time: 2012-10-11 13:43:50.729319, event: done, request: osd pg remove(epoch 7; pg1.df; ) v1 -9017> 2012-10-11 13:43:50.729331 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124712) -9016> 2012-10-11 13:43:50.729334 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 512 ==== osd pg remove(epoch 7; pg1.a2; ) v1 ==== 25+0+0 (1988977428 0 0) 0x31aca80 con 0x2fe2280 -9015> 2012-10-11 13:43:50.729344 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1391, time: 2012-10-11 13:43:49.232386, event: header_read, request: osd pg remove(epoch 7; pg1.a2; ) v1 -9014> 2012-10-11 13:43:50.729350 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1391, time: 2012-10-11 13:43:49.232388, event: throttled, request: osd pg remove(epoch 7; pg1.a2; ) v1 -9013> 2012-10-11 13:43:50.729355 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1391, time: 2012-10-11 13:43:49.232402, event: all_read, request: osd pg remove(epoch 7; pg1.a2; ) v1 -9012> 2012-10-11 13:43:50.729354 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.e0 epoch 8 query_epoch 8) v3 -- ?+0 0x2d9ea00 -9011> 2012-10-11 13:43:50.729362 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1391, time: 2012-10-11 13:43:50.729343, event: dispatched, request: osd pg remove(epoch 7; pg1.a2; ) v1 -9010> 2012-10-11 13:43:50.729368 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1391, time: 2012-10-11 13:43:50.729367, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.a2; ) v1 -9009> 2012-10-11 13:43:50.729373 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1391, time: 2012-10-11 13:43:50.729373, event: started, request: osd pg remove(epoch 7; pg1.a2; ) v1 -9008> 2012-10-11 13:43:50.729377 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.a2 -9007> 2012-10-11 13:43:50.729388 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.e0 0x2e38da0)/0x2e38da0 -9006> 2012-10-11 13:43:50.729390 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.a2 0x2e38140)/0x2e38140 -9005> 2012-10-11 13:43:50.729393 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -9004> 2012-10-11 13:43:50.729397 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -9003> 2012-10-11 13:43:50.729399 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3979 0x2a26f30 -9002> 2012-10-11 13:43:50.729403 7f4402a29700 5 journal submit_entry seq 3979 len 969 (0x2c78000) -9008> 2012-10-11 13:43:50.729402 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -9007> 2012-10-11 13:43:50.729412 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -9007> 2012-10-11 13:43:50.729414 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -9006> 2012-10-11 13:43:50.729417 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -9005> 2012-10-11 13:43:50.729424 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3980 0x2f21000 -9004> 2012-10-11 13:43:50.729430 7f4402228700 5 journal submit_entry seq 3980 len 926 (0x341ce10) -9003> 2012-10-11 13:43:50.729433 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -9002> 2012-10-11 13:43:50.729434 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -9001> 2012-10-11 13:43:50.729442 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3981 0x3074e10 -9000> 2012-10-11 13:43:50.729444 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.e1 epoch 8 query_epoch 8) v3 -- ?+0 0x2d9e500 -8999> 2012-10-11 13:43:50.729459 7f440532f700 5 journal submit_entry seq 3981 len 204 (0x3056d50) -8998> 2012-10-11 13:43:50.729465 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.60 0x2adb5a0)/0x2adb5a0 -8999> 2012-10-11 13:43:50.729467 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8998> 2012-10-11 13:43:50.729476 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8997> 2012-10-11 13:43:50.729484 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -8996> 2012-10-11 13:43:50.729494 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -8995> 2012-10-11 13:43:50.729497 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.e1 0x2e38d70)/0x2e38d70 -8994> 2012-10-11 13:43:50.729502 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8993> 2012-10-11 13:43:50.729504 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8992> 2012-10-11 13:43:50.729517 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3982 0x2f21f30 -8991> 2012-10-11 13:43:50.729523 7f4402228700 5 journal submit_entry seq 3982 len 926 (0x1e3f510) -8990> 2012-10-11 13:43:50.729524 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -8989> 2012-10-11 13:43:50.729527 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -8988> 2012-10-11 13:43:50.729535 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3983 0x2a26090 -8987> 2012-10-11 13:43:50.729534 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1391, time: 2012-10-11 13:43:50.729533, event: done, request: osd pg remove(epoch 7; pg1.a2; ) v1 -8986> 2012-10-11 13:43:50.729547 7f4402a29700 5 journal submit_entry seq 3983 len 969 (0x22d4a50) -8985> 2012-10-11 13:43:50.729553 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8984> 2012-10-11 13:43:50.729554 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8983> 2012-10-11 13:43:50.729547 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124687) -8982> 2012-10-11 13:43:50.729554 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.5d 0x2130200)/0x2130200 -8981> 2012-10-11 13:43:50.729558 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -8980> 2012-10-11 13:43:50.729559 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -8979> 2012-10-11 13:43:50.729559 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 857 ==== osd pg remove(epoch 7; pg1.e3; ) v1 ==== 25+0+0 (632411393 0 0) 0x1eb48c0 con 0x2fe2140 -8978> 2012-10-11 13:43:50.729569 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3984 0x2f21a20 -8977> 2012-10-11 13:43:50.729573 7f4402228700 5 journal submit_entry seq 3984 len 926 (0x1e3f090) -8976> 2012-10-11 13:43:50.729572 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1392, time: 2012-10-11 13:43:48.854850, event: header_read, request: osd pg remove(epoch 7; pg1.e3; ) v1 -8975> 2012-10-11 13:43:50.729577 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -8974> 2012-10-11 13:43:50.729579 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -8973> 2012-10-11 13:43:50.729577 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1392, time: 2012-10-11 13:43:48.854852, event: throttled, request: osd pg remove(epoch 7; pg1.e3; ) v1 -8972> 2012-10-11 13:43:50.729583 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1392, time: 2012-10-11 13:43:48.854855, event: all_read, request: osd pg remove(epoch 7; pg1.e3; ) v1 -8971> 2012-10-11 13:43:50.729587 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1392, time: 2012-10-11 13:43:50.729571, event: dispatched, request: osd pg remove(epoch 7; pg1.e3; ) v1 -8970> 2012-10-11 13:43:50.729593 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1392, time: 2012-10-11 13:43:50.729593, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.e3; ) v1 -8969> 2012-10-11 13:43:50.729599 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1392, time: 2012-10-11 13:43:50.729599, event: started, request: osd pg remove(epoch 7; pg1.e3; ) v1 -8968> 2012-10-11 13:43:50.729605 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.e3 -8967> 2012-10-11 13:43:50.729604 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.5f 0x21302f0)/0x21302f0 -8966> 2012-10-11 13:43:50.729608 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -8965> 2012-10-11 13:43:50.729611 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -8964> 2012-10-11 13:43:50.729612 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3985 0x2f21990 -8963> 2012-10-11 13:43:50.729617 7f4402228700 5 journal submit_entry seq 3985 len 926 (0x26c17e0) -8962> 2012-10-11 13:43:50.729620 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -8961> 2012-10-11 13:43:50.729621 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -8960> 2012-10-11 13:43:50.729621 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.e3 0x2e38d10)/0x2e38d10 -8959> 2012-10-11 13:43:50.729632 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8958> 2012-10-11 13:43:50.729635 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8957> 2012-10-11 13:43:50.729636 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3986 0x3074630 -8956> 2012-10-11 13:43:50.729640 7f440532f700 5 journal submit_entry seq 3986 len 204 (0x2e13630) -8955> 2012-10-11 13:43:50.729642 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8954> 2012-10-11 13:43:50.729644 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8953> 2012-10-11 13:43:50.729647 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.5e 0x2adb200)/0x2adb200 -8952> 2012-10-11 13:43:50.729652 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -8951> 2012-10-11 13:43:50.729653 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -8950> 2012-10-11 13:43:50.729656 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3987 0x2f21360 -8949> 2012-10-11 13:43:50.729659 7f4402228700 5 journal submit_entry seq 3987 len 926 (0x2d6c600) -8948> 2012-10-11 13:43:50.729662 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -8947> 2012-10-11 13:43:50.729663 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -8946> 2012-10-11 13:43:50.729659 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.e8 epoch 8 query_epoch 8) v3 -- ?+0 0x2d9e000 -8945> 2012-10-11 13:43:50.729685 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.5f 0x31769c0)/0x31769c0 -8944> 2012-10-11 13:43:50.729688 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -8943> 2012-10-11 13:43:50.729689 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -8942> 2012-10-11 13:43:50.729690 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3988 0x2f21b40 -8941> 2012-10-11 13:43:50.729693 7f4402228700 5 journal submit_entry seq 3988 len 926 (0x33b03f0) -8940> 2012-10-11 13:43:50.729694 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -8939> 2012-10-11 13:43:50.729696 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -8938> 2012-10-11 13:43:50.729716 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.59 0x2130410)/0x2130410 -8937> 2012-10-11 13:43:50.729719 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -8936> 2012-10-11 13:43:50.729720 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -8935> 2012-10-11 13:43:50.729721 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3989 0x2f21c60 -8937> 2012-10-11 13:43:50.729724 7f4402228700 5 journal submit_entry seq 3989 len 926 (0x341ce70) -8937> 2012-10-11 13:43:50.729725 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -8939> 2012-10-11 13:43:50.729726 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -8938> 2012-10-11 13:43:50.729741 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.e8 0x2e38c20)/0x2e38c20 -8937> 2012-10-11 13:43:50.729748 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8936> 2012-10-11 13:43:50.729747 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.58 0x2adb320)/0x2adb320 -8936> 2012-10-11 13:43:50.729750 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8935> 2012-10-11 13:43:50.729751 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -8934> 2012-10-11 13:43:50.729751 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3990 0x2a261b0 -8933> 2012-10-11 13:43:50.729752 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -8934> 2012-10-11 13:43:50.729755 7f4402a29700 5 journal submit_entry seq 3990 len 969 (0x28a8300) -8933> 2012-10-11 13:43:50.729756 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8932> 2012-10-11 13:43:50.729758 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8931> 2012-10-11 13:43:50.729790 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.eb epoch 8 query_epoch 8) v3 -- ?+0 0x2888a00 -8930> 2012-10-11 13:43:50.729809 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3991 0x2f21ea0 -8929> 2012-10-11 13:43:50.729813 7f4402228700 5 journal submit_entry seq 3991 len 926 (0x1e3f600) -8928> 2012-10-11 13:43:50.729815 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -8927> 2012-10-11 13:43:50.729817 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 926 -8926> 2012-10-11 13:43:50.729672 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1392, time: 2012-10-11 13:43:50.729672, event: done, request: osd pg remove(epoch 7; pg1.e3; ) v1 -8925> 2012-10-11 13:43:50.730080 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.4f epoch 8 query_epoch 8) v3 -- ?+0 0x2935000 -8924> 2012-10-11 13:43:50.730102 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124662) -8923> 2012-10-11 13:43:50.730154 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.eb 0x2e38f90)/0x2e38f90 -8922> 2012-10-11 13:43:50.730161 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8921> 2012-10-11 13:43:50.730162 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8920> 2012-10-11 13:43:50.730164 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3992 0x2a26000 -8919> 2012-10-11 13:43:50.730169 7f4402a29700 5 journal submit_entry seq 3992 len 969 (0x2c1f7b0) -8918> 2012-10-11 13:43:50.730172 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8917> 2012-10-11 13:43:50.730175 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8916> 2012-10-11 13:43:50.730174 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 513 ==== osd pg remove(epoch 7; pg1.a3; ) v1 ==== 25+0+0 (1068572211 0 0) 0x31ac8c0 con 0x2fe2280 -8915> 2012-10-11 13:43:50.730191 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1393, time: 2012-10-11 13:43:49.232426, event: header_read, request: osd pg remove(epoch 7; pg1.a3; ) v1 -8914> 2012-10-11 13:43:50.730198 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1393, time: 2012-10-11 13:43:49.232432, event: throttled, request: osd pg remove(epoch 7; pg1.a3; ) v1 -8913> 2012-10-11 13:43:50.730203 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1393, time: 2012-10-11 13:43:49.232437, event: all_read, request: osd pg remove(epoch 7; pg1.a3; ) v1 -8912> 2012-10-11 13:43:50.730207 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1393, time: 2012-10-11 13:43:50.730189, event: dispatched, request: osd pg remove(epoch 7; pg1.a3; ) v1 -8911> 2012-10-11 13:43:50.730213 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1393, time: 2012-10-11 13:43:50.730212, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.a3; ) v1 -8910> 2012-10-11 13:43:50.730208 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.ec epoch 8 query_epoch 8) v3 -- ?+0 0x2888500 -8909> 2012-10-11 13:43:50.730219 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1393, time: 2012-10-11 13:43:50.730219, event: started, request: osd pg remove(epoch 7; pg1.a3; ) v1 -8908> 2012-10-11 13:43:50.730224 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.a3 -8907> 2012-10-11 13:43:50.730239 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.a3 0x2e38110)/0x2e38110 -8906> 2012-10-11 13:43:50.730244 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8905> 2012-10-11 13:43:50.730245 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8904> 2012-10-11 13:43:50.730247 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3993 0x3074360 -8903> 2012-10-11 13:43:50.730248 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ec 0x2e38f60)/0x2e38f60 -8902> 2012-10-11 13:43:50.730250 7f440532f700 5 journal submit_entry seq 3993 len 204 (0x30a1bd0) -8901> 2012-10-11 13:43:50.730252 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8900> 2012-10-11 13:43:50.730255 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8899> 2012-10-11 13:43:50.730272 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.4f 0x2adb0d0)/0x2adb0d0 -8898> 2012-10-11 13:43:50.730278 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -8897> 2012-10-11 13:43:50.730279 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -8896> 2012-10-11 13:43:50.730280 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3994 0x2f21240 -8895> 2012-10-11 13:43:50.730283 7f4402228700 5 journal submit_entry seq 3994 len 969 (0x23c77b0) -8894> 2012-10-11 13:43:50.730285 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -8893> 2012-10-11 13:43:50.730286 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8892> 2012-10-11 13:43:50.730313 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.4f epoch 8 query_epoch 8) v3 -- ?+0 0x2935500 -8891> 2012-10-11 13:43:50.730344 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.4f 0x2130050)/0x2130050 -8890> 2012-10-11 13:43:50.730340 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1393, time: 2012-10-11 13:43:50.730339, event: done, request: osd pg remove(epoch 7; pg1.a3; ) v1 -8889> 2012-10-11 13:43:50.730349 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -8888> 2012-10-11 13:43:50.730350 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -8887> 2012-10-11 13:43:50.730351 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3995 0x2f21480 -8886> 2012-10-11 13:43:50.730355 7f4402228700 5 journal submit_entry seq 3995 len 969 (0x331b660) -8885> 2012-10-11 13:43:50.730356 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -8884> 2012-10-11 13:43:50.730358 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8883> 2012-10-11 13:43:50.730353 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124637) -8882> 2012-10-11 13:43:50.730398 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 858 ==== osd pg remove(epoch 7; pg1.e5; ) v1 ==== 25+0+0 (2530520354 0 0) 0x1eb4700 con 0x2fe2140 -8881> 2012-10-11 13:43:50.730412 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1394, time: 2012-10-11 13:43:48.854858, event: header_read, request: osd pg remove(epoch 7; pg1.e5; ) v1 -8880> 2012-10-11 13:43:50.730418 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1394, time: 2012-10-11 13:43:48.854860, event: throttled, request: osd pg remove(epoch 7; pg1.e5; ) v1 -8879> 2012-10-11 13:43:50.730423 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1394, time: 2012-10-11 13:43:48.854863, event: all_read, request: osd pg remove(epoch 7; pg1.e5; ) v1 -8878> 2012-10-11 13:43:50.730428 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1394, time: 2012-10-11 13:43:50.730410, event: dispatched, request: osd pg remove(epoch 7; pg1.e5; ) v1 -8877> 2012-10-11 13:43:50.730433 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1394, time: 2012-10-11 13:43:50.730433, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.e5; ) v1 -8876> 2012-10-11 13:43:50.730422 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_notify(2.68(1),0.6a(1),1.69(1),0.61(1),1.60(1),2.5d(1),0.5f(1),1.5e(1),2.5f(1),0.59(1),1.58(1),0.58(2),0.5c(2),0.64(2),0.65(2),0.6b(2),0.6c(2),0.89(2),1.23(2),1.2b(2),1.2e(2),1.31(2),1.32(2),1.37(2),1.3b(2),1.3f(2),1.57(2) epoch 8) v4 -- ?+0 0x227be00 -8875> 2012-10-11 13:43:50.730439 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1394, time: 2012-10-11 13:43:50.730439, event: started, request: osd pg remove(epoch 7; pg1.e5; ) v1 -8874> 2012-10-11 13:43:50.730455 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.e5 -8873> 2012-10-11 13:43:50.730450 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_notify(1.33(2),1.40(2),1.44(2),1.46(2),1.47(2),1.48(2),1.4b(2),1.51(2),1.59(2),1.5a(2),1.5f(2),1.6d(2) epoch 8) v4 -- ?+0 0x232bc40 -8872> 2012-10-11 13:43:50.730469 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8871> 2012-10-11 13:43:50.730471 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8870> 2012-10-11 13:43:50.730470 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.e5 0x2e38cb0)/0x2e38cb0 -8869> 2012-10-11 13:43:50.730472 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3996 0x2d17a20 -8868> 2012-10-11 13:43:50.730474 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8867> 2012-10-11 13:43:50.730475 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8866> 2012-10-11 13:43:50.730476 7f4402a29700 5 journal submit_entry seq 3996 len 969 (0x28a8de0) -8865> 2012-10-11 13:43:50.730478 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8864> 2012-10-11 13:43:50.730479 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8863> 2012-10-11 13:43:50.730488 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3997 0x3074480 -8862> 2012-10-11 13:43:50.730492 7f440532f700 5 journal submit_entry seq 3997 len 204 (0x2e13e40) -8861> 2012-10-11 13:43:50.730494 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8860> 2012-10-11 13:43:50.730495 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8859> 2012-10-11 13:43:50.730508 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.f7 epoch 8 query_epoch 8) v3 -- ?+0 0x2888000 -8858> 2012-10-11 13:43:50.730513 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1394, time: 2012-10-11 13:43:50.730513, event: done, request: osd pg remove(epoch 7; pg1.e5; ) v1 -8857> 2012-10-11 13:43:50.730546 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124612) -8856> 2012-10-11 13:43:50.730551 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 514 ==== pg_log(0.f5 epoch 7 query_epoch 7) v3 ==== 507+0+0 (366846375 0 0) 0x29c9a00 con 0x2fe2280 -8855> 2012-10-11 13:43:50.730561 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1395, time: 2012-10-11 13:43:49.949914, event: header_read, request: pg_log(0.f5 epoch 7 query_epoch 7) v3 -8854> 2012-10-11 13:43:50.730565 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1395, time: 2012-10-11 13:43:49.949928, event: throttled, request: pg_log(0.f5 epoch 7 query_epoch 7) v3 -8853> 2012-10-11 13:43:50.730568 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1395, time: 2012-10-11 13:43:49.949948, event: all_read, request: pg_log(0.f5 epoch 7 query_epoch 7) v3 -8852> 2012-10-11 13:43:50.730572 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1395, time: 2012-10-11 13:43:50.730559, event: dispatched, request: pg_log(0.f5 epoch 7 query_epoch 7) v3 -8851> 2012-10-11 13:43:50.730576 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1395, time: 2012-10-11 13:43:50.730576, event: waiting_for_osdmap, request: pg_log(0.f5 epoch 7 query_epoch 7) v3 -8850> 2012-10-11 13:43:50.730598 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1395, time: 2012-10-11 13:43:50.730598, event: started, request: pg_log(0.f5 epoch 7 query_epoch 7) v3 -8849> 2012-10-11 13:43:50.730719 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.f7 0x3176150)/0x3176150 -8848> 2012-10-11 13:43:50.730726 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8847> 2012-10-11 13:43:50.730727 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8846> 2012-10-11 13:43:50.730729 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3998 0x2d17cf0 -8845> 2012-10-11 13:43:50.730732 7f4402a29700 5 journal submit_entry seq 3998 len 969 (0x320ba80) -8844> 2012-10-11 13:43:50.730734 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8843> 2012-10-11 13:43:50.730735 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8843> 2012-10-11 13:43:50.730607 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1395, time: 2012-10-11 13:43:50.730607, event: done, request: pg_log(0.f5 epoch 7 query_epoch 7) v3 -8842> 2012-10-11 13:43:50.730753 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 124105) -8841> 2012-10-11 13:43:50.730756 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 859 ==== osd pg remove(epoch 7; pg1.fe; ) v1 ==== 25+0+0 (2346526501 0 0) 0x20aae00 con 0x2fe2140 -8840> 2012-10-11 13:43:50.730766 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1396, time: 2012-10-11 13:43:48.854866, event: header_read, request: osd pg remove(epoch 7; pg1.fe; ) v1 -8839> 2012-10-11 13:43:50.730771 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1396, time: 2012-10-11 13:43:48.854868, event: throttled, request: osd pg remove(epoch 7; pg1.fe; ) v1 -8840> 2012-10-11 13:43:50.730767 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.fc epoch 8 query_epoch 8) v3 -- ?+0 0x25b8a00 -8843> 2012-10-11 13:43:50.730774 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1396, time: 2012-10-11 13:43:48.854873, event: all_read, request: osd pg remove(epoch 7; pg1.fe; ) v1 -8842> 2012-10-11 13:43:50.730778 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1396, time: 2012-10-11 13:43:50.730765, event: dispatched, request: osd pg remove(epoch 7; pg1.fe; ) v1 -8842> 2012-10-11 13:43:50.730783 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1396, time: 2012-10-11 13:43:50.730783, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.fe; ) v1 -8841> 2012-10-11 13:43:50.730789 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1396, time: 2012-10-11 13:43:50.730788, event: started, request: osd pg remove(epoch 7; pg1.fe; ) v1 -8841> 2012-10-11 13:43:50.730803 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.fe -8842> 2012-10-11 13:43:50.730838 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.fc 0x3176060)/0x3176060 -8841> 2012-10-11 13:43:50.730853 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8840> 2012-10-11 13:43:50.730857 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.fe 0x3176000)/0x3176000 -8839> 2012-10-11 13:43:50.730864 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8838> 2012-10-11 13:43:50.730885 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 3999 0x2d17bd0 -8837> 2012-10-11 13:43:50.730889 7f4402a29700 5 journal submit_entry seq 3999 len 969 (0x1e3f930) -8836> 2012-10-11 13:43:50.730870 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8835> 2012-10-11 13:43:50.730899 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8834> 2012-10-11 13:43:50.734371 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8833> 2012-10-11 13:43:50.734378 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8832> 2012-10-11 13:43:50.734414 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.8 epoch 8 query_epoch 8) v3 -- ?+0 0x25b8500 -8831> 2012-10-11 13:43:50.734433 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4000 0x30746c0 -8830> 2012-10-11 13:43:50.734438 7f440532f700 5 journal submit_entry seq 4000 len 204 (0x30a1900) -8829> 2012-10-11 13:43:50.734440 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8828> 2012-10-11 13:43:50.734442 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8827> 2012-10-11 13:43:50.730868 7f4402228700 5 --OSD::tracker-- reqid: mds.0.1:19, seq: 24, time: 2012-10-11 13:43:50.730660, event: reached_pg, request: osd_op(mds.0.1:19 608.00000000 [setxattr path (12),setxattr parent (39),tmapup 0~0] 1.c4405e8e) v4 -8826> 2012-10-11 13:43:50.734470 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1396, time: 2012-10-11 13:43:50.734463, event: done, request: osd pg remove(epoch 7; pg1.fe; ) v1 -8825> 2012-10-11 13:43:50.734482 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 124080) -8824> 2012-10-11 13:43:50.734485 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 515 ==== pg_log(0.f9 epoch 7 query_epoch 7) v3 ==== 507+0+0 (495833326 0 0) 0x29c9500 con 0x2fe2280 -8823> 2012-10-11 13:43:50.734496 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1397, time: 2012-10-11 13:43:49.951769, event: header_read, request: pg_log(0.f9 epoch 7 query_epoch 7) v3 -8822> 2012-10-11 13:43:50.734500 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1397, time: 2012-10-11 13:43:49.951779, event: throttled, request: pg_log(0.f9 epoch 7 query_epoch 7) v3 -8821> 2012-10-11 13:43:50.734504 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1397, time: 2012-10-11 13:43:49.951792, event: all_read, request: pg_log(0.f9 epoch 7 query_epoch 7) v3 -8820> 2012-10-11 13:43:50.734507 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1397, time: 2012-10-11 13:43:50.734495, event: dispatched, request: pg_log(0.f9 epoch 7 query_epoch 7) v3 -8819> 2012-10-11 13:43:50.734511 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1397, time: 2012-10-11 13:43:50.734511, event: waiting_for_osdmap, request: pg_log(0.f9 epoch 7 query_epoch 7) v3 -8818> 2012-10-11 13:43:50.734517 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1397, time: 2012-10-11 13:43:50.734517, event: started, request: pg_log(0.f9 epoch 7 query_epoch 7) v3 -8817> 2012-10-11 13:43:50.734525 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1397, time: 2012-10-11 13:43:50.734525, event: done, request: pg_log(0.f9 epoch 7 query_epoch 7) v3 -8816> 2012-10-11 13:43:50.734531 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 123573) -8815> 2012-10-11 13:43:50.734533 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 860 ==== osd pg remove(epoch 7; pg2.5; ) v1 ==== 25+0+0 (2788029726 0 0) 0x20aac40 con 0x2fe2140 -8814> 2012-10-11 13:43:50.734540 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1398, time: 2012-10-11 13:43:48.854876, event: header_read, request: osd pg remove(epoch 7; pg2.5; ) v1 -8813> 2012-10-11 13:43:50.734544 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1398, time: 2012-10-11 13:43:48.854878, event: throttled, request: osd pg remove(epoch 7; pg2.5; ) v1 -8812> 2012-10-11 13:43:50.734548 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1398, time: 2012-10-11 13:43:48.854882, event: all_read, request: osd pg remove(epoch 7; pg2.5; ) v1 -8811> 2012-10-11 13:43:50.734551 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1398, time: 2012-10-11 13:43:50.734539, event: dispatched, request: osd pg remove(epoch 7; pg2.5; ) v1 -8810> 2012-10-11 13:43:50.734555 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1398, time: 2012-10-11 13:43:50.734555, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.5; ) v1 -8809> 2012-10-11 13:43:50.734560 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1398, time: 2012-10-11 13:43:50.734560, event: started, request: osd pg remove(epoch 7; pg2.5; ) v1 -8808> 2012-10-11 13:43:50.734564 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.5 -8807> 2012-10-11 13:43:50.734578 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.5 0x3176240)/0x3176240 -8806> 2012-10-11 13:43:50.734581 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8805> 2012-10-11 13:43:50.734582 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8804> 2012-10-11 13:43:50.734583 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4001 0x30743f0 -8803> 2012-10-11 13:43:50.734586 7f440532f700 5 journal submit_entry seq 4001 len 200 (0x1e860c0) -8802> 2012-10-11 13:43:50.734587 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8801> 2012-10-11 13:43:50.734589 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 200 -8800> 2012-10-11 13:43:50.734603 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1398, time: 2012-10-11 13:43:50.734603, event: done, request: osd pg remove(epoch 7; pg2.5; ) v1 -8799> 2012-10-11 13:43:50.734611 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 123548) -8798> 2012-10-11 13:43:50.734614 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 516 ==== pg_log(0.fb epoch 7 query_epoch 7) v3 ==== 507+0+0 (2392603092 0 0) 0x29c9000 con 0x2fe2280 -8797> 2012-10-11 13:43:50.734622 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1399, time: 2012-10-11 13:43:49.951798, event: header_read, request: pg_log(0.fb epoch 7 query_epoch 7) v3 -8796> 2012-10-11 13:43:50.734626 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1399, time: 2012-10-11 13:43:49.951801, event: throttled, request: pg_log(0.fb epoch 7 query_epoch 7) v3 -8795> 2012-10-11 13:43:50.734629 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1399, time: 2012-10-11 13:43:49.951811, event: all_read, request: pg_log(0.fb epoch 7 query_epoch 7) v3 -8794> 2012-10-11 13:43:50.734633 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1399, time: 2012-10-11 13:43:50.734621, event: dispatched, request: pg_log(0.fb epoch 7 query_epoch 7) v3 -8793> 2012-10-11 13:43:50.734637 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1399, time: 2012-10-11 13:43:50.734637, event: waiting_for_osdmap, request: pg_log(0.fb epoch 7 query_epoch 7) v3 -8792> 2012-10-11 13:43:50.734642 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1399, time: 2012-10-11 13:43:50.734642, event: started, request: pg_log(0.fb epoch 7 query_epoch 7) v3 -8791> 2012-10-11 13:43:50.734649 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1399, time: 2012-10-11 13:43:50.734649, event: done, request: pg_log(0.fb epoch 7 query_epoch 7) v3 -8790> 2012-10-11 13:43:50.734654 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 123041) -8789> 2012-10-11 13:43:50.734657 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 861 ==== osd pg remove(epoch 7; pg2.d; ) v1 ==== 25+0+0 (3826708932 0 0) 0x20aaa80 con 0x2fe2140 -8788> 2012-10-11 13:43:50.734663 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1400, time: 2012-10-11 13:43:48.854884, event: header_read, request: osd pg remove(epoch 7; pg2.d; ) v1 -8788> 2012-10-11 13:43:50.734667 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1400, time: 2012-10-11 13:43:48.854887, event: throttled, request: osd pg remove(epoch 7; pg2.d; ) v1 -8787> 2012-10-11 13:43:50.734671 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1400, time: 2012-10-11 13:43:48.854890, event: all_read, request: osd pg remove(epoch 7; pg2.d; ) v1 -8786> 2012-10-11 13:43:50.734674 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1400, time: 2012-10-11 13:43:50.734663, event: dispatched, request: osd pg remove(epoch 7; pg2.d; ) v1 -8785> 2012-10-11 13:43:50.734678 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1400, time: 2012-10-11 13:43:50.734678, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.d; ) v1 -8784> 2012-10-11 13:43:50.734683 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1400, time: 2012-10-11 13:43:50.734683, event: started, request: osd pg remove(epoch 7; pg2.d; ) v1 -8783> 2012-10-11 13:43:50.734687 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.d -8782> 2012-10-11 13:43:50.734698 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.d 0x1d71430)/0x1d71430 -8781> 2012-10-11 13:43:50.734701 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8780> 2012-10-11 13:43:50.734702 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8779> 2012-10-11 13:43:50.734703 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4002 0x3074f30 -8778> 2012-10-11 13:43:50.734705 7f440532f700 5 journal submit_entry seq 4002 len 200 (0x1eed3f0) -8777> 2012-10-11 13:43:50.734707 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8776> 2012-10-11 13:43:50.734708 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 200 -8775> 2012-10-11 13:43:50.734722 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1400, time: 2012-10-11 13:43:50.734721, event: done, request: osd pg remove(epoch 7; pg2.d; ) v1 -8774> 2012-10-11 13:43:50.734729 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 123016) -8773> 2012-10-11 13:43:50.734732 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 517 ==== pg_log(0.fc epoch 7 query_epoch 7) v3 ==== 507+0+0 (3518425158 0 0) 0x301ca00 con 0x2fe2280 -8772> 2012-10-11 13:43:50.734739 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1401, time: 2012-10-11 13:43:49.952056, event: header_read, request: pg_log(0.fc epoch 7 query_epoch 7) v3 -8771> 2012-10-11 13:43:50.734743 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1401, time: 2012-10-11 13:43:49.952064, event: throttled, request: pg_log(0.fc epoch 7 query_epoch 7) v3 -8770> 2012-10-11 13:43:50.734747 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1401, time: 2012-10-11 13:43:49.952077, event: all_read, request: pg_log(0.fc epoch 7 query_epoch 7) v3 -8769> 2012-10-11 13:43:50.734750 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1401, time: 2012-10-11 13:43:50.734738, event: dispatched, request: pg_log(0.fc epoch 7 query_epoch 7) v3 -8768> 2012-10-11 13:43:50.734754 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1401, time: 2012-10-11 13:43:50.734754, event: waiting_for_osdmap, request: pg_log(0.fc epoch 7 query_epoch 7) v3 -8767> 2012-10-11 13:43:50.734759 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1401, time: 2012-10-11 13:43:50.734759, event: started, request: pg_log(0.fc epoch 7 query_epoch 7) v3 -8766> 2012-10-11 13:43:50.734767 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1401, time: 2012-10-11 13:43:50.734766, event: done, request: pg_log(0.fc epoch 7 query_epoch 7) v3 -8765> 2012-10-11 13:43:50.734772 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 122509) -8764> 2012-10-11 13:43:50.734774 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 862 ==== osd pg remove(epoch 7; pg2.9b; ) v1 ==== 25+0+0 (3875804727 0 0) 0x20aa8c0 con 0x2fe2140 -8763> 2012-10-11 13:43:50.734780 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1402, time: 2012-10-11 13:43:48.981687, event: header_read, request: osd pg remove(epoch 7; pg2.9b; ) v1 -8762> 2012-10-11 13:43:50.734784 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1402, time: 2012-10-11 13:43:48.981704, event: throttled, request: osd pg remove(epoch 7; pg2.9b; ) v1 -8761> 2012-10-11 13:43:50.734788 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1402, time: 2012-10-11 13:43:48.981713, event: all_read, request: osd pg remove(epoch 7; pg2.9b; ) v1 -8760> 2012-10-11 13:43:50.734792 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1402, time: 2012-10-11 13:43:50.734780, event: dispatched, request: osd pg remove(epoch 7; pg2.9b; ) v1 -8759> 2012-10-11 13:43:50.734796 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1402, time: 2012-10-11 13:43:50.734796, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.9b; ) v1 -8758> 2012-10-11 13:43:50.734800 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1402, time: 2012-10-11 13:43:50.734800, event: started, request: osd pg remove(epoch 7; pg2.9b; ) v1 -8757> 2012-10-11 13:43:50.734804 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.9b -8756> 2012-10-11 13:43:50.734817 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.9b 0x2130cc0)/0x2130cc0 -8755> 2012-10-11 13:43:50.734819 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8754> 2012-10-11 13:43:50.734820 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8753> 2012-10-11 13:43:50.734821 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4003 0x3074ea0 -8752> 2012-10-11 13:43:50.734824 7f440532f700 5 journal submit_entry seq 4003 len 204 (0x1eedc60) -8751> 2012-10-11 13:43:50.734825 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8750> 2012-10-11 13:43:50.734826 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8749> 2012-10-11 13:43:50.734840 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1402, time: 2012-10-11 13:43:50.734840, event: done, request: osd pg remove(epoch 7; pg2.9b; ) v1 -8748> 2012-10-11 13:43:50.734849 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 122484) -8747> 2012-10-11 13:43:50.734852 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 518 ==== pg_log(1.e7 epoch 7 query_epoch 7) v3 ==== 507+0+0 (1866285542 0 0) 0x301c500 con 0x2fe2280 -8747> 2012-10-11 13:43:50.734860 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1403, time: 2012-10-11 13:43:49.954785, event: header_read, request: pg_log(1.e7 epoch 7 query_epoch 7) v3 -8746> 2012-10-11 13:43:50.734864 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1403, time: 2012-10-11 13:43:49.954796, event: throttled, request: pg_log(1.e7 epoch 7 query_epoch 7) v3 -8745> 2012-10-11 13:43:50.734868 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1403, time: 2012-10-11 13:43:49.954810, event: all_read, request: pg_log(1.e7 epoch 7 query_epoch 7) v3 -8744> 2012-10-11 13:43:50.734872 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1403, time: 2012-10-11 13:43:50.734859, event: dispatched, request: pg_log(1.e7 epoch 7 query_epoch 7) v3 -8743> 2012-10-11 13:43:50.734875 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1403, time: 2012-10-11 13:43:50.734875, event: waiting_for_osdmap, request: pg_log(1.e7 epoch 7 query_epoch 7) v3 -8742> 2012-10-11 13:43:50.734881 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1403, time: 2012-10-11 13:43:50.734881, event: started, request: pg_log(1.e7 epoch 7 query_epoch 7) v3 -8741> 2012-10-11 13:43:50.734888 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1403, time: 2012-10-11 13:43:50.734888, event: done, request: pg_log(1.e7 epoch 7 query_epoch 7) v3 -8740> 2012-10-11 13:43:50.734893 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 121977) -8739> 2012-10-11 13:43:50.734895 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 863 ==== osd pg remove(epoch 7; pg2.9f; ) v1 ==== 25+0+0 (3323565146 0 0) 0x20aa700 con 0x2fe2140 -8738> 2012-10-11 13:43:50.734902 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1404, time: 2012-10-11 13:43:48.981719, event: header_read, request: osd pg remove(epoch 7; pg2.9f; ) v1 -8737> 2012-10-11 13:43:50.734906 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1404, time: 2012-10-11 13:43:48.981722, event: throttled, request: osd pg remove(epoch 7; pg2.9f; ) v1 -8736> 2012-10-11 13:43:50.734910 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1404, time: 2012-10-11 13:43:48.981726, event: all_read, request: osd pg remove(epoch 7; pg2.9f; ) v1 -8735> 2012-10-11 13:43:50.734913 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1404, time: 2012-10-11 13:43:50.734901, event: dispatched, request: osd pg remove(epoch 7; pg2.9f; ) v1 -8734> 2012-10-11 13:43:50.734917 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1404, time: 2012-10-11 13:43:50.734917, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.9f; ) v1 -8733> 2012-10-11 13:43:50.734922 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1404, time: 2012-10-11 13:43:50.734922, event: started, request: osd pg remove(epoch 7; pg2.9f; ) v1 -8732> 2012-10-11 13:43:50.734926 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.9f -8731> 2012-10-11 13:43:50.734937 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.9f 0x3176ce0)/0x3176ce0 -8730> 2012-10-11 13:43:50.734940 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8729> 2012-10-11 13:43:50.734941 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8728> 2012-10-11 13:43:50.734942 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4004 0x3074240 -8727> 2012-10-11 13:43:50.734944 7f440532f700 5 journal submit_entry seq 4004 len 204 (0x33abae0) -8726> 2012-10-11 13:43:50.734946 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8725> 2012-10-11 13:43:50.734947 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8724> 2012-10-11 13:43:50.734959 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1404, time: 2012-10-11 13:43:50.734959, event: done, request: osd pg remove(epoch 7; pg2.9f; ) v1 -8723> 2012-10-11 13:43:50.734967 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 121952) -8722> 2012-10-11 13:43:50.734970 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 519 ==== pg_log(1.ed epoch 7 query_epoch 7) v3 ==== 507+0+0 (2280060157 0 0) 0x301c000 con 0x2fe2280 -8721> 2012-10-11 13:43:50.734977 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1405, time: 2012-10-11 13:43:49.955821, event: header_read, request: pg_log(1.ed epoch 7 query_epoch 7) v3 -8720> 2012-10-11 13:43:50.734981 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1405, time: 2012-10-11 13:43:49.955832, event: throttled, request: pg_log(1.ed epoch 7 query_epoch 7) v3 -8719> 2012-10-11 13:43:50.734985 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1405, time: 2012-10-11 13:43:49.955844, event: all_read, request: pg_log(1.ed epoch 7 query_epoch 7) v3 -8718> 2012-10-11 13:43:50.734989 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1405, time: 2012-10-11 13:43:50.734977, event: dispatched, request: pg_log(1.ed epoch 7 query_epoch 7) v3 -8717> 2012-10-11 13:43:50.734992 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1405, time: 2012-10-11 13:43:50.734992, event: waiting_for_osdmap, request: pg_log(1.ed epoch 7 query_epoch 7) v3 -8716> 2012-10-11 13:43:50.734998 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1405, time: 2012-10-11 13:43:50.734998, event: started, request: pg_log(1.ed epoch 7 query_epoch 7) v3 -8715> 2012-10-11 13:43:50.735005 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1405, time: 2012-10-11 13:43:50.735005, event: done, request: pg_log(1.ed epoch 7 query_epoch 7) v3 -8714> 2012-10-11 13:43:50.735013 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 121445) -8713> 2012-10-11 13:43:50.735015 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 864 ==== osd pg remove(epoch 7; pg2.b1; ) v1 ==== 25+0+0 (977767738 0 0) 0x20aa540 con 0x2fe2140 -8712> 2012-10-11 13:43:50.735022 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1406, time: 2012-10-11 13:43:48.981731, event: header_read, request: osd pg remove(epoch 7; pg2.b1; ) v1 -8711> 2012-10-11 13:43:50.735026 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1406, time: 2012-10-11 13:43:48.981735, event: throttled, request: osd pg remove(epoch 7; pg2.b1; ) v1 -8710> 2012-10-11 13:43:50.735030 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1406, time: 2012-10-11 13:43:48.981753, event: all_read, request: osd pg remove(epoch 7; pg2.b1; ) v1 -8709> 2012-10-11 13:43:50.735034 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1406, time: 2012-10-11 13:43:50.735021, event: dispatched, request: osd pg remove(epoch 7; pg2.b1; ) v1 -8708> 2012-10-11 13:43:50.735038 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1406, time: 2012-10-11 13:43:50.735038, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.b1; ) v1 -8707> 2012-10-11 13:43:50.735042 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1406, time: 2012-10-11 13:43:50.735042, event: started, request: osd pg remove(epoch 7; pg2.b1; ) v1 -8706> 2012-10-11 13:43:50.735046 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.b1 -8705> 2012-10-11 13:43:50.735058 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b1 0x3176d80)/0x3176d80 -8704> 2012-10-11 13:43:50.735060 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8703> 2012-10-11 13:43:50.735061 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8702> 2012-10-11 13:43:50.735062 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4005 0x3074090 -8701> 2012-10-11 13:43:50.735064 7f440532f700 5 journal submit_entry seq 4005 len 204 (0x33a7930) -8700> 2012-10-11 13:43:50.735066 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8699> 2012-10-11 13:43:50.735067 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8698> 2012-10-11 13:43:50.735082 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1406, time: 2012-10-11 13:43:50.735082, event: done, request: osd pg remove(epoch 7; pg2.b1; ) v1 -8697> 2012-10-11 13:43:50.735090 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 121420) -8696> 2012-10-11 13:43:50.735093 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 520 ==== pg_log(1.ef epoch 7 query_epoch 7) v3 ==== 507+0+0 (510613918 0 0) 0x2956a00 con 0x2fe2280 -8695> 2012-10-11 13:43:50.735100 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1407, time: 2012-10-11 13:43:49.956792, event: header_read, request: pg_log(1.ef epoch 7 query_epoch 7) v3 -8694> 2012-10-11 13:43:50.735104 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1407, time: 2012-10-11 13:43:49.956802, event: throttled, request: pg_log(1.ef epoch 7 query_epoch 7) v3 -8693> 2012-10-11 13:43:50.735108 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1407, time: 2012-10-11 13:43:49.956816, event: all_read, request: pg_log(1.ef epoch 7 query_epoch 7) v3 -8692> 2012-10-11 13:43:50.735111 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1407, time: 2012-10-11 13:43:50.735099, event: dispatched, request: pg_log(1.ef epoch 7 query_epoch 7) v3 -8691> 2012-10-11 13:43:50.735115 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1407, time: 2012-10-11 13:43:50.735115, event: waiting_for_osdmap, request: pg_log(1.ef epoch 7 query_epoch 7) v3 -8690> 2012-10-11 13:43:50.735120 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1407, time: 2012-10-11 13:43:50.735120, event: started, request: pg_log(1.ef epoch 7 query_epoch 7) v3 -8689> 2012-10-11 13:43:50.735128 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1407, time: 2012-10-11 13:43:50.735127, event: done, request: pg_log(1.ef epoch 7 query_epoch 7) v3 -8688> 2012-10-11 13:43:50.735133 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 120913) -8687> 2012-10-11 13:43:50.735135 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 865 ==== osd pg remove(epoch 7; pg2.b4; ) v1 ==== 25+0+0 (1382445680 0 0) 0x20aa380 con 0x2fe2140 -8686> 2012-10-11 13:43:50.735141 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1408, time: 2012-10-11 13:43:48.981757, event: header_read, request: osd pg remove(epoch 7; pg2.b4; ) v1 -8686> 2012-10-11 13:43:50.735145 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1408, time: 2012-10-11 13:43:48.981761, event: throttled, request: osd pg remove(epoch 7; pg2.b4; ) v1 -8685> 2012-10-11 13:43:50.735149 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1408, time: 2012-10-11 13:43:48.981765, event: all_read, request: osd pg remove(epoch 7; pg2.b4; ) v1 -8684> 2012-10-11 13:43:50.735153 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1408, time: 2012-10-11 13:43:50.735141, event: dispatched, request: osd pg remove(epoch 7; pg2.b4; ) v1 -8683> 2012-10-11 13:43:50.735159 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1408, time: 2012-10-11 13:43:50.735159, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.b4; ) v1 -8682> 2012-10-11 13:43:50.735163 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1408, time: 2012-10-11 13:43:50.735163, event: started, request: osd pg remove(epoch 7; pg2.b4; ) v1 -8681> 2012-10-11 13:43:50.735167 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.b4 -8680> 2012-10-11 13:43:50.735179 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b4 0x3176f40)/0x3176f40 -8679> 2012-10-11 13:43:50.735181 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8678> 2012-10-11 13:43:50.735183 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8677> 2012-10-11 13:43:50.735184 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4006 0x3074120 -8676> 2012-10-11 13:43:50.735186 7f440532f700 5 journal submit_entry seq 4006 len 204 (0x33a3a20) -8675> 2012-10-11 13:43:50.735187 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8674> 2012-10-11 13:43:50.735188 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8673> 2012-10-11 13:43:50.735203 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1408, time: 2012-10-11 13:43:50.735203, event: done, request: osd pg remove(epoch 7; pg2.b4; ) v1 -8672> 2012-10-11 13:43:50.735211 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 120888) -8671> 2012-10-11 13:43:50.735213 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 521 ==== pg_log(1.f1 epoch 7 query_epoch 7) v3 ==== 507+0+0 (1089962054 0 0) 0x2956500 con 0x2fe2280 -8670> 2012-10-11 13:43:50.735221 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1409, time: 2012-10-11 13:43:49.957738, event: header_read, request: pg_log(1.f1 epoch 7 query_epoch 7) v3 -8669> 2012-10-11 13:43:50.735225 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1409, time: 2012-10-11 13:43:49.957748, event: throttled, request: pg_log(1.f1 epoch 7 query_epoch 7) v3 -8668> 2012-10-11 13:43:50.735228 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1409, time: 2012-10-11 13:43:49.957761, event: all_read, request: pg_log(1.f1 epoch 7 query_epoch 7) v3 -8667> 2012-10-11 13:43:50.735232 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1409, time: 2012-10-11 13:43:50.735220, event: dispatched, request: pg_log(1.f1 epoch 7 query_epoch 7) v3 -8666> 2012-10-11 13:43:50.735236 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1409, time: 2012-10-11 13:43:50.735236, event: waiting_for_osdmap, request: pg_log(1.f1 epoch 7 query_epoch 7) v3 -8665> 2012-10-11 13:43:50.735241 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1409, time: 2012-10-11 13:43:50.735241, event: started, request: pg_log(1.f1 epoch 7 query_epoch 7) v3 -8664> 2012-10-11 13:43:50.735248 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1409, time: 2012-10-11 13:43:50.735248, event: done, request: pg_log(1.f1 epoch 7 query_epoch 7) v3 -8663> 2012-10-11 13:43:50.735253 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 120381) -8662> 2012-10-11 13:43:50.735255 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 866 ==== osd pg remove(epoch 7; pg2.b5; ) v1 ==== 25+0+0 (458886999 0 0) 0x20aa1c0 con 0x2fe2140 -8661> 2012-10-11 13:43:50.735262 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1410, time: 2012-10-11 13:43:48.981769, event: header_read, request: osd pg remove(epoch 7; pg2.b5; ) v1 -8660> 2012-10-11 13:43:50.735266 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1410, time: 2012-10-11 13:43:48.981773, event: throttled, request: osd pg remove(epoch 7; pg2.b5; ) v1 -8659> 2012-10-11 13:43:50.735270 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1410, time: 2012-10-11 13:43:48.981776, event: all_read, request: osd pg remove(epoch 7; pg2.b5; ) v1 -8658> 2012-10-11 13:43:50.735273 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1410, time: 2012-10-11 13:43:50.735261, event: dispatched, request: osd pg remove(epoch 7; pg2.b5; ) v1 -8657> 2012-10-11 13:43:50.735277 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1410, time: 2012-10-11 13:43:50.735277, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.b5; ) v1 -8656> 2012-10-11 13:43:50.735282 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1410, time: 2012-10-11 13:43:50.735282, event: started, request: osd pg remove(epoch 7; pg2.b5; ) v1 -8655> 2012-10-11 13:43:50.735286 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.b5 -8654> 2012-10-11 13:43:50.735297 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b5 0x3176f10)/0x3176f10 -8653> 2012-10-11 13:43:50.735299 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8652> 2012-10-11 13:43:50.735300 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8651> 2012-10-11 13:43:50.735303 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4007 0x3074a20 -8650> 2012-10-11 13:43:50.735306 7f440532f700 5 journal submit_entry seq 4007 len 204 (0x33a3f90) -8649> 2012-10-11 13:43:50.735307 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8648> 2012-10-11 13:43:50.735309 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8647> 2012-10-11 13:43:50.735324 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1410, time: 2012-10-11 13:43:50.735324, event: done, request: osd pg remove(epoch 7; pg2.b5; ) v1 -8646> 2012-10-11 13:43:50.735332 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 120356) -8645> 2012-10-11 13:43:50.735334 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 522 ==== pg_log(1.f2 epoch 7 query_epoch 7) v3 ==== 507+0+0 (3787593095 0 0) 0x2956000 con 0x2fe2280 -8644> 2012-10-11 13:43:50.735342 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1411, time: 2012-10-11 13:43:49.959123, event: header_read, request: pg_log(1.f2 epoch 7 query_epoch 7) v3 -8643> 2012-10-11 13:43:50.735346 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1411, time: 2012-10-11 13:43:49.959135, event: throttled, request: pg_log(1.f2 epoch 7 query_epoch 7) v3 -8642> 2012-10-11 13:43:50.735349 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1411, time: 2012-10-11 13:43:49.959151, event: all_read, request: pg_log(1.f2 epoch 7 query_epoch 7) v3 -8641> 2012-10-11 13:43:50.735353 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1411, time: 2012-10-11 13:43:50.735341, event: dispatched, request: pg_log(1.f2 epoch 7 query_epoch 7) v3 -8640> 2012-10-11 13:43:50.735359 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1411, time: 2012-10-11 13:43:50.735359, event: waiting_for_osdmap, request: pg_log(1.f2 epoch 7 query_epoch 7) v3 -8639> 2012-10-11 13:43:50.735364 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1411, time: 2012-10-11 13:43:50.735364, event: started, request: pg_log(1.f2 epoch 7 query_epoch 7) v3 -8638> 2012-10-11 13:43:50.735371 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1411, time: 2012-10-11 13:43:50.735371, event: done, request: pg_log(1.f2 epoch 7 query_epoch 7) v3 -8637> 2012-10-11 13:43:50.735377 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 119849) -8636> 2012-10-11 13:43:50.735379 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 867 ==== osd pg remove(epoch 7; pg2.b6; ) v1 ==== 25+0+0 (3223226430 0 0) 0x20aa000 con 0x2fe2140 -8635> 2012-10-11 13:43:50.735386 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1412, time: 2012-10-11 13:43:48.981780, event: header_read, request: osd pg remove(epoch 7; pg2.b6; ) v1 -8634> 2012-10-11 13:43:50.735390 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1412, time: 2012-10-11 13:43:48.981784, event: throttled, request: osd pg remove(epoch 7; pg2.b6; ) v1 -8633> 2012-10-11 13:43:50.735393 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1412, time: 2012-10-11 13:43:48.981787, event: all_read, request: osd pg remove(epoch 7; pg2.b6; ) v1 -8632> 2012-10-11 13:43:50.735397 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1412, time: 2012-10-11 13:43:50.735385, event: dispatched, request: osd pg remove(epoch 7; pg2.b6; ) v1 -8631> 2012-10-11 13:43:50.735401 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1412, time: 2012-10-11 13:43:50.735401, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.b6; ) v1 -8630> 2012-10-11 13:43:50.735405 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1412, time: 2012-10-11 13:43:50.735405, event: started, request: osd pg remove(epoch 7; pg2.b6; ) v1 -8629> 2012-10-11 13:43:50.735409 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.b6 -8628> 2012-10-11 13:43:50.735420 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b6 0x2468540)/0x2468540 -8627> 2012-10-11 13:43:50.735423 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8626> 2012-10-11 13:43:50.735424 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8625> 2012-10-11 13:43:50.735425 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4008 0x3074cf0 -8624> 2012-10-11 13:43:50.735427 7f440532f700 5 journal submit_entry seq 4008 len 204 (0x30a19c0) -8623> 2012-10-11 13:43:50.735429 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8622> 2012-10-11 13:43:50.735430 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8621> 2012-10-11 13:43:50.735444 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1412, time: 2012-10-11 13:43:50.735444, event: done, request: osd pg remove(epoch 7; pg2.b6; ) v1 -8620> 2012-10-11 13:43:50.735452 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 119824) -8619> 2012-10-11 13:43:50.735455 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 523 ==== pg_log(1.f8 epoch 7 query_epoch 7) v3 ==== 507+0+0 (1158005171 0 0) 0x32e5a00 con 0x2fe2280 -8618> 2012-10-11 13:43:50.735465 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1413, time: 2012-10-11 13:43:49.961705, event: header_read, request: pg_log(1.f8 epoch 7 query_epoch 7) v3 -8617> 2012-10-11 13:43:50.735469 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1413, time: 2012-10-11 13:43:49.961716, event: throttled, request: pg_log(1.f8 epoch 7 query_epoch 7) v3 -8616> 2012-10-11 13:43:50.735472 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1413, time: 2012-10-11 13:43:49.961732, event: all_read, request: pg_log(1.f8 epoch 7 query_epoch 7) v3 -8615> 2012-10-11 13:43:50.735476 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1413, time: 2012-10-11 13:43:50.735464, event: dispatched, request: pg_log(1.f8 epoch 7 query_epoch 7) v3 -8614> 2012-10-11 13:43:50.735480 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1413, time: 2012-10-11 13:43:50.735480, event: waiting_for_osdmap, request: pg_log(1.f8 epoch 7 query_epoch 7) v3 -8613> 2012-10-11 13:43:50.735485 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1413, time: 2012-10-11 13:43:50.735485, event: started, request: pg_log(1.f8 epoch 7 query_epoch 7) v3 -8612> 2012-10-11 13:43:50.735492 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1413, time: 2012-10-11 13:43:50.735492, event: done, request: pg_log(1.f8 epoch 7 query_epoch 7) v3 -8611> 2012-10-11 13:43:50.735497 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 119317) -8610> 2012-10-11 13:43:50.735499 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 868 ==== osd pg remove(epoch 7; pg2.b9; ) v1 ==== 25+0+0 (2021427680 0 0) 0x331ae00 con 0x2fe2140 -8609> 2012-10-11 13:43:50.735506 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1414, time: 2012-10-11 13:43:48.981791, event: header_read, request: osd pg remove(epoch 7; pg2.b9; ) v1 -8608> 2012-10-11 13:43:50.735510 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1414, time: 2012-10-11 13:43:48.981795, event: throttled, request: osd pg remove(epoch 7; pg2.b9; ) v1 -8607> 2012-10-11 13:43:50.735513 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1414, time: 2012-10-11 13:43:48.981801, event: all_read, request: osd pg remove(epoch 7; pg2.b9; ) v1 -8606> 2012-10-11 13:43:50.735517 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1414, time: 2012-10-11 13:43:50.735505, event: dispatched, request: osd pg remove(epoch 7; pg2.b9; ) v1 -8605> 2012-10-11 13:43:50.735521 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1414, time: 2012-10-11 13:43:50.735521, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.b9; ) v1 -8604> 2012-10-11 13:43:50.735525 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1414, time: 2012-10-11 13:43:50.735525, event: started, request: osd pg remove(epoch 7; pg2.b9; ) v1 -8603> 2012-10-11 13:43:50.735529 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.b9 -8602> 2012-10-11 13:43:50.735540 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b9 0x2468250)/0x2468250 -8601> 2012-10-11 13:43:50.735543 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8600> 2012-10-11 13:43:50.735544 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8599> 2012-10-11 13:43:50.735545 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4009 0x30747e0 -8598> 2012-10-11 13:43:50.735547 7f440532f700 5 journal submit_entry seq 4009 len 204 (0x3056ab0) -8597> 2012-10-11 13:43:50.735549 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8596> 2012-10-11 13:43:50.735550 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8595> 2012-10-11 13:43:50.735565 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1414, time: 2012-10-11 13:43:50.735565, event: done, request: osd pg remove(epoch 7; pg2.b9; ) v1 -8594> 2012-10-11 13:43:50.735573 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 119292) -8593> 2012-10-11 13:43:50.735575 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 524 ==== pg_log(1.fa epoch 7 query_epoch 7) v3 ==== 507+0+0 (3758990408 0 0) 0x32e5500 con 0x2fe2280 -8592> 2012-10-11 13:43:50.735582 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1415, time: 2012-10-11 13:43:49.963414, event: header_read, request: pg_log(1.fa epoch 7 query_epoch 7) v3 -8591> 2012-10-11 13:43:50.735586 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1415, time: 2012-10-11 13:43:49.963425, event: throttled, request: pg_log(1.fa epoch 7 query_epoch 7) v3 -8590> 2012-10-11 13:43:50.735590 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1415, time: 2012-10-11 13:43:49.963440, event: all_read, request: pg_log(1.fa epoch 7 query_epoch 7) v3 -8589> 2012-10-11 13:43:50.735593 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1415, time: 2012-10-11 13:43:50.735582, event: dispatched, request: pg_log(1.fa epoch 7 query_epoch 7) v3 -8588> 2012-10-11 13:43:50.735597 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1415, time: 2012-10-11 13:43:50.735597, event: waiting_for_osdmap, request: pg_log(1.fa epoch 7 query_epoch 7) v3 -8587> 2012-10-11 13:43:50.735606 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1415, time: 2012-10-11 13:43:50.735605, event: started, request: pg_log(1.fa epoch 7 query_epoch 7) v3 -8586> 2012-10-11 13:43:50.735613 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1415, time: 2012-10-11 13:43:50.735613, event: done, request: pg_log(1.fa epoch 7 query_epoch 7) v3 -8585> 2012-10-11 13:43:50.735618 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 118785) -8584> 2012-10-11 13:43:50.735620 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 869 ==== osd pg remove(epoch 7; pg2.c9; ) v1 ==== 25+0+0 (3943313151 0 0) 0x331ac40 con 0x2fe2140 -8583> 2012-10-11 13:43:50.735627 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1416, time: 2012-10-11 13:43:48.981805, event: header_read, request: osd pg remove(epoch 7; pg2.c9; ) v1 -8582> 2012-10-11 13:43:50.735631 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1416, time: 2012-10-11 13:43:48.981809, event: throttled, request: osd pg remove(epoch 7; pg2.c9; ) v1 -8581> 2012-10-11 13:43:50.735636 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1416, time: 2012-10-11 13:43:48.981812, event: all_read, request: osd pg remove(epoch 7; pg2.c9; ) v1 -8580> 2012-10-11 13:43:50.735640 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1416, time: 2012-10-11 13:43:50.735626, event: dispatched, request: osd pg remove(epoch 7; pg2.c9; ) v1 -8579> 2012-10-11 13:43:50.735644 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1416, time: 2012-10-11 13:43:50.735643, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.c9; ) v1 -8578> 2012-10-11 13:43:50.735648 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1416, time: 2012-10-11 13:43:50.735648, event: started, request: osd pg remove(epoch 7; pg2.c9; ) v1 -8577> 2012-10-11 13:43:50.735652 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.c9 -8576> 2012-10-11 13:43:50.735663 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.c9 0x3176fc0)/0x3176fc0 -8575> 2012-10-11 13:43:50.735666 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8574> 2012-10-11 13:43:50.735667 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8573> 2012-10-11 13:43:50.735668 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4010 0x3074c60 -8572> 2012-10-11 13:43:50.735670 7f440532f700 5 journal submit_entry seq 4010 len 204 (0x2faf270) -8571> 2012-10-11 13:43:50.735673 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8570> 2012-10-11 13:43:50.735674 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8569> 2012-10-11 13:43:50.735687 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1416, time: 2012-10-11 13:43:50.735687, event: done, request: osd pg remove(epoch 7; pg2.c9; ) v1 -8568> 2012-10-11 13:43:50.735698 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 118760) -8567> 2012-10-11 13:43:50.735701 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 525 ==== pg_log(1.fb epoch 7 query_epoch 7) v3 ==== 507+0+0 (1749599110 0 0) 0x32e5000 con 0x2fe2280 -8566> 2012-10-11 13:43:50.735709 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1417, time: 2012-10-11 13:43:49.963445, event: header_read, request: pg_log(1.fb epoch 7 query_epoch 7) v3 -8565> 2012-10-11 13:43:50.735713 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1417, time: 2012-10-11 13:43:49.963451, event: throttled, request: pg_log(1.fb epoch 7 query_epoch 7) v3 -8564> 2012-10-11 13:43:50.735717 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1417, time: 2012-10-11 13:43:49.963459, event: all_read, request: pg_log(1.fb epoch 7 query_epoch 7) v3 -8563> 2012-10-11 13:43:50.735721 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1417, time: 2012-10-11 13:43:50.735708, event: dispatched, request: pg_log(1.fb epoch 7 query_epoch 7) v3 -8562> 2012-10-11 13:43:50.735725 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1417, time: 2012-10-11 13:43:50.735725, event: waiting_for_osdmap, request: pg_log(1.fb epoch 7 query_epoch 7) v3 -8561> 2012-10-11 13:43:50.735731 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1417, time: 2012-10-11 13:43:50.735730, event: started, request: pg_log(1.fb epoch 7 query_epoch 7) v3 -8560> 2012-10-11 13:43:50.735739 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1417, time: 2012-10-11 13:43:50.735739, event: done, request: pg_log(1.fb epoch 7 query_epoch 7) v3 -8559> 2012-10-11 13:43:50.735745 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 118253) -8558> 2012-10-11 13:43:50.735747 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 870 ==== osd pg remove(epoch 7; pg2.cf; ) v1 ==== 25+0+0 (1483691740 0 0) 0x331aa80 con 0x2fe2140 -8557> 2012-10-11 13:43:50.735754 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1418, time: 2012-10-11 13:43:48.981816, event: header_read, request: osd pg remove(epoch 7; pg2.cf; ) v1 -8556> 2012-10-11 13:43:50.735758 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1418, time: 2012-10-11 13:43:48.981820, event: throttled, request: osd pg remove(epoch 7; pg2.cf; ) v1 -8555> 2012-10-11 13:43:50.735762 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1418, time: 2012-10-11 13:43:48.981823, event: all_read, request: osd pg remove(epoch 7; pg2.cf; ) v1 -8554> 2012-10-11 13:43:50.735767 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1418, time: 2012-10-11 13:43:50.735753, event: dispatched, request: osd pg remove(epoch 7; pg2.cf; ) v1 -8553> 2012-10-11 13:43:50.735771 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1418, time: 2012-10-11 13:43:50.735771, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.cf; ) v1 -8552> 2012-10-11 13:43:50.735776 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1418, time: 2012-10-11 13:43:50.735776, event: started, request: osd pg remove(epoch 7; pg2.cf; ) v1 -8551> 2012-10-11 13:43:50.735780 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.cf -8550> 2012-10-11 13:43:50.735792 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.cf 0x24689d0)/0x24689d0 -8549> 2012-10-11 13:43:50.735798 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8548> 2012-10-11 13:43:50.735799 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8547> 2012-10-11 13:43:50.735800 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4011 0x3074990 -8546> 2012-10-11 13:43:50.735803 7f440532f700 5 journal submit_entry seq 4011 len 204 (0x2b5dc30) -8545> 2012-10-11 13:43:50.735804 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8544> 2012-10-11 13:43:50.735806 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8543> 2012-10-11 13:43:50.735820 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1418, time: 2012-10-11 13:43:50.735820, event: done, request: osd pg remove(epoch 7; pg2.cf; ) v1 -8542> 2012-10-11 13:43:50.735828 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 118228) -8541> 2012-10-11 13:43:50.735831 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 526 ==== pg_log(2.e6 epoch 7 query_epoch 7) v3 ==== 507+0+0 (3027408295 0 0) 0x309fa00 con 0x2fe2280 -8540> 2012-10-11 13:43:50.735839 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1419, time: 2012-10-11 13:43:49.964801, event: header_read, request: pg_log(2.e6 epoch 7 query_epoch 7) v3 -8539> 2012-10-11 13:43:50.735843 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1419, time: 2012-10-11 13:43:49.964812, event: throttled, request: pg_log(2.e6 epoch 7 query_epoch 7) v3 -8538> 2012-10-11 13:43:50.735846 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1419, time: 2012-10-11 13:43:49.964828, event: all_read, request: pg_log(2.e6 epoch 7 query_epoch 7) v3 -8537> 2012-10-11 13:43:50.735850 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1419, time: 2012-10-11 13:43:50.735838, event: dispatched, request: pg_log(2.e6 epoch 7 query_epoch 7) v3 -8536> 2012-10-11 13:43:50.735853 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1419, time: 2012-10-11 13:43:50.735853, event: waiting_for_osdmap, request: pg_log(2.e6 epoch 7 query_epoch 7) v3 -8535> 2012-10-11 13:43:50.735858 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1419, time: 2012-10-11 13:43:50.735858, event: started, request: pg_log(2.e6 epoch 7 query_epoch 7) v3 -8534> 2012-10-11 13:43:50.735865 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1419, time: 2012-10-11 13:43:50.735865, event: done, request: pg_log(2.e6 epoch 7 query_epoch 7) v3 -8533> 2012-10-11 13:43:50.735871 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 117721) -8532> 2012-10-11 13:43:50.735873 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 871 ==== osd pg remove(epoch 7; pg2.d0; ) v1 ==== 25+0+0 (1685806774 0 0) 0x331a8c0 con 0x2fe2140 -8531> 2012-10-11 13:43:50.735879 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1420, time: 2012-10-11 13:43:48.981827, event: header_read, request: osd pg remove(epoch 7; pg2.d0; ) v1 -8530> 2012-10-11 13:43:50.735883 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1420, time: 2012-10-11 13:43:48.981830, event: throttled, request: osd pg remove(epoch 7; pg2.d0; ) v1 -8529> 2012-10-11 13:43:50.735887 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1420, time: 2012-10-11 13:43:48.981834, event: all_read, request: osd pg remove(epoch 7; pg2.d0; ) v1 -8528> 2012-10-11 13:43:50.735891 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1420, time: 2012-10-11 13:43:50.735879, event: dispatched, request: osd pg remove(epoch 7; pg2.d0; ) v1 -8527> 2012-10-11 13:43:50.735894 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1420, time: 2012-10-11 13:43:50.735894, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.d0; ) v1 -8526> 2012-10-11 13:43:50.735899 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1420, time: 2012-10-11 13:43:50.735899, event: started, request: osd pg remove(epoch 7; pg2.d0; ) v1 -8525> 2012-10-11 13:43:50.735903 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.d0 -8524> 2012-10-11 13:43:50.735914 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.d0 0x2468980)/0x2468980 -8523> 2012-10-11 13:43:50.735917 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8522> 2012-10-11 13:43:50.735918 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8521> 2012-10-11 13:43:50.735919 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4012 0x30741b0 -8520> 2012-10-11 13:43:50.735922 7f440532f700 5 journal submit_entry seq 4012 len 204 (0x2719540) -8519> 2012-10-11 13:43:50.735923 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8518> 2012-10-11 13:43:50.735925 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8517> 2012-10-11 13:43:50.735939 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1420, time: 2012-10-11 13:43:50.735939, event: done, request: osd pg remove(epoch 7; pg2.d0; ) v1 -8516> 2012-10-11 13:43:50.735947 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 117696) -8515> 2012-10-11 13:43:50.735949 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 527 ==== pg_log(2.ec epoch 7 query_epoch 7) v3 ==== 507+0+0 (2748042316 0 0) 0x309f500 con 0x2fe2280 -8514> 2012-10-11 13:43:50.735957 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1421, time: 2012-10-11 13:43:49.965535, event: header_read, request: pg_log(2.ec epoch 7 query_epoch 7) v3 -8513> 2012-10-11 13:43:50.735961 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1421, time: 2012-10-11 13:43:49.965550, event: throttled, request: pg_log(2.ec epoch 7 query_epoch 7) v3 -8512> 2012-10-11 13:43:50.735964 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1421, time: 2012-10-11 13:43:49.965567, event: all_read, request: pg_log(2.ec epoch 7 query_epoch 7) v3 -8511> 2012-10-11 13:43:50.735968 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1421, time: 2012-10-11 13:43:50.735956, event: dispatched, request: pg_log(2.ec epoch 7 query_epoch 7) v3 -8510> 2012-10-11 13:43:50.735972 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1421, time: 2012-10-11 13:43:50.735972, event: waiting_for_osdmap, request: pg_log(2.ec epoch 7 query_epoch 7) v3 -8509> 2012-10-11 13:43:50.735977 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1421, time: 2012-10-11 13:43:50.735977, event: started, request: pg_log(2.ec epoch 7 query_epoch 7) v3 -8508> 2012-10-11 13:43:50.735984 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1421, time: 2012-10-11 13:43:50.735984, event: done, request: pg_log(2.ec epoch 7 query_epoch 7) v3 -8507> 2012-10-11 13:43:50.735989 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 117189) -8506> 2012-10-11 13:43:50.735991 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 872 ==== osd pg remove(epoch 7; pg2.dc; ) v1 ==== 25+0+0 (123590657 0 0) 0x331a700 con 0x2fe2140 -8505> 2012-10-11 13:43:50.735998 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1422, time: 2012-10-11 13:43:48.981838, event: header_read, request: osd pg remove(epoch 7; pg2.dc; ) v1 -8504> 2012-10-11 13:43:50.736002 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1422, time: 2012-10-11 13:43:48.981842, event: throttled, request: osd pg remove(epoch 7; pg2.dc; ) v1 -8503> 2012-10-11 13:43:50.736006 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1422, time: 2012-10-11 13:43:48.981845, event: all_read, request: osd pg remove(epoch 7; pg2.dc; ) v1 -8502> 2012-10-11 13:43:50.736009 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1422, time: 2012-10-11 13:43:50.735997, event: dispatched, request: osd pg remove(epoch 7; pg2.dc; ) v1 -8501> 2012-10-11 13:43:50.736013 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1422, time: 2012-10-11 13:43:50.736013, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.dc; ) v1 -8500> 2012-10-11 13:43:50.736018 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1422, time: 2012-10-11 13:43:50.736018, event: started, request: osd pg remove(epoch 7; pg2.dc; ) v1 -8499> 2012-10-11 13:43:50.736021 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.dc -8498> 2012-10-11 13:43:50.736034 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.dc 0x25cf0c0)/0x25cf0c0 -8497> 2012-10-11 13:43:50.736037 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8496> 2012-10-11 13:43:50.736038 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8495> 2012-10-11 13:43:50.736039 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4013 0x3074000 -8494> 2012-10-11 13:43:50.736041 7f440532f700 5 journal submit_entry seq 4013 len 204 (0x2827c30) -8493> 2012-10-11 13:43:50.736043 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8492> 2012-10-11 13:43:50.736044 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 204 -8491> 2012-10-11 13:43:50.736058 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1422, time: 2012-10-11 13:43:50.736057, event: done, request: osd pg remove(epoch 7; pg2.dc; ) v1 -8490> 2012-10-11 13:43:50.736065 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 117164) -8489> 2012-10-11 13:43:50.736068 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 528 ==== pg_log(2.6 epoch 7 query_epoch 7) v3 ==== 507+0+0 (2631809605 0 0) 0x309f000 con 0x2fe2280 -8488> 2012-10-11 13:43:50.736075 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1423, time: 2012-10-11 13:43:49.965700, event: header_read, request: pg_log(2.6 epoch 7 query_epoch 7) v3 -8487> 2012-10-11 13:43:50.736079 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1423, time: 2012-10-11 13:43:49.965713, event: throttled, request: pg_log(2.6 epoch 7 query_epoch 7) v3 -8486> 2012-10-11 13:43:50.736083 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1423, time: 2012-10-11 13:43:49.965725, event: all_read, request: pg_log(2.6 epoch 7 query_epoch 7) v3 -8485> 2012-10-11 13:43:50.736086 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1423, time: 2012-10-11 13:43:50.736074, event: dispatched, request: pg_log(2.6 epoch 7 query_epoch 7) v3 -8484> 2012-10-11 13:43:50.736090 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1423, time: 2012-10-11 13:43:50.736090, event: waiting_for_osdmap, request: pg_log(2.6 epoch 7 query_epoch 7) v3 -8483> 2012-10-11 13:43:50.736095 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1423, time: 2012-10-11 13:43:50.736095, event: started, request: pg_log(2.6 epoch 7 query_epoch 7) v3 -8482> 2012-10-11 13:43:50.736102 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1423, time: 2012-10-11 13:43:50.736102, event: done, request: pg_log(2.6 epoch 7 query_epoch 7) v3 -8481> 2012-10-11 13:43:50.736107 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 116657) -8480> 2012-10-11 13:43:50.736109 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 873 ==== osd pg remove(epoch 7; pg2.dd; ) v1 ==== 25+0+0 (1315022118 0 0) 0x331a540 con 0x2fe2140 -8479> 2012-10-11 13:43:50.736116 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1424, time: 2012-10-11 13:43:48.981850, event: header_read, request: osd pg remove(epoch 7; pg2.dd; ) v1 -8478> 2012-10-11 13:43:50.736120 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1424, time: 2012-10-11 13:43:48.981853, event: throttled, request: osd pg remove(epoch 7; pg2.dd; ) v1 -8477> 2012-10-11 13:43:50.736123 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1424, time: 2012-10-11 13:43:48.981857, event: all_read, request: osd pg remove(epoch 7; pg2.dd; ) v1 -8476> 2012-10-11 13:43:50.736127 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1424, time: 2012-10-11 13:43:50.736115, event: dispatched, request: osd pg remove(epoch 7; pg2.dd; ) v1 -8475> 2012-10-11 13:43:50.736131 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1424, time: 2012-10-11 13:43:50.736131, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.dd; ) v1 -8474> 2012-10-11 13:43:50.736135 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1424, time: 2012-10-11 13:43:50.736135, event: started, request: osd pg remove(epoch 7; pg2.dd; ) v1 -8473> 2012-10-11 13:43:50.736139 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.dd -8472> 2012-10-11 13:43:50.736151 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.dd 0x25cf090)/0x25cf090 -8471> 2012-10-11 13:43:50.736153 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8470> 2012-10-11 13:43:50.736154 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8469> 2012-10-11 13:43:50.736155 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4014 0x30742d0 -8468> 2012-10-11 13:43:50.736157 7f440532f700 5 journal submit_entry seq 4014 len 205 (0x216e060) -8467> 2012-10-11 13:43:50.736159 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8466> 2012-10-11 13:43:50.736160 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8465> 2012-10-11 13:43:50.736174 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1424, time: 2012-10-11 13:43:50.736174, event: done, request: osd pg remove(epoch 7; pg2.dd; ) v1 -8464> 2012-10-11 13:43:50.736181 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 116632) -8463> 2012-10-11 13:43:50.736184 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 529 ==== pg_log(2.ee epoch 7 query_epoch 7) v3 ==== 507+0+0 (773975914 0 0) 0x2aa2a00 con 0x2fe2280 -8462> 2012-10-11 13:43:50.736191 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1425, time: 2012-10-11 13:43:49.967159, event: header_read, request: pg_log(2.ee epoch 7 query_epoch 7) v3 -8461> 2012-10-11 13:43:50.736195 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1425, time: 2012-10-11 13:43:49.967167, event: throttled, request: pg_log(2.ee epoch 7 query_epoch 7) v3 -8460> 2012-10-11 13:43:50.736199 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1425, time: 2012-10-11 13:43:49.967180, event: all_read, request: pg_log(2.ee epoch 7 query_epoch 7) v3 -8459> 2012-10-11 13:43:50.736202 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1425, time: 2012-10-11 13:43:50.736190, event: dispatched, request: pg_log(2.ee epoch 7 query_epoch 7) v3 -8458> 2012-10-11 13:43:50.736206 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1425, time: 2012-10-11 13:43:50.736206, event: waiting_for_osdmap, request: pg_log(2.ee epoch 7 query_epoch 7) v3 -8457> 2012-10-11 13:43:50.736211 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1425, time: 2012-10-11 13:43:50.736211, event: started, request: pg_log(2.ee epoch 7 query_epoch 7) v3 -8456> 2012-10-11 13:43:50.736218 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1425, time: 2012-10-11 13:43:50.736218, event: done, request: pg_log(2.ee epoch 7 query_epoch 7) v3 -8455> 2012-10-11 13:43:50.736223 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 116125) -8454> 2012-10-11 13:43:50.736225 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 874 ==== osd pg remove(epoch 7; pg2.de; ) v1 ==== 25+0+0 (2502238799 0 0) 0x331a380 con 0x2fe2140 -8453> 2012-10-11 13:43:50.736232 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1426, time: 2012-10-11 13:43:48.981860, event: header_read, request: osd pg remove(epoch 7; pg2.de; ) v1 -8452> 2012-10-11 13:43:50.736236 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1426, time: 2012-10-11 13:43:48.981864, event: throttled, request: osd pg remove(epoch 7; pg2.de; ) v1 -8451> 2012-10-11 13:43:50.736240 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1426, time: 2012-10-11 13:43:48.981867, event: all_read, request: osd pg remove(epoch 7; pg2.de; ) v1 -8450> 2012-10-11 13:43:50.736243 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1426, time: 2012-10-11 13:43:50.736231, event: dispatched, request: osd pg remove(epoch 7; pg2.de; ) v1 -8449> 2012-10-11 13:43:50.736247 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1426, time: 2012-10-11 13:43:50.736247, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.de; ) v1 -8448> 2012-10-11 13:43:50.736252 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1426, time: 2012-10-11 13:43:50.736252, event: started, request: osd pg remove(epoch 7; pg2.de; ) v1 -8447> 2012-10-11 13:43:50.736255 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.de -8446> 2012-10-11 13:43:50.736266 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.de 0x25cf060)/0x25cf060 -8445> 2012-10-11 13:43:50.736269 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8444> 2012-10-11 13:43:50.736270 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8443> 2012-10-11 13:43:50.736271 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4015 0x30745a0 -8442> 2012-10-11 13:43:50.736273 7f440532f700 5 journal submit_entry seq 4015 len 205 (0x325bba0) -8441> 2012-10-11 13:43:50.736275 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8440> 2012-10-11 13:43:50.736276 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8439> 2012-10-11 13:43:50.736289 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1426, time: 2012-10-11 13:43:50.736289, event: done, request: osd pg remove(epoch 7; pg2.de; ) v1 -8438> 2012-10-11 13:43:50.736297 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 116100) -8437> 2012-10-11 13:43:50.736299 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 530 ==== pg_log(2.f0 epoch 7 query_epoch 7) v3 ==== 507+0+0 (1546312712 0 0) 0x2aa2500 con 0x2fe2280 -8436> 2012-10-11 13:43:50.736307 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1427, time: 2012-10-11 13:43:49.967642, event: header_read, request: pg_log(2.f0 epoch 7 query_epoch 7) v3 -8435> 2012-10-11 13:43:50.736311 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1427, time: 2012-10-11 13:43:49.967652, event: throttled, request: pg_log(2.f0 epoch 7 query_epoch 7) v3 -8434> 2012-10-11 13:43:50.736314 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1427, time: 2012-10-11 13:43:49.967666, event: all_read, request: pg_log(2.f0 epoch 7 query_epoch 7) v3 -8433> 2012-10-11 13:43:50.736318 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1427, time: 2012-10-11 13:43:50.736306, event: dispatched, request: pg_log(2.f0 epoch 7 query_epoch 7) v3 -8432> 2012-10-11 13:43:50.736321 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1427, time: 2012-10-11 13:43:50.736321, event: waiting_for_osdmap, request: pg_log(2.f0 epoch 7 query_epoch 7) v3 -8431> 2012-10-11 13:43:50.736327 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1427, time: 2012-10-11 13:43:50.736327, event: started, request: pg_log(2.f0 epoch 7 query_epoch 7) v3 -8430> 2012-10-11 13:43:50.736334 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1427, time: 2012-10-11 13:43:50.736334, event: done, request: pg_log(2.f0 epoch 7 query_epoch 7) v3 -8429> 2012-10-11 13:43:50.736339 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 115593) -8428> 2012-10-11 13:43:50.736341 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 875 ==== osd pg remove(epoch 7; pg2.e2; ) v1 ==== 25+0+0 (2138425557 0 0) 0x331a1c0 con 0x2fe2140 -8427> 2012-10-11 13:43:50.736349 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1428, time: 2012-10-11 13:43:48.981871, event: header_read, request: osd pg remove(epoch 7; pg2.e2; ) v1 -8426> 2012-10-11 13:43:50.736353 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1428, time: 2012-10-11 13:43:48.981875, event: throttled, request: osd pg remove(epoch 7; pg2.e2; ) v1 -8425> 2012-10-11 13:43:50.736357 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1428, time: 2012-10-11 13:43:48.981879, event: all_read, request: osd pg remove(epoch 7; pg2.e2; ) v1 -8424> 2012-10-11 13:43:50.736361 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1428, time: 2012-10-11 13:43:50.736347, event: dispatched, request: osd pg remove(epoch 7; pg2.e2; ) v1 -8423> 2012-10-11 13:43:50.736365 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1428, time: 2012-10-11 13:43:50.736364, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.e2; ) v1 -8422> 2012-10-11 13:43:50.736369 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1428, time: 2012-10-11 13:43:50.736369, event: started, request: osd pg remove(epoch 7; pg2.e2; ) v1 -8421> 2012-10-11 13:43:50.736373 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.e2 -8420> 2012-10-11 13:43:50.736384 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.e2 0x2468db0)/0x2468db0 -8419> 2012-10-11 13:43:50.736387 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8418> 2012-10-11 13:43:50.736388 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8417> 2012-10-11 13:43:50.736388 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4016 0x3074d80 -8416> 2012-10-11 13:43:50.736391 7f440532f700 5 journal submit_entry seq 4016 len 205 (0x3235ae0) -8415> 2012-10-11 13:43:50.736392 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8414> 2012-10-11 13:43:50.736393 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8413> 2012-10-11 13:43:50.736408 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1428, time: 2012-10-11 13:43:50.736407, event: done, request: osd pg remove(epoch 7; pg2.e2; ) v1 -8412> 2012-10-11 13:43:50.736416 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 115568) -8411> 2012-10-11 13:43:50.736418 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 531 ==== pg_log(2.f3 epoch 7 query_epoch 7) v3 ==== 507+0+0 (1739456010 0 0) 0x2aa2000 con 0x2fe2280 -8410> 2012-10-11 13:43:50.736425 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1429, time: 2012-10-11 13:43:49.968556, event: header_read, request: pg_log(2.f3 epoch 7 query_epoch 7) v3 -8409> 2012-10-11 13:43:50.736429 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1429, time: 2012-10-11 13:43:49.968566, event: throttled, request: pg_log(2.f3 epoch 7 query_epoch 7) v3 -8408> 2012-10-11 13:43:50.736433 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1429, time: 2012-10-11 13:43:49.968578, event: all_read, request: pg_log(2.f3 epoch 7 query_epoch 7) v3 -8407> 2012-10-11 13:43:50.736436 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1429, time: 2012-10-11 13:43:50.736425, event: dispatched, request: pg_log(2.f3 epoch 7 query_epoch 7) v3 -8406> 2012-10-11 13:43:50.736440 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1429, time: 2012-10-11 13:43:50.736440, event: waiting_for_osdmap, request: pg_log(2.f3 epoch 7 query_epoch 7) v3 -8405> 2012-10-11 13:43:50.736446 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1429, time: 2012-10-11 13:43:50.736445, event: started, request: pg_log(2.f3 epoch 7 query_epoch 7) v3 -8404> 2012-10-11 13:43:50.736453 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1429, time: 2012-10-11 13:43:50.736453, event: done, request: pg_log(2.f3 epoch 7 query_epoch 7) v3 -8403> 2012-10-11 13:43:50.736458 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 115061) -8402> 2012-10-11 13:43:50.736460 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 876 ==== osd pg remove(epoch 7; pg2.e4; ) v1 ==== 25+0+0 (3423645942 0 0) 0x331a000 con 0x2fe2140 -8401> 2012-10-11 13:43:50.736466 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1430, time: 2012-10-11 13:43:48.981883, event: header_read, request: osd pg remove(epoch 7; pg2.e4; ) v1 -8400> 2012-10-11 13:43:50.736470 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1430, time: 2012-10-11 13:43:48.981886, event: throttled, request: osd pg remove(epoch 7; pg2.e4; ) v1 -8399> 2012-10-11 13:43:50.736474 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1430, time: 2012-10-11 13:43:48.981890, event: all_read, request: osd pg remove(epoch 7; pg2.e4; ) v1 -8398> 2012-10-11 13:43:50.736477 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1430, time: 2012-10-11 13:43:50.736466, event: dispatched, request: osd pg remove(epoch 7; pg2.e4; ) v1 -8397> 2012-10-11 13:43:50.736481 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1430, time: 2012-10-11 13:43:50.736481, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.e4; ) v1 -8396> 2012-10-11 13:43:50.736486 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1430, time: 2012-10-11 13:43:50.736486, event: started, request: osd pg remove(epoch 7; pg2.e4; ) v1 -8395> 2012-10-11 13:43:50.736491 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.e4 -8394> 2012-10-11 13:43:50.736503 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.e4 0x2468aa0)/0x2468aa0 -8393> 2012-10-11 13:43:50.736505 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8392> 2012-10-11 13:43:50.736506 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8391> 2012-10-11 13:43:50.736507 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4017 0x28acbd0 -8390> 2012-10-11 13:43:50.736510 7f440532f700 5 journal submit_entry seq 4017 len 205 (0x1f50960) -8389> 2012-10-11 13:43:50.736511 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8388> 2012-10-11 13:43:50.736512 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8387> 2012-10-11 13:43:50.736528 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1430, time: 2012-10-11 13:43:50.736528, event: done, request: osd pg remove(epoch 7; pg2.e4; ) v1 -8386> 2012-10-11 13:43:50.736536 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 115036) -8385> 2012-10-11 13:43:50.736538 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 532 ==== pg_log(2.f1 epoch 7 query_epoch 7) v3 ==== 507+0+0 (2305105131 0 0) 0x23f2a00 con 0x2fe2280 -8384> 2012-10-11 13:43:50.736546 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1431, time: 2012-10-11 13:43:49.971067, event: header_read, request: pg_log(2.f1 epoch 7 query_epoch 7) v3 -8383> 2012-10-11 13:43:50.736550 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1431, time: 2012-10-11 13:43:49.971075, event: throttled, request: pg_log(2.f1 epoch 7 query_epoch 7) v3 -8382> 2012-10-11 13:43:50.736554 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1431, time: 2012-10-11 13:43:49.971089, event: all_read, request: pg_log(2.f1 epoch 7 query_epoch 7) v3 -8381> 2012-10-11 13:43:50.736557 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1431, time: 2012-10-11 13:43:50.736545, event: dispatched, request: pg_log(2.f1 epoch 7 query_epoch 7) v3 -8380> 2012-10-11 13:43:50.736561 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1431, time: 2012-10-11 13:43:50.736561, event: waiting_for_osdmap, request: pg_log(2.f1 epoch 7 query_epoch 7) v3 -8379> 2012-10-11 13:43:50.736566 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1431, time: 2012-10-11 13:43:50.736566, event: started, request: pg_log(2.f1 epoch 7 query_epoch 7) v3 -8378> 2012-10-11 13:43:50.736574 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1431, time: 2012-10-11 13:43:50.736574, event: done, request: pg_log(2.f1 epoch 7 query_epoch 7) v3 -8377> 2012-10-11 13:43:50.736579 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 114529) -8376> 2012-10-11 13:43:50.736581 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 877 ==== osd pg remove(epoch 7; pg2.fd; ) v1 ==== 25+0+0 (1130479807 0 0) 0x31d1e00 con 0x2fe2140 -8375> 2012-10-11 13:43:50.736587 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1432, time: 2012-10-11 13:43:48.981894, event: header_read, request: osd pg remove(epoch 7; pg2.fd; ) v1 -8374> 2012-10-11 13:43:50.736591 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1432, time: 2012-10-11 13:43:48.981897, event: throttled, request: osd pg remove(epoch 7; pg2.fd; ) v1 -8373> 2012-10-11 13:43:50.736595 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1432, time: 2012-10-11 13:43:48.981902, event: all_read, request: osd pg remove(epoch 7; pg2.fd; ) v1 -8372> 2012-10-11 13:43:50.736599 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1432, time: 2012-10-11 13:43:50.736587, event: dispatched, request: osd pg remove(epoch 7; pg2.fd; ) v1 -8371> 2012-10-11 13:43:50.736602 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1432, time: 2012-10-11 13:43:50.736602, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.fd; ) v1 -8370> 2012-10-11 13:43:50.736607 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1432, time: 2012-10-11 13:43:50.736607, event: started, request: osd pg remove(epoch 7; pg2.fd; ) v1 -8369> 2012-10-11 13:43:50.736610 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.fd -8368> 2012-10-11 13:43:50.736625 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.fd 0x25cf300)/0x25cf300 -8367> 2012-10-11 13:43:50.736627 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8366> 2012-10-11 13:43:50.736628 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8365> 2012-10-11 13:43:50.736629 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4018 0x31cb5a0 -8364> 2012-10-11 13:43:50.736632 7f440532f700 5 journal submit_entry seq 4018 len 205 (0x33b05a0) -8363> 2012-10-11 13:43:50.736634 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8362> 2012-10-11 13:43:50.736636 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8361> 2012-10-11 13:43:50.736652 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1432, time: 2012-10-11 13:43:50.736652, event: done, request: osd pg remove(epoch 7; pg2.fd; ) v1 -8360> 2012-10-11 13:43:50.736661 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 114504) -8359> 2012-10-11 13:43:50.736663 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 533 ==== pg_log(2.f9 epoch 7 query_epoch 7) v3 ==== 507+0+0 (2227289438 0 0) 0x23f2500 con 0x2fe2280 -8428> 2012-10-11 13:43:50.736671 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1433, time: 2012-10-11 13:43:49.971363, event: header_read, request: pg_log(2.f9 epoch 7 query_epoch 7) v3 -8427> 2012-10-11 13:43:50.736675 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1433, time: 2012-10-11 13:43:49.971371, event: throttled, request: pg_log(2.f9 epoch 7 query_epoch 7) v3 -8426> 2012-10-11 13:43:50.736679 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1433, time: 2012-10-11 13:43:49.971382, event: all_read, request: pg_log(2.f9 epoch 7 query_epoch 7) v3 -8425> 2012-10-11 13:43:50.736682 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1433, time: 2012-10-11 13:43:50.736670, event: dispatched, request: pg_log(2.f9 epoch 7 query_epoch 7) v3 -8424> 2012-10-11 13:43:50.736686 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1433, time: 2012-10-11 13:43:50.736686, event: waiting_for_osdmap, request: pg_log(2.f9 epoch 7 query_epoch 7) v3 -8423> 2012-10-11 13:43:50.736691 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1433, time: 2012-10-11 13:43:50.736691, event: started, request: pg_log(2.f9 epoch 7 query_epoch 7) v3 -8422> 2012-10-11 13:43:50.736698 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1433, time: 2012-10-11 13:43:50.736698, event: done, request: pg_log(2.f9 epoch 7 query_epoch 7) v3 -8421> 2012-10-11 13:43:50.736703 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 113997) -8420> 2012-10-11 13:43:50.736705 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 878 ==== osd pg remove(epoch 7; pg0.f; ) v1 ==== 25+0+0 (2543478407 0 0) 0x31d1c40 con 0x2fe2140 -8419> 2012-10-11 13:43:50.736712 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1434, time: 2012-10-11 13:43:48.981906, event: header_read, request: osd pg remove(epoch 7; pg0.f; ) v1 -8418> 2012-10-11 13:43:50.736716 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1434, time: 2012-10-11 13:43:48.981910, event: throttled, request: osd pg remove(epoch 7; pg0.f; ) v1 -8417> 2012-10-11 13:43:50.736720 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1434, time: 2012-10-11 13:43:48.981914, event: all_read, request: osd pg remove(epoch 7; pg0.f; ) v1 -8416> 2012-10-11 13:43:50.736723 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1434, time: 2012-10-11 13:43:50.736711, event: dispatched, request: osd pg remove(epoch 7; pg0.f; ) v1 -8415> 2012-10-11 13:43:50.736727 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1434, time: 2012-10-11 13:43:50.736727, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.f; ) v1 -8414> 2012-10-11 13:43:50.736732 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1434, time: 2012-10-11 13:43:50.736732, event: started, request: osd pg remove(epoch 7; pg0.f; ) v1 -8413> 2012-10-11 13:43:50.736735 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.f -8412> 2012-10-11 13:43:50.736747 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.f 0x1d71500)/0x1d71500 -8411> 2012-10-11 13:43:50.736749 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8410> 2012-10-11 13:43:50.736750 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8409> 2012-10-11 13:43:50.736751 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4019 0x31cb630 -8408> 2012-10-11 13:43:50.736753 7f440532f700 5 journal submit_entry seq 4019 len 201 (0x33f3c60) -8417> 2012-10-11 13:43:50.736755 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8416> 2012-10-11 13:43:50.736756 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 201 -8415> 2012-10-11 13:43:50.736773 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1434, time: 2012-10-11 13:43:50.736773, event: done, request: osd pg remove(epoch 7; pg0.f; ) v1 -8414> 2012-10-11 13:43:50.736781 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 113972) -8413> 2012-10-11 13:43:50.736783 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 534 ==== pg_log(2.f7 epoch 7 query_epoch 7) v3 ==== 507+0+0 (1971486683 0 0) 0x23f2000 con 0x2fe2280 -8412> 2012-10-11 13:43:50.736791 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1435, time: 2012-10-11 13:43:49.971436, event: header_read, request: pg_log(2.f7 epoch 7 query_epoch 7) v3 -8411> 2012-10-11 13:43:50.736797 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1435, time: 2012-10-11 13:43:49.971443, event: throttled, request: pg_log(2.f7 epoch 7 query_epoch 7) v3 -8410> 2012-10-11 13:43:50.736800 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1435, time: 2012-10-11 13:43:49.971454, event: all_read, request: pg_log(2.f7 epoch 7 query_epoch 7) v3 -8409> 2012-10-11 13:43:50.736804 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1435, time: 2012-10-11 13:43:50.736790, event: dispatched, request: pg_log(2.f7 epoch 7 query_epoch 7) v3 -8408> 2012-10-11 13:43:50.736808 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1435, time: 2012-10-11 13:43:50.736807, event: waiting_for_osdmap, request: pg_log(2.f7 epoch 7 query_epoch 7) v3 -8407> 2012-10-11 13:43:50.736813 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1435, time: 2012-10-11 13:43:50.736813, event: started, request: pg_log(2.f7 epoch 7 query_epoch 7) v3 -8406> 2012-10-11 13:43:50.736820 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1435, time: 2012-10-11 13:43:50.736820, event: done, request: pg_log(2.f7 epoch 7 query_epoch 7) v3 -8405> 2012-10-11 13:43:50.736825 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 113465) -8404> 2012-10-11 13:43:50.736827 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 879 ==== osd pg remove(epoch 7; pg0.7; ) v1 ==== 25+0+0 (3584123485 0 0) 0x31d1a80 con 0x2fe2140 -8403> 2012-10-11 13:43:50.736835 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1436, time: 2012-10-11 13:43:48.981918, event: header_read, request: osd pg remove(epoch 7; pg0.7; ) v1 -8402> 2012-10-11 13:43:50.736839 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1436, time: 2012-10-11 13:43:48.981921, event: throttled, request: osd pg remove(epoch 7; pg0.7; ) v1 -8401> 2012-10-11 13:43:50.736843 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1436, time: 2012-10-11 13:43:48.981925, event: all_read, request: osd pg remove(epoch 7; pg0.7; ) v1 -8400> 2012-10-11 13:43:50.736846 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1436, time: 2012-10-11 13:43:50.736834, event: dispatched, request: osd pg remove(epoch 7; pg0.7; ) v1 -8399> 2012-10-11 13:43:50.736850 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1436, time: 2012-10-11 13:43:50.736850, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.7; ) v1 -8398> 2012-10-11 13:43:50.736854 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1436, time: 2012-10-11 13:43:50.736854, event: started, request: osd pg remove(epoch 7; pg0.7; ) v1 -8397> 2012-10-11 13:43:50.736858 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.7 -8396> 2012-10-11 13:43:50.736869 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.7 0x1d71350)/0x1d71350 -8395> 2012-10-11 13:43:50.736872 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8394> 2012-10-11 13:43:50.736873 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8393> 2012-10-11 13:43:50.736874 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4020 0x31cb990 -8392> 2012-10-11 13:43:50.736876 7f440532f700 5 journal submit_entry seq 4020 len 201 (0x1ee5450) -8391> 2012-10-11 13:43:50.736878 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8390> 2012-10-11 13:43:50.736879 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 201 -8389> 2012-10-11 13:43:50.736892 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1436, time: 2012-10-11 13:43:50.736892, event: done, request: osd pg remove(epoch 7; pg0.7; ) v1 -8388> 2012-10-11 13:43:50.736900 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 113440) -8387> 2012-10-11 13:43:50.736902 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 535 ==== pg_log(2.fa epoch 7 query_epoch 7) v3 ==== 507+0+0 (2445790418 0 0) 0x2bcea00 con 0x2fe2280 -8386> 2012-10-11 13:43:50.736911 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1437, time: 2012-10-11 13:43:49.972698, event: header_read, request: pg_log(2.fa epoch 7 query_epoch 7) v3 -8385> 2012-10-11 13:43:50.736915 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1437, time: 2012-10-11 13:43:49.972706, event: throttled, request: pg_log(2.fa epoch 7 query_epoch 7) v3 -8384> 2012-10-11 13:43:50.736919 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1437, time: 2012-10-11 13:43:49.972720, event: all_read, request: pg_log(2.fa epoch 7 query_epoch 7) v3 -8383> 2012-10-11 13:43:50.736922 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1437, time: 2012-10-11 13:43:50.736910, event: dispatched, request: pg_log(2.fa epoch 7 query_epoch 7) v3 -8382> 2012-10-11 13:43:50.736926 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1437, time: 2012-10-11 13:43:50.736926, event: waiting_for_osdmap, request: pg_log(2.fa epoch 7 query_epoch 7) v3 -8381> 2012-10-11 13:43:50.736931 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1437, time: 2012-10-11 13:43:50.736931, event: started, request: pg_log(2.fa epoch 7 query_epoch 7) v3 -8380> 2012-10-11 13:43:50.736938 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1437, time: 2012-10-11 13:43:50.736938, event: done, request: pg_log(2.fa epoch 7 query_epoch 7) v3 -8379> 2012-10-11 13:43:50.736945 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 112933) -8378> 2012-10-11 13:43:50.736947 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 880 ==== osd pg remove(epoch 7; pg1.9c; ) v1 ==== 25+0+0 (245724096 0 0) 0x31d18c0 con 0x2fe2140 -8377> 2012-10-11 13:43:50.736954 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1438, time: 2012-10-11 13:43:48.981929, event: header_read, request: osd pg remove(epoch 7; pg1.9c; ) v1 -8396> 2012-10-11 13:43:50.736958 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1438, time: 2012-10-11 13:43:48.981932, event: throttled, request: osd pg remove(epoch 7; pg1.9c; ) v1 -8395> 2012-10-11 13:43:50.736962 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1438, time: 2012-10-11 13:43:48.981936, event: all_read, request: osd pg remove(epoch 7; pg1.9c; ) v1 -8394> 2012-10-11 13:43:50.736965 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1438, time: 2012-10-11 13:43:50.736953, event: dispatched, request: osd pg remove(epoch 7; pg1.9c; ) v1 -8393> 2012-10-11 13:43:50.736969 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1438, time: 2012-10-11 13:43:50.736969, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.9c; ) v1 -8392> 2012-10-11 13:43:50.736973 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1438, time: 2012-10-11 13:43:50.736973, event: started, request: osd pg remove(epoch 7; pg1.9c; ) v1 -8391> 2012-10-11 13:43:50.736977 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.9c -8390> 2012-10-11 13:43:50.736988 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.9c 0x2adbe60)/0x2adbe60 -8389> 2012-10-11 13:43:50.736991 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8388> 2012-10-11 13:43:50.736992 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8387> 2012-10-11 13:43:50.736993 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4021 0x31cbbd0 -8386> 2012-10-11 13:43:50.736995 7f440532f700 5 journal submit_entry seq 4021 len 205 (0x1e960c0) -8385> 2012-10-11 13:43:50.736997 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8384> 2012-10-11 13:43:50.736998 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8383> 2012-10-11 13:43:50.737012 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1438, time: 2012-10-11 13:43:50.737012, event: done, request: osd pg remove(epoch 7; pg1.9c; ) v1 -8382> 2012-10-11 13:43:50.737019 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 112908) -8381> 2012-10-11 13:43:50.737022 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 536 ==== pg_log(1.8d epoch 7 query_epoch 7) v3 ==== 507+0+0 (3914002498 0 0) 0x2bce500 con 0x2fe2280 -8380> 2012-10-11 13:43:50.737029 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1439, time: 2012-10-11 13:43:49.998041, event: header_read, request: pg_log(1.8d epoch 7 query_epoch 7) v3 -8379> 2012-10-11 13:43:50.737033 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1439, time: 2012-10-11 13:43:49.998052, event: throttled, request: pg_log(1.8d epoch 7 query_epoch 7) v3 -8378> 2012-10-11 13:43:50.737037 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1439, time: 2012-10-11 13:43:49.998066, event: all_read, request: pg_log(1.8d epoch 7 query_epoch 7) v3 -8377> 2012-10-11 13:43:50.737040 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1439, time: 2012-10-11 13:43:50.737028, event: dispatched, request: pg_log(1.8d epoch 7 query_epoch 7) v3 -8376> 2012-10-11 13:43:50.737044 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1439, time: 2012-10-11 13:43:50.737044, event: waiting_for_osdmap, request: pg_log(1.8d epoch 7 query_epoch 7) v3 -8375> 2012-10-11 13:43:50.737049 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1439, time: 2012-10-11 13:43:50.737049, event: started, request: pg_log(1.8d epoch 7 query_epoch 7) v3 -8374> 2012-10-11 13:43:50.737056 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1439, time: 2012-10-11 13:43:50.737056, event: done, request: pg_log(1.8d epoch 7 query_epoch 7) v3 -8373> 2012-10-11 13:43:50.737061 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 112401) -8372> 2012-10-11 13:43:50.737063 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 881 ==== pg_info(1 pgs e6:1.db) v3 ==== 471+0+0 (2662412990 0 0) 0x31d1700 con 0x2fe2140 -8371> 2012-10-11 13:43:50.737070 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1440, time: 2012-10-11 13:43:48.981939, event: header_read, request: pg_info(1 pgs e6:1.db) v3 -8370> 2012-10-11 13:43:50.737074 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1440, time: 2012-10-11 13:43:48.981943, event: throttled, request: pg_info(1 pgs e6:1.db) v3 -8369> 2012-10-11 13:43:50.737078 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1440, time: 2012-10-11 13:43:48.981956, event: all_read, request: pg_info(1 pgs e6:1.db) v3 -8368> 2012-10-11 13:43:50.737081 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1440, time: 2012-10-11 13:43:50.737069, event: dispatched, request: pg_info(1 pgs e6:1.db) v3 -8367> 2012-10-11 13:43:50.737088 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1440, time: 2012-10-11 13:43:50.737088, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.db) v3 -8366> 2012-10-11 13:43:50.737092 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1440, time: 2012-10-11 13:43:50.737092, event: started, request: pg_info(1 pgs e6:1.db) v3 -8365> 2012-10-11 13:43:50.737105 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1440, time: 2012-10-11 13:43:50.737105, event: done, request: pg_info(1 pgs e6:1.db) v3 -8364> 2012-10-11 13:43:50.737112 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 111930) -8363> 2012-10-11 13:43:50.737114 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 537 ==== osd pg remove(epoch 7; pg2.15; ) v1 ==== 25+0+0 (576453802 0 0) 0x20b0000 con 0x2fe2280 -8362> 2012-10-11 13:43:50.737121 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1441, time: 2012-10-11 13:43:50.032973, event: header_read, request: osd pg remove(epoch 7; pg2.15; ) v1 -8361> 2012-10-11 13:43:50.737126 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1441, time: 2012-10-11 13:43:50.032987, event: throttled, request: osd pg remove(epoch 7; pg2.15; ) v1 -8360> 2012-10-11 13:43:50.737129 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1441, time: 2012-10-11 13:43:50.032995, event: all_read, request: osd pg remove(epoch 7; pg2.15; ) v1 -8359> 2012-10-11 13:43:50.737133 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1441, time: 2012-10-11 13:43:50.737121, event: dispatched, request: osd pg remove(epoch 7; pg2.15; ) v1 -8358> 2012-10-11 13:43:50.737137 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1441, time: 2012-10-11 13:43:50.737137, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.15; ) v1 -8357> 2012-10-11 13:43:50.737141 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1441, time: 2012-10-11 13:43:50.737141, event: started, request: osd pg remove(epoch 7; pg2.15; ) v1 -8356> 2012-10-11 13:43:50.737145 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.15 -8355> 2012-10-11 13:43:50.737158 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.15 0x3176460)/0x3176460 -8354> 2012-10-11 13:43:50.737160 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8353> 2012-10-11 13:43:50.737161 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8352> 2012-10-11 13:43:50.737162 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4022 0x31cbd80 -8351> 2012-10-11 13:43:50.737165 7f440532f700 5 journal submit_entry seq 4022 len 205 (0x2dc3c60) -8350> 2012-10-11 13:43:50.737167 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8349> 2012-10-11 13:43:50.737168 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8348> 2012-10-11 13:43:50.737184 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1441, time: 2012-10-11 13:43:50.737184, event: done, request: osd pg remove(epoch 7; pg2.15; ) v1 -8347> 2012-10-11 13:43:50.737192 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 111905) -8346> 2012-10-11 13:43:50.737194 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 882 ==== pg_info(1 pgs e6:2.db) v3 ==== 471+0+0 (1721911061 0 0) 0x31d1540 con 0x2fe2140 -8345> 2012-10-11 13:43:50.737202 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1442, time: 2012-10-11 13:43:48.981960, event: header_read, request: pg_info(1 pgs e6:2.db) v3 -8344> 2012-10-11 13:43:50.737206 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1442, time: 2012-10-11 13:43:48.981964, event: throttled, request: pg_info(1 pgs e6:2.db) v3 -8343> 2012-10-11 13:43:50.737210 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1442, time: 2012-10-11 13:43:48.981973, event: all_read, request: pg_info(1 pgs e6:2.db) v3 -8342> 2012-10-11 13:43:50.737213 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1442, time: 2012-10-11 13:43:50.737201, event: dispatched, request: pg_info(1 pgs e6:2.db) v3 -8341> 2012-10-11 13:43:50.737217 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1442, time: 2012-10-11 13:43:50.737217, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.db) v3 -8340> 2012-10-11 13:43:50.737222 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1442, time: 2012-10-11 13:43:50.737222, event: started, request: pg_info(1 pgs e6:2.db) v3 -8339> 2012-10-11 13:43:50.737233 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1442, time: 2012-10-11 13:43:50.737233, event: done, request: pg_info(1 pgs e6:2.db) v3 -8338> 2012-10-11 13:43:50.737239 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 111434) -8337> 2012-10-11 13:43:50.737653 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.8 0x1d71360)/0x1d71360 -8336> 2012-10-11 13:43:50.737661 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8335> 2012-10-11 13:43:50.737662 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8334> 2012-10-11 13:43:50.737665 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4023 0x2d17360 -8333> 2012-10-11 13:43:50.737669 7f4402a29700 5 journal submit_entry seq 4023 len 963 (0x24f82d0) -8332> 2012-10-11 13:43:50.737671 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8331> 2012-10-11 13:43:50.737672 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -8330> 2012-10-11 13:43:50.737702 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.9 epoch 8 query_epoch 8) v3 -- ?+0 0x25b8000 -8358> 2012-10-11 13:43:50.738135 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.9 0x31763f0)/0x31763f0 -8357> 2012-10-11 13:43:50.738141 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8356> 2012-10-11 13:43:50.738142 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8355> 2012-10-11 13:43:50.738143 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4024 0x2d17090 -8354> 2012-10-11 13:43:50.738147 7f4402a29700 5 journal submit_entry seq 4024 len 963 (0x204d4e0) -8354> 2012-10-11 13:43:50.738148 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8353> 2012-10-11 13:43:50.738150 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -8352> 2012-10-11 13:43:50.738180 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.a epoch 8 query_epoch 8) v3 -- ?+0 0x209aa00 -8351> 2012-10-11 13:43:50.738256 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.a 0x31763c0)/0x31763c0 -8350> 2012-10-11 13:43:50.738264 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8349> 2012-10-11 13:43:50.738266 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8348> 2012-10-11 13:43:50.738267 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4025 0x2d171b0 -8347> 2012-10-11 13:43:50.738271 7f4402a29700 5 journal submit_entry seq 4025 len 963 (0x210b4b0) -8346> 2012-10-11 13:43:50.738272 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8345> 2012-10-11 13:43:50.738274 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -8344> 2012-10-11 13:43:50.738302 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.d9 epoch 8 query_epoch 8) v3 -- ?+0 0x209a500 -8343> 2012-10-11 13:43:50.738370 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.d9 0x25cf150)/0x25cf150 -8342> 2012-10-11 13:43:50.738376 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8341> 2012-10-11 13:43:50.738377 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8340> 2012-10-11 13:43:50.738378 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4026 0x2d17480 -8339> 2012-10-11 13:43:50.738381 7f4402a29700 5 journal submit_entry seq 4026 len 969 (0x2d191e0) -8338> 2012-10-11 13:43:50.738383 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8337> 2012-10-11 13:43:50.738384 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8336> 2012-10-11 13:43:50.738412 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.df epoch 8 query_epoch 8) v3 -- ?+0 0x209a000 -8335> 2012-10-11 13:43:50.738479 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.df 0x25cf030)/0x25cf030 -8334> 2012-10-11 13:43:50.738484 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8342> 2012-10-11 13:43:50.738486 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8341> 2012-10-11 13:43:50.738487 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4027 0x2bd6870 -8340> 2012-10-11 13:43:50.738490 7f4402a29700 5 journal submit_entry seq 4027 len 969 (0x2863780) -8339> 2012-10-11 13:43:50.738492 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8339> 2012-10-11 13:43:50.738493 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8338> 2012-10-11 13:43:50.738521 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.e0 epoch 8 query_epoch 8) v3 -- ?+0 0x1f70a00 -8337> 2012-10-11 13:43:50.738589 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.e0 0x25cf260)/0x25cf260 -8336> 2012-10-11 13:43:50.738594 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8335> 2012-10-11 13:43:50.738596 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8334> 2012-10-11 13:43:50.738597 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4028 0x2bd6900 -8333> 2012-10-11 13:43:50.738600 7f4402a29700 5 journal submit_entry seq 4028 len 969 (0x21c7b70) -8332> 2012-10-11 13:43:50.738602 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8331> 2012-10-11 13:43:50.738603 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8330> 2012-10-11 13:43:50.738631 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.e7 epoch 8 query_epoch 8) v3 -- ?+0 0x1f70500 -8329> 2012-10-11 13:43:50.738699 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.e7 0x2468b10)/0x2468b10 -8328> 2012-10-11 13:43:50.738704 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8327> 2012-10-11 13:43:50.738706 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8326> 2012-10-11 13:43:50.738707 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4029 0x2bd61b0 -8325> 2012-10-11 13:43:50.738710 7f4402a29700 5 journal submit_entry seq 4029 len 969 (0x2ed34e0) -8324> 2012-10-11 13:43:50.738712 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8323> 2012-10-11 13:43:50.738714 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8322> 2012-10-11 13:43:50.738740 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.ea epoch 8 query_epoch 8) v3 -- ?+0 0x1f70000 -8321> 2012-10-11 13:43:50.738806 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.ea 0x25cf290)/0x25cf290 -8320> 2012-10-11 13:43:50.738811 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8319> 2012-10-11 13:43:50.738813 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8318> 2012-10-11 13:43:50.738814 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4030 0x2bd63f0 -8326> 2012-10-11 13:43:50.738817 7f4402a29700 5 journal submit_entry seq 4030 len 969 (0x1e96000) -8325> 2012-10-11 13:43:50.738818 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8324> 2012-10-11 13:43:50.738820 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8332> 2012-10-11 13:43:50.738849 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.eb epoch 8 query_epoch 8) v3 -- ?+0 0x2c02a00 -8331> 2012-10-11 13:43:50.738914 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.eb 0x2468e60)/0x2468e60 -8331> 2012-10-11 13:43:50.738920 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8330> 2012-10-11 13:43:50.738921 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8329> 2012-10-11 13:43:50.738922 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4031 0x2bd6510 -8328> 2012-10-11 13:43:50.738926 7f4402a29700 5 journal submit_entry seq 4031 len 969 (0x28a8090) -8327> 2012-10-11 13:43:50.738927 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8326> 2012-10-11 13:43:50.738929 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8325> 2012-10-11 13:43:50.738956 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.f6 epoch 8 query_epoch 8) v3 -- ?+0 0x2c02500 -8324> 2012-10-11 13:43:50.739024 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.f6 0x25cf450)/0x25cf450 -8323> 2012-10-11 13:43:50.739029 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8322> 2012-10-11 13:43:50.739031 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8321> 2012-10-11 13:43:50.739032 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4032 0x2bd6a20 -8321> 2012-10-11 13:43:50.739035 7f4402a29700 5 journal submit_entry seq 4032 len 969 (0x2e183c0) -8320> 2012-10-11 13:43:50.739037 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8319> 2012-10-11 13:43:50.739038 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8318> 2012-10-11 13:43:50.739066 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.fb epoch 8 query_epoch 8) v3 -- ?+0 0x2c02000 -8317> 2012-10-11 13:43:50.739133 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.fb 0x25cf360)/0x25cf360 -8335> 2012-10-11 13:43:50.739139 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8334> 2012-10-11 13:43:50.739141 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8333> 2012-10-11 13:43:50.739142 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4033 0x2bd66c0 -8332> 2012-10-11 13:43:50.739145 7f4402a29700 5 journal submit_entry seq 4033 len 969 (0x28767b0) -8331> 2012-10-11 13:43:50.739146 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8330> 2012-10-11 13:43:50.739148 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8329> 2012-10-11 13:43:50.739197 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.8b epoch 8 query_epoch 8) v3 -- ?+0 0x2e72a00 -8328> 2012-10-11 13:43:50.739264 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.8b 0x2130b40)/0x2130b40 -8327> 2012-10-11 13:43:50.739270 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8326> 2012-10-11 13:43:50.739271 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8325> 2012-10-11 13:43:50.739272 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4034 0x2bd6ea0 -8324> 2012-10-11 13:43:50.739275 7f4402a29700 5 journal submit_entry seq 4034 len 969 (0x2d6c0f0) -8323> 2012-10-11 13:43:50.739277 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8322> 2012-10-11 13:43:50.739279 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8321> 2012-10-11 13:43:50.739310 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.8a epoch 8 query_epoch 8) v3 -- ?+0 0x2e72500 -8320> 2012-10-11 13:43:50.739377 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.8a 0x2adbdc0)/0x2adbdc0 -8319> 2012-10-11 13:43:50.739383 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8318> 2012-10-11 13:43:50.739385 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8317> 2012-10-11 13:43:50.739386 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4035 0x2bd6f30 -8316> 2012-10-11 13:43:50.739389 7f4402a29700 5 journal submit_entry seq 4035 len 969 (0x2e13f60) -8325> 2012-10-11 13:43:50.739391 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8324> 2012-10-11 13:43:50.739392 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8323> 2012-10-11 13:43:50.739425 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.88 epoch 8 query_epoch 8) v3 -- ?+0 0x2e72000 -8322> 2012-10-11 13:43:50.739491 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.88 0x2130ad0)/0x2130ad0 -8321> 2012-10-11 13:43:50.739497 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8320> 2012-10-11 13:43:50.739499 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8319> 2012-10-11 13:43:50.739500 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4036 0x25f2900 -8318> 2012-10-11 13:43:50.739503 7f4402a29700 5 journal submit_entry seq 4036 len 969 (0x216ea80) -8317> 2012-10-11 13:43:50.739504 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8316> 2012-10-11 13:43:50.739506 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8315> 2012-10-11 13:43:50.739534 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.89 epoch 8 query_epoch 8) v3 -- ?+0 0x2c3da00 -8314> 2012-10-11 13:43:50.739587 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.89 0x3176c40)/0x3176c40 -8313> 2012-10-11 13:43:50.739591 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8312> 2012-10-11 13:43:50.739593 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8311> 2012-10-11 13:43:50.739594 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4037 0x2aa3900 -8310> 2012-10-11 13:43:50.739597 7f4402a29700 5 journal submit_entry seq 4037 len 969 (0x28811e0) -8310> 2012-10-11 13:43:50.739599 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8309> 2012-10-11 13:43:50.739600 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8308> 2012-10-11 13:43:50.739621 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_notify(1.81(1),2.7d(1),0.7f(1),1.7e(1),0.6d(2),0.71(2),0.74(2),0.75(2),0.77(2),0.7e(2),0.80(2),0.83(2),0.84(2),0.85(2),0.86(2) epoch 8) v4 -- ?+0 0x309a540 -8307> 2012-10-11 13:43:50.739640 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_notify(0.92(2),0.93(2),1.16(2),1.1c(2),1.1f(2),1.20(2),1.21(2),1.27(2),1.6e(2),1.72(2),1.79(2),1.7a(2),0.a5(2),0.c0(2),0.c6(2),0.cf(2),0.d3(2),0.d8(2),1.a4(2),1.bf(2),1.c5(2),1.ce(2),1.d2(2),1.d7(2),2.a3(2),2.be(2),2.c4(2),2.cd(2),2.d1(2),2.d6(2),0.8(2),0.e8(2),0.ee(2),0.f0(2),0.f2(2),0.f3(2),0.f5(2),0.f9(2),0.fb(2),0.fc(2),1.7(2),1.e7(2),1.ed(2),1.ef(2),1.f1(2),1.f2(2),1.f4(2),1.f8(2),1.fa(2),1.fb(2),2.6(2),2.e6(2),2.ec(2),2.ee(2),2.f0(2),2.f1(2),2.f3(2),2.f7(2),2.f9(2),2.fa(2),1.8d(2) epoch 8) v4 -- ?+0 0x309a700 -8306> 2012-10-11 13:43:50.740230 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(1.d0 epoch 8 query_epoch 7) v3 -- ?+0 0x2c3d500 -8305> 2012-10-11 13:43:50.740451 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ff 0x3176360)/0x3176360 -8323> 2012-10-11 13:43:50.740467 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8322> 2012-10-11 13:43:50.740475 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8321> 2012-10-11 13:43:50.740482 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4038 0x2aa33f0 -8320> 2012-10-11 13:43:50.740491 7f4402a29700 5 journal submit_entry seq 4038 len 1052 (0x1e96870) -8319> 2012-10-11 13:43:50.740499 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8318> 2012-10-11 13:43:50.740507 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 1052 -8317> 2012-10-11 13:43:50.740540 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a5 0x24680b0)/0x24680b0 -8316> 2012-10-11 13:43:50.740553 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8315> 2012-10-11 13:43:50.740560 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8314> 2012-10-11 13:43:50.740567 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4039 0x2aa3a20 -8313> 2012-10-11 13:43:50.740576 7f4402a29700 5 journal submit_entry seq 4039 len 969 (0x2dc3de0) -8312> 2012-10-11 13:43:50.740584 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8311> 2012-10-11 13:43:50.740591 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8310> 2012-10-11 13:43:50.740624 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.b0 0x2e382a0)/0x2e382a0 -8309> 2012-10-11 13:43:50.740635 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8308> 2012-10-11 13:43:50.740643 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8307> 2012-10-11 13:43:50.740650 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4040 0x2a26360 -8306> 2012-10-11 13:43:50.740659 7f4402a29700 5 journal submit_entry seq 4040 len 1182 (0x2863a20) -8305> 2012-10-11 13:43:50.740666 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8304> 2012-10-11 13:43:50.740674 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 1182 -8303> 2012-10-11 13:43:50.740704 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.c0 0x24687a0)/0x24687a0 -8302> 2012-10-11 13:43:50.740714 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8301> 2012-10-11 13:43:50.740721 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8300> 2012-10-11 13:43:50.740728 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4041 0x2f21900 -8299> 2012-10-11 13:43:50.740737 7f4402a29700 5 journal submit_entry seq 4041 len 969 (0x2dc3d50) -8298> 2012-10-11 13:43:50.740745 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8297> 2012-10-11 13:43:50.740752 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8296> 2012-10-11 13:43:50.740782 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ad 0x2e38330)/0x2e38330 -8295> 2012-10-11 13:43:50.740793 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8294> 2012-10-11 13:43:50.740800 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8293> 2012-10-11 13:43:50.740807 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4042 0x2aa3cf0 -8292> 2012-10-11 13:43:50.740815 7f4402a29700 5 journal submit_entry seq 4042 len 1055 (0x1f50210) -8291> 2012-10-11 13:43:50.740823 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8300> 2012-10-11 13:43:50.740830 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 1055 -8299> 2012-10-11 13:43:50.740859 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.c6 0x2468680)/0x2468680 -8298> 2012-10-11 13:43:50.740869 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8297> 2012-10-11 13:43:50.740876 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8296> 2012-10-11 13:43:50.740883 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4043 0x2f213f0 -8295> 2012-10-11 13:43:50.740892 7f4402a29700 5 journal submit_entry seq 4043 len 969 (0x2dc3e40) -8294> 2012-10-11 13:43:50.740900 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8293> 2012-10-11 13:43:50.740908 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8292> 2012-10-11 13:43:50.740920 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_log(1.7f epoch 8 query_epoch 7) v3 -- ?+0 0x23c4500 -8291> 2012-10-11 13:43:50.740962 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.cf 0x24688d0)/0x24688d0 -8290> 2012-10-11 13:43:50.740974 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8289> 2012-10-11 13:43:50.740981 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8288> 2012-10-11 13:43:50.740988 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4044 0x2aa3f30 -8287> 2012-10-11 13:43:50.740996 7f4402a29700 5 journal submit_entry seq 4044 len 969 (0x2dc3e10) -8296> 2012-10-11 13:43:50.741004 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8296> 2012-10-11 13:43:50.741011 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8295> 2012-10-11 13:43:50.741040 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.d3 0x2468810)/0x2468810 -8294> 2012-10-11 13:43:50.741051 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8293> 2012-10-11 13:43:50.741058 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8292> 2012-10-11 13:43:50.741065 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4045 0x2aa3b40 -8291> 2012-10-11 13:43:50.741074 7f4402a29700 5 journal submit_entry seq 4045 len 969 (0x2dc3cc0) -8290> 2012-10-11 13:43:50.741082 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8289> 2012-10-11 13:43:50.741089 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8288> 2012-10-11 13:43:50.741118 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.d8 0x2468b20)/0x2468b20 -8287> 2012-10-11 13:43:50.741128 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8286> 2012-10-11 13:43:50.741135 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8285> 2012-10-11 13:43:50.741142 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4046 0x2aa3510 -8284> 2012-10-11 13:43:50.741151 7f4402a29700 5 journal submit_entry seq 4046 len 969 (0x2442360) -8293> 2012-10-11 13:43:50.741159 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8292> 2012-10-11 13:43:50.741166 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8291> 2012-10-11 13:43:50.741195 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.a4 0x2e380e0)/0x2e380e0 -8290> 2012-10-11 13:43:50.741206 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8289> 2012-10-11 13:43:50.741213 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8288> 2012-10-11 13:43:50.741219 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4047 0x2aa35a0 -8287> 2012-10-11 13:43:50.741228 7f4402a29700 5 journal submit_entry seq 4047 len 969 (0x24428a0) -8286> 2012-10-11 13:43:50.741236 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8285> 2012-10-11 13:43:50.741243 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8284> 2012-10-11 13:43:50.741289 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.bf 0x2e387d0)/0x2e387d0 -8283> 2012-10-11 13:43:50.741301 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8282> 2012-10-11 13:43:50.741308 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8281> 2012-10-11 13:43:50.741315 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4048 0x2aa3750 -8280> 2012-10-11 13:43:50.741324 7f4402a29700 5 journal submit_entry seq 4048 len 969 (0x24f8a20) -8279> 2012-10-11 13:43:50.741332 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8287> 2012-10-11 13:43:50.741339 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8287> 2012-10-11 13:43:50.741368 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.c5 0x2e386b0)/0x2e386b0 -8296> 2012-10-11 13:43:50.741379 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8295> 2012-10-11 13:43:50.741386 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8294> 2012-10-11 13:43:50.741393 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4049 0x2aa37e0 -8293> 2012-10-11 13:43:50.741402 7f4402a29700 5 journal submit_entry seq 4049 len 969 (0x24f8f00) -8292> 2012-10-11 13:43:50.741410 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8291> 2012-10-11 13:43:50.741416 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8290> 2012-10-11 13:43:50.741446 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ce 0x2e38900)/0x2e38900 -8289> 2012-10-11 13:43:50.741458 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8288> 2012-10-11 13:43:50.741465 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8287> 2012-10-11 13:43:50.741472 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4050 0x2aa3000 -8286> 2012-10-11 13:43:50.741481 7f4402a29700 5 journal submit_entry seq 4050 len 969 (0x24f8d50) -8285> 2012-10-11 13:43:50.741489 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8284> 2012-10-11 13:43:50.741496 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8283> 2012-10-11 13:43:50.741526 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.d2 0x2e38840)/0x2e38840 -8282> 2012-10-11 13:43:50.741537 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8281> 2012-10-11 13:43:50.741543 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8280> 2012-10-11 13:43:50.741550 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4051 0x2aa3e10 -8279> 2012-10-11 13:43:50.741559 7f4402a29700 5 journal submit_entry seq 4051 len 969 (0x25535a0) -8278> 2012-10-11 13:43:50.741567 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8277> 2012-10-11 13:43:50.741573 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8276> 2012-10-11 13:43:50.741602 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.d7 0x2e38b50)/0x2e38b50 -8275> 2012-10-11 13:43:50.741613 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8274> 2012-10-11 13:43:50.741620 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8273> 2012-10-11 13:43:50.741627 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4052 0x2aa3bd0 -8272> 2012-10-11 13:43:50.741636 7f4402a29700 5 journal submit_entry seq 4052 len 969 (0x2553090) -8271> 2012-10-11 13:43:50.741645 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8270> 2012-10-11 13:43:50.741652 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8269> 2012-10-11 13:43:50.741683 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.a3 0x2468150)/0x2468150 -8268> 2012-10-11 13:43:50.741694 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8267> 2012-10-11 13:43:50.741700 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8266> 2012-10-11 13:43:50.741707 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4053 0x2aa3120 -8265> 2012-10-11 13:43:50.741716 7f4402a29700 5 journal submit_entry seq 4053 len 969 (0x2609570) -8264> 2012-10-11 13:43:50.741724 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8263> 2012-10-11 13:43:50.741731 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8262> 2012-10-11 13:43:50.741761 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.be 0x24683b0)/0x24683b0 -8261> 2012-10-11 13:43:50.741772 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8260> 2012-10-11 13:43:50.741779 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8259> 2012-10-11 13:43:50.741786 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4054 0x2aa3090 -8258> 2012-10-11 13:43:50.741794 7f4402a29700 5 journal submit_entry seq 4054 len 969 (0x2609750) -8257> 2012-10-11 13:43:50.741802 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8256> 2012-10-11 13:43:50.741809 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8255> 2012-10-11 13:43:50.741839 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.c4 0x24687c0)/0x24687c0 -8254> 2012-10-11 13:43:50.741850 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8253> 2012-10-11 13:43:50.741857 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8252> 2012-10-11 13:43:50.741864 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4055 0x26fd1b0 -8251> 2012-10-11 13:43:50.741873 7f4402a29700 5 journal submit_entry seq 4055 len 969 (0x2609f90) -8250> 2012-10-11 13:43:50.741881 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8249> 2012-10-11 13:43:50.741888 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8248> 2012-10-11 13:43:50.741918 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.cd 0x24688b0)/0x24688b0 -8247> 2012-10-11 13:43:50.741929 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8246> 2012-10-11 13:43:50.741936 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8245> 2012-10-11 13:43:50.741943 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4056 0x26fd240 -8244> 2012-10-11 13:43:50.741952 7f4402a29700 5 journal submit_entry seq 4056 len 969 (0x26c1540) -8243> 2012-10-11 13:43:50.741960 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8242> 2012-10-11 13:43:50.741967 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8241> 2012-10-11 13:43:50.741996 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.d1 0x2468630)/0x2468630 -8240> 2012-10-11 13:43:50.737241 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 538 ==== osd pg remove(epoch 7; pg2.1b; ) v1 ==== 25+0+0 (3540353107 0 0) 0x20b0a80 con 0x2fe2280 -8239> 2012-10-11 13:43:50.742022 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1443, time: 2012-10-11 13:43:50.034411, event: header_read, request: osd pg remove(epoch 7; pg2.1b; ) v1 -8238> 2012-10-11 13:43:50.742013 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8237> 2012-10-11 13:43:50.742041 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8236> 2012-10-11 13:43:50.742048 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4057 0x26fdea0 -8235> 2012-10-11 13:43:50.742065 7f4402a29700 5 journal submit_entry seq 4057 len 969 (0x26c1390) -8234> 2012-10-11 13:43:50.742054 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1443, time: 2012-10-11 13:43:50.034422, event: throttled, request: osd pg remove(epoch 7; pg2.1b; ) v1 -8233> 2012-10-11 13:43:50.742080 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1443, time: 2012-10-11 13:43:50.034430, event: all_read, request: osd pg remove(epoch 7; pg2.1b; ) v1 -8232> 2012-10-11 13:43:50.742088 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8231> 2012-10-11 13:43:50.742098 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8230> 2012-10-11 13:43:50.742137 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.d6 0x25cf1e0)/0x25cf1e0 -8229> 2012-10-11 13:43:50.742103 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1443, time: 2012-10-11 13:43:50.742020, event: dispatched, request: osd pg remove(epoch 7; pg2.1b; ) v1 -8228> 2012-10-11 13:43:50.742155 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1443, time: 2012-10-11 13:43:50.742155, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.1b; ) v1 -8227> 2012-10-11 13:43:50.742168 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1443, time: 2012-10-11 13:43:50.742168, event: started, request: osd pg remove(epoch 7; pg2.1b; ) v1 -8226> 2012-10-11 13:43:50.742179 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.1b -8225> 2012-10-11 13:43:50.742199 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.1b 0x1d71880)/0x1d71880 -8224> 2012-10-11 13:43:50.742206 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8223> 2012-10-11 13:43:50.742217 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8222> 2012-10-11 13:43:50.742224 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4058 0x26fd000 -8221> 2012-10-11 13:43:50.742233 7f4402a29700 5 journal submit_entry seq 4058 len 969 (0x26c11e0) -8220> 2012-10-11 13:43:50.742239 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8219> 2012-10-11 13:43:50.742250 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8218> 2012-10-11 13:43:50.742255 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8217> 2012-10-11 13:43:50.742267 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8216> 2012-10-11 13:43:50.742302 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.8 0x1d71410)/0x1d71410 -8215> 2012-10-11 13:43:50.742310 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4059 0x31cb000 -8214> 2012-10-11 13:43:50.742323 7f440532f700 5 journal submit_entry seq 4059 len 205 (0x1f50f00) -8213> 2012-10-11 13:43:50.742331 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8212> 2012-10-11 13:43:50.742338 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8211> 2012-10-11 13:43:50.744666 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1443, time: 2012-10-11 13:43:50.744666, event: done, request: osd pg remove(epoch 7; pg2.1b; ) v1 -8210> 2012-10-11 13:43:50.744682 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8209> 2012-10-11 13:43:50.745025 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8208> 2012-10-11 13:43:50.745036 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4060 0x26fd120 -8207> 2012-10-11 13:43:50.745048 7f4402a29700 5 journal submit_entry seq 4060 len 963 (0x26c1720) -8206> 2012-10-11 13:43:50.745069 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8205> 2012-10-11 13:43:50.745420 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -8204> 2012-10-11 13:43:50.745061 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 111409) -8203> 2012-10-11 13:43:50.745441 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 883 ==== pg_info(1 pgs e6:1.d8) v3 ==== 471+0+0 (678647658 0 0) 0x31d1380 con 0x2fe2140 -8202> 2012-10-11 13:43:50.745508 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1444, time: 2012-10-11 13:43:48.981977, event: header_read, request: pg_info(1 pgs e6:1.d8) v3 -8201> 2012-10-11 13:43:50.745522 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1444, time: 2012-10-11 13:43:48.981981, event: throttled, request: pg_info(1 pgs e6:1.d8) v3 -8200> 2012-10-11 13:43:50.745532 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1444, time: 2012-10-11 13:43:48.981990, event: all_read, request: pg_info(1 pgs e6:1.d8) v3 -8199> 2012-10-11 13:43:50.745542 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1444, time: 2012-10-11 13:43:50.745506, event: dispatched, request: pg_info(1 pgs e6:1.d8) v3 -8198> 2012-10-11 13:43:50.745553 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1444, time: 2012-10-11 13:43:50.745553, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.d8) v3 -8197> 2012-10-11 13:43:50.745495 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.e8 0x2468c20)/0x2468c20 -8196> 2012-10-11 13:43:50.745571 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8195> 2012-10-11 13:43:50.745587 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8194> 2012-10-11 13:43:50.745594 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4061 0x26fdf30 -8193> 2012-10-11 13:43:50.745577 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1444, time: 2012-10-11 13:43:50.745577, event: started, request: pg_info(1 pgs e6:1.d8) v3 -8192> 2012-10-11 13:43:50.745619 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1444, time: 2012-10-11 13:43:50.745619, event: done, request: pg_info(1 pgs e6:1.d8) v3 -8191> 2012-10-11 13:43:50.745630 7f4402a29700 5 journal submit_entry seq 4061 len 969 (0x26c1db0) -8190> 2012-10-11 13:43:50.745642 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8189> 2012-10-11 13:43:50.745649 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8188> 2012-10-11 13:43:50.745661 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 110938) -8187> 2012-10-11 13:43:50.745706 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 539 ==== osd pg remove(epoch 7; pg2.1e; ) v1 ==== 25+0+0 (3139731225 0 0) 0x28d11c0 con 0x2fe2280 -8186> 2012-10-11 13:43:50.745723 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1445, time: 2012-10-11 13:43:50.037714, event: header_read, request: osd pg remove(epoch 7; pg2.1e; ) v1 -8185> 2012-10-11 13:43:50.745735 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1445, time: 2012-10-11 13:43:50.037722, event: throttled, request: osd pg remove(epoch 7; pg2.1e; ) v1 -8184> 2012-10-11 13:43:50.745695 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.ee 0x2468f00)/0x2468f00 -8183> 2012-10-11 13:43:50.745753 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8182> 2012-10-11 13:43:50.745769 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8181> 2012-10-11 13:43:50.745758 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1445, time: 2012-10-11 13:43:50.037728, event: all_read, request: osd pg remove(epoch 7; pg2.1e; ) v1 -8180> 2012-10-11 13:43:50.745786 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1445, time: 2012-10-11 13:43:50.745721, event: dispatched, request: osd pg remove(epoch 7; pg2.1e; ) v1 -8179> 2012-10-11 13:43:50.745779 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4062 0x26fd2d0 -8178> 2012-10-11 13:43:50.745805 7f4402a29700 5 journal submit_entry seq 4062 len 969 (0x27d2960) -8177> 2012-10-11 13:43:50.745821 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8176> 2012-10-11 13:43:50.745811 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1445, time: 2012-10-11 13:43:50.745811, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.1e; ) v1 -8175> 2012-10-11 13:43:50.745837 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1445, time: 2012-10-11 13:43:50.745837, event: started, request: osd pg remove(epoch 7; pg2.1e; ) v1 -8174> 2012-10-11 13:43:50.745845 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8173> 2012-10-11 13:43:50.745886 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.f0 0x2468ea0)/0x2468ea0 -8172> 2012-10-11 13:43:50.745894 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.1e -8171> 2012-10-11 13:43:50.745921 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.1e 0x1d71780)/0x1d71780 -8170> 2012-10-11 13:43:50.745930 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8169> 2012-10-11 13:43:50.745937 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8168> 2012-10-11 13:43:50.745948 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4063 0x31cb3f0 -8167> 2012-10-11 13:43:50.745942 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8166> 2012-10-11 13:43:50.745962 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8165> 2012-10-11 13:43:50.745967 7f440532f700 5 journal submit_entry seq 4063 len 205 (0x210bcc0) -8164> 2012-10-11 13:43:50.745981 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8163> 2012-10-11 13:43:50.745987 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8162> 2012-10-11 13:43:50.746011 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1445, time: 2012-10-11 13:43:50.746011, event: done, request: osd pg remove(epoch 7; pg2.1e; ) v1 -8161> 2012-10-11 13:43:50.746022 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4064 0x26fde10 -8160> 2012-10-11 13:43:50.746037 7f4402a29700 5 journal submit_entry seq 4064 len 969 (0x2827bd0) -8159> 2012-10-11 13:43:50.746045 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8158> 2012-10-11 13:43:50.746052 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8157> 2012-10-11 13:43:50.746087 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.f2 0x2468e40)/0x2468e40 -8156> 2012-10-11 13:43:50.746099 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 110913) -8155> 2012-10-11 13:43:50.746112 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 884 ==== pg_info(1 pgs e6:0.d9) v3 ==== 471+0+0 (3584303480 0 0) 0x31d11c0 con 0x2fe2140 -8154> 2012-10-11 13:43:50.746134 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1446, time: 2012-10-11 13:43:48.981995, event: header_read, request: pg_info(1 pgs e6:0.d9) v3 -8153> 2012-10-11 13:43:50.746127 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8152> 2012-10-11 13:43:50.746151 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8151> 2012-10-11 13:43:50.746158 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4065 0x26fd090 -8150> 2012-10-11 13:43:50.746175 7f4402a29700 5 journal submit_entry seq 4065 len 969 (0x28810c0) -8149> 2012-10-11 13:43:50.746164 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1446, time: 2012-10-11 13:43:48.981998, event: throttled, request: pg_info(1 pgs e6:0.d9) v3 -8148> 2012-10-11 13:43:50.746190 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1446, time: 2012-10-11 13:43:48.982006, event: all_read, request: pg_info(1 pgs e6:0.d9) v3 -8147> 2012-10-11 13:43:50.746198 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8146> 2012-10-11 13:43:50.746209 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8145> 2012-10-11 13:43:50.746249 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.f3 0x2468e10)/0x2468e10 -8144> 2012-10-11 13:43:50.746214 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1446, time: 2012-10-11 13:43:50.746132, event: dispatched, request: pg_info(1 pgs e6:0.d9) v3 -8143> 2012-10-11 13:43:50.746268 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1446, time: 2012-10-11 13:43:50.746268, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.d9) v3 -8142> 2012-10-11 13:43:50.746281 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1446, time: 2012-10-11 13:43:50.746281, event: started, request: pg_info(1 pgs e6:0.d9) v3 -8141> 2012-10-11 13:43:50.746300 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1446, time: 2012-10-11 13:43:50.746300, event: done, request: pg_info(1 pgs e6:0.d9) v3 -8140> 2012-10-11 13:43:50.746309 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8139> 2012-10-11 13:43:50.746320 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8138> 2012-10-11 13:43:50.746337 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4066 0x26fdcf0 -8137> 2012-10-11 13:43:50.746347 7f4402a29700 5 journal submit_entry seq 4066 len 969 (0x2f0e2a0) -8136> 2012-10-11 13:43:50.746330 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 110442) -8135> 2012-10-11 13:43:50.746362 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 540 ==== osd pg remove(epoch 7; pg2.1f; ) v1 ==== 25+0+0 (4061659710 0 0) 0x20b0c40 con 0x2fe2280 -8134> 2012-10-11 13:43:50.746375 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8133> 2012-10-11 13:43:50.746385 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8132> 2012-10-11 13:43:50.746394 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1447, time: 2012-10-11 13:43:50.037766, event: header_read, request: osd pg remove(epoch 7; pg2.1f; ) v1 -8131> 2012-10-11 13:43:50.746440 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1447, time: 2012-10-11 13:43:50.037771, event: throttled, request: osd pg remove(epoch 7; pg2.1f; ) v1 -8130> 2012-10-11 13:43:50.746452 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1447, time: 2012-10-11 13:43:50.037776, event: all_read, request: osd pg remove(epoch 7; pg2.1f; ) v1 -8129> 2012-10-11 13:43:50.746463 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1447, time: 2012-10-11 13:43:50.746392, event: dispatched, request: osd pg remove(epoch 7; pg2.1f; ) v1 -8128> 2012-10-11 13:43:50.746430 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.f5 0x27a11b0)/0x27a11b0 -8127> 2012-10-11 13:43:50.746487 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8126> 2012-10-11 13:43:50.746476 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1447, time: 2012-10-11 13:43:50.746476, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.1f; ) v1 -8125> 2012-10-11 13:43:50.746504 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1447, time: 2012-10-11 13:43:50.746504, event: started, request: osd pg remove(epoch 7; pg2.1f; ) v1 -8124> 2012-10-11 13:43:50.746495 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8123> 2012-10-11 13:43:50.746520 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4067 0x31cb360 -8122> 2012-10-11 13:43:50.746528 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.1f -8121> 2012-10-11 13:43:50.746554 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.1f 0x31764f0)/0x31764f0 -8120> 2012-10-11 13:43:50.746535 7f4402a29700 5 journal submit_entry seq 4067 len 969 (0x2e13ed0) -8119> 2012-10-11 13:43:50.746569 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8118> 2012-10-11 13:43:50.746576 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8117> 2012-10-11 13:43:50.746608 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.f9 0x27a10f0)/0x27a10f0 -8116> 2012-10-11 13:43:50.746617 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8115> 2012-10-11 13:43:50.746628 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8114> 2012-10-11 13:43:50.746635 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4068 0x31cb2d0 -8113> 2012-10-11 13:43:50.746643 7f440532f700 5 journal submit_entry seq 4068 len 205 (0x1f469c0) -8112> 2012-10-11 13:43:50.746651 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8111> 2012-10-11 13:43:50.746659 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8110> 2012-10-11 13:43:50.746665 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8109> 2012-10-11 13:43:50.746677 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8108> 2012-10-11 13:43:50.746704 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1447, time: 2012-10-11 13:43:50.746704, event: done, request: osd pg remove(epoch 7; pg2.1f; ) v1 -8107> 2012-10-11 13:43:50.746715 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4069 0x31cb870 -8106> 2012-10-11 13:43:50.746728 7f4402a29700 5 journal submit_entry seq 4069 len 969 (0x30a1810) -8105> 2012-10-11 13:43:50.746737 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8104> 2012-10-11 13:43:50.746743 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8103> 2012-10-11 13:43:50.746754 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 110417) -8102> 2012-10-11 13:43:50.746796 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 885 ==== pg_info(1 pgs e6:2.da) v3 ==== 471+0+0 (3641783217 0 0) 0x31d1000 con 0x2fe2140 -8101> 2012-10-11 13:43:50.746814 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1448, time: 2012-10-11 13:43:48.982010, event: header_read, request: pg_info(1 pgs e6:2.da) v3 -8100> 2012-10-11 13:43:50.746786 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.fb 0x27a1090)/0x27a1090 -8099> 2012-10-11 13:43:50.746839 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8098> 2012-10-11 13:43:50.746829 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1448, time: 2012-10-11 13:43:48.982013, event: throttled, request: pg_info(1 pgs e6:2.da) v3 -8097> 2012-10-11 13:43:50.746857 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1448, time: 2012-10-11 13:43:48.982021, event: all_read, request: pg_info(1 pgs e6:2.da) v3 -8096> 2012-10-11 13:43:50.746850 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8095> 2012-10-11 13:43:50.746873 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4070 0x31cbcf0 -8094> 2012-10-11 13:43:50.746890 7f4402a29700 5 journal submit_entry seq 4070 len 969 (0x1e86bd0) -8093> 2012-10-11 13:43:50.746878 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1448, time: 2012-10-11 13:43:50.746812, event: dispatched, request: pg_info(1 pgs e6:2.da) v3 -8092> 2012-10-11 13:43:50.746904 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8091> 2012-10-11 13:43:50.746918 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8090> 2012-10-11 13:43:50.746909 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1448, time: 2012-10-11 13:43:50.746909, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.da) v3 -8089> 2012-10-11 13:43:50.746959 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(0.fc 0x27a1060)/0x27a1060 -8088> 2012-10-11 13:43:50.746968 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1448, time: 2012-10-11 13:43:50.746968, event: started, request: pg_info(1 pgs e6:2.da) v3 -8087> 2012-10-11 13:43:50.746993 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1448, time: 2012-10-11 13:43:50.746993, event: done, request: pg_info(1 pgs e6:2.da) v3 -8086> 2012-10-11 13:43:50.747007 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 109946) -8085> 2012-10-11 13:43:50.747020 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 541 ==== osd pg remove(epoch 7; pg2.26; ) v1 ==== 25+0+0 (1885935598 0 0) 0x28d1700 con 0x2fe2280 -8084> 2012-10-11 13:43:50.747013 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8083> 2012-10-11 13:43:50.747041 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8082> 2012-10-11 13:43:50.747048 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4071 0x31cb750 -8081> 2012-10-11 13:43:50.747067 7f4402a29700 5 journal submit_entry seq 4071 len 969 (0x1eed420) -8080> 2012-10-11 13:43:50.747055 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1449, time: 2012-10-11 13:43:50.042150, event: header_read, request: osd pg remove(epoch 7; pg2.26; ) v1 -8079> 2012-10-11 13:43:50.747083 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8078> 2012-10-11 13:43:50.747097 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8077> 2012-10-11 13:43:50.747088 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1449, time: 2012-10-11 13:43:50.042165, event: throttled, request: osd pg remove(epoch 7; pg2.26; ) v1 -8076> 2012-10-11 13:43:50.747138 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.e7 0x2e38c50)/0x2e38c50 -8075> 2012-10-11 13:43:50.747146 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1449, time: 2012-10-11 13:43:50.042174, event: all_read, request: osd pg remove(epoch 7; pg2.26; ) v1 -8074> 2012-10-11 13:43:50.747162 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1449, time: 2012-10-11 13:43:50.747053, event: dispatched, request: osd pg remove(epoch 7; pg2.26; ) v1 -8073> 2012-10-11 13:43:50.747173 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1449, time: 2012-10-11 13:43:50.747173, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.26; ) v1 -8072> 2012-10-11 13:43:50.747185 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1449, time: 2012-10-11 13:43:50.747185, event: started, request: osd pg remove(epoch 7; pg2.26; ) v1 -8071> 2012-10-11 13:43:50.747196 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.26 -8070> 2012-10-11 13:43:50.747202 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8069> 2012-10-11 13:43:50.747226 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.26 0x1d71a10)/0x1d71a10 -8068> 2012-10-11 13:43:50.747231 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8067> 2012-10-11 13:43:50.747242 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4072 0x31cb480 -8066> 2012-10-11 13:43:50.747252 7f4402a29700 5 journal submit_entry seq 4072 len 969 (0x1eedc90) -8065> 2012-10-11 13:43:50.747260 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8064> 2012-10-11 13:43:50.747270 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8063> 2012-10-11 13:43:50.747274 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8062> 2012-10-11 13:43:50.747314 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ed 0x2e38f30)/0x2e38f30 -8061> 2012-10-11 13:43:50.747321 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8060> 2012-10-11 13:43:50.747333 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4073 0x31cbf30 -8059> 2012-10-11 13:43:50.747341 7f440532f700 5 journal submit_entry seq 4073 len 205 (0x1feeab0) -8058> 2012-10-11 13:43:50.747350 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8057> 2012-10-11 13:43:50.747357 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8056> 2012-10-11 13:43:50.747378 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1449, time: 2012-10-11 13:43:50.747378, event: done, request: osd pg remove(epoch 7; pg2.26; ) v1 -8055> 2012-10-11 13:43:50.747390 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8054> 2012-10-11 13:43:50.747401 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8053> 2012-10-11 13:43:50.747408 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4074 0x31cb510 -8052> 2012-10-11 13:43:50.747419 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 109921) -8051> 2012-10-11 13:43:50.747427 7f4402a29700 5 journal submit_entry seq 4074 len 969 (0x33abf90) -8050> 2012-10-11 13:43:50.747439 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8049> 2012-10-11 13:43:50.747459 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8048> 2012-10-11 13:43:50.747498 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ef 0x2e38ed0)/0x2e38ed0 -8047> 2012-10-11 13:43:50.747444 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 886 ==== pg_info(1 pgs e6:2.d5) v3 ==== 471+0+0 (255920550 0 0) 0x2a27e00 con 0x2fe2140 -8046> 2012-10-11 13:43:50.747517 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1450, time: 2012-10-11 13:43:48.982025, event: header_read, request: pg_info(1 pgs e6:2.d5) v3 -8045> 2012-10-11 13:43:50.747530 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1450, time: 2012-10-11 13:43:48.982029, event: throttled, request: pg_info(1 pgs e6:2.d5) v3 -8044> 2012-10-11 13:43:50.747548 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1450, time: 2012-10-11 13:43:48.982056, event: all_read, request: pg_info(1 pgs e6:2.d5) v3 -8043> 2012-10-11 13:43:50.747558 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1450, time: 2012-10-11 13:43:50.747515, event: dispatched, request: pg_info(1 pgs e6:2.d5) v3 -8042> 2012-10-11 13:43:50.747567 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8041> 2012-10-11 13:43:50.747578 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8040> 2012-10-11 13:43:50.747593 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4075 0x308f900 -8039> 2012-10-11 13:43:50.747583 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1450, time: 2012-10-11 13:43:50.747583, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.d5) v3 -8038> 2012-10-11 13:43:50.747615 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1450, time: 2012-10-11 13:43:50.747615, event: started, request: pg_info(1 pgs e6:2.d5) v3 -8037> 2012-10-11 13:43:50.747606 7f4402a29700 5 journal submit_entry seq 4075 len 969 (0x33a7bd0) -8036> 2012-10-11 13:43:50.747632 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8035> 2012-10-11 13:43:50.747655 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8034> 2012-10-11 13:43:50.747690 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.f1 0x2e38e70)/0x2e38e70 -8033> 2012-10-11 13:43:50.747646 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1450, time: 2012-10-11 13:43:50.747646, event: done, request: pg_info(1 pgs e6:2.d5) v3 -8032> 2012-10-11 13:43:50.747710 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 109450) -8031> 2012-10-11 13:43:50.747719 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 542 ==== osd pg remove(epoch 7; pg2.32; ) v1 ==== 25+0+0 (3573718071 0 0) 0x30098c0 con 0x2fe2280 -8030> 2012-10-11 13:43:50.747736 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1451, time: 2012-10-11 13:43:50.043923, event: header_read, request: osd pg remove(epoch 7; pg2.32; ) v1 -8029> 2012-10-11 13:43:50.747746 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8028> 2012-10-11 13:43:50.747757 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8027> 2012-10-11 13:43:50.747771 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4076 0x1f95ab0 -8026> 2012-10-11 13:43:50.747762 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1451, time: 2012-10-11 13:43:50.043933, event: throttled, request: osd pg remove(epoch 7; pg2.32; ) v1 -8025> 2012-10-11 13:43:50.747791 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1451, time: 2012-10-11 13:43:50.043939, event: all_read, request: osd pg remove(epoch 7; pg2.32; ) v1 -8024> 2012-10-11 13:43:50.747783 7f4402a29700 5 journal submit_entry seq 4076 len 969 (0x33a3a50) -8023> 2012-10-11 13:43:50.747808 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8022> 2012-10-11 13:43:50.747822 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8021> 2012-10-11 13:43:50.747813 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1451, time: 2012-10-11 13:43:50.747734, event: dispatched, request: osd pg remove(epoch 7; pg2.32; ) v1 -8020> 2012-10-11 13:43:50.747869 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1451, time: 2012-10-11 13:43:50.747869, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.32; ) v1 -8019> 2012-10-11 13:43:50.747883 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1451, time: 2012-10-11 13:43:50.747883, event: started, request: osd pg remove(epoch 7; pg2.32; ) v1 -8018> 2012-10-11 13:43:50.747894 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.32 -8017> 2012-10-11 13:43:50.747914 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.32 0x1d71b40)/0x1d71b40 -8016> 2012-10-11 13:43:50.747859 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.f2 0x2e38e40)/0x2e38e40 -8015> 2012-10-11 13:43:50.747930 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8014> 2012-10-11 13:43:50.747937 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -8013> 2012-10-11 13:43:50.747948 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4077 0x1f95f30 -8012> 2012-10-11 13:43:50.747942 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -8011> 2012-10-11 13:43:50.747962 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -8010> 2012-10-11 13:43:50.747968 7f4402a29700 5 journal submit_entry seq 4077 len 969 (0x33a33c0) -8009> 2012-10-11 13:43:50.747981 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -8008> 2012-10-11 13:43:50.747988 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -8007> 2012-10-11 13:43:50.748024 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.f8 0x3176120)/0x3176120 -8006> 2012-10-11 13:43:50.748032 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4078 0x31cb7e0 -8005> 2012-10-11 13:43:50.748045 7f440532f700 5 journal submit_entry seq 4078 len 205 (0x1fa8de0) -8004> 2012-10-11 13:43:50.748053 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -8003> 2012-10-11 13:43:50.748060 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -8002> 2012-10-11 13:43:50.748090 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1451, time: 2012-10-11 13:43:50.748090, event: done, request: osd pg remove(epoch 7; pg2.32; ) v1 -8001> 2012-10-11 13:43:50.748103 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -8000> 2012-10-11 13:43:50.748114 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7999> 2012-10-11 13:43:50.748130 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4079 0x1f95480 -7998> 2012-10-11 13:43:50.748123 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 109425) -7997> 2012-10-11 13:43:50.748150 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 887 ==== pg_info(1 pgs e6:1.d6) v3 ==== 471+0+0 (1798569575 0 0) 0x2a27c40 con 0x2fe2140 -7996> 2012-10-11 13:43:50.748142 7f4402a29700 5 journal submit_entry seq 4079 len 969 (0x30a17e0) -7995> 2012-10-11 13:43:50.748171 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7994> 2012-10-11 13:43:50.748178 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7993> 2012-10-11 13:43:50.748222 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.fa 0x31760c0)/0x31760c0 -7992> 2012-10-11 13:43:50.748184 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1452, time: 2012-10-11 13:43:48.982061, event: header_read, request: pg_info(1 pgs e6:1.d6) v3 -7991> 2012-10-11 13:43:50.748239 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1452, time: 2012-10-11 13:43:48.982067, event: throttled, request: pg_info(1 pgs e6:1.d6) v3 -7990> 2012-10-11 13:43:50.748251 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1452, time: 2012-10-11 13:43:48.982089, event: all_read, request: pg_info(1 pgs e6:1.d6) v3 -7989> 2012-10-11 13:43:50.748261 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1452, time: 2012-10-11 13:43:50.748183, event: dispatched, request: pg_info(1 pgs e6:1.d6) v3 -7988> 2012-10-11 13:43:50.748272 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1452, time: 2012-10-11 13:43:50.748272, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.d6) v3 -7987> 2012-10-11 13:43:50.748288 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1452, time: 2012-10-11 13:43:50.748288, event: started, request: pg_info(1 pgs e6:1.d6) v3 -7986> 2012-10-11 13:43:50.748280 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7985> 2012-10-11 13:43:50.748304 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7984> 2012-10-11 13:43:50.748312 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4080 0x1f95360 -7983> 2012-10-11 13:43:50.748338 7f4402a29700 5 journal submit_entry seq 4080 len 969 (0x30568d0) -7982> 2012-10-11 13:43:50.748347 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7981> 2012-10-11 13:43:50.748326 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1452, time: 2012-10-11 13:43:50.748326, event: done, request: pg_info(1 pgs e6:1.d6) v3 -7980> 2012-10-11 13:43:50.748698 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 108954) -7979> 2012-10-11 13:43:50.748678 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7978> 2012-10-11 13:43:50.748745 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.fb 0x3176090)/0x3176090 -7977> 2012-10-11 13:43:50.748754 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 543 ==== osd pg remove(epoch 7; pg2.3f; ) v1 ==== 25+0+0 (4279789479 0 0) 0x24af000 con 0x2fe2280 -7976> 2012-10-11 13:43:50.748777 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1453, time: 2012-10-11 13:43:50.043981, event: header_read, request: osd pg remove(epoch 7; pg2.3f; ) v1 -7975> 2012-10-11 13:43:50.748789 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1453, time: 2012-10-11 13:43:50.043989, event: throttled, request: osd pg remove(epoch 7; pg2.3f; ) v1 -7974> 2012-10-11 13:43:50.748800 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1453, time: 2012-10-11 13:43:50.043994, event: all_read, request: osd pg remove(epoch 7; pg2.3f; ) v1 -7973> 2012-10-11 13:43:50.748809 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7972> 2012-10-11 13:43:50.748827 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7971> 2012-10-11 13:43:50.748818 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1453, time: 2012-10-11 13:43:50.748775, event: dispatched, request: osd pg remove(epoch 7; pg2.3f; ) v1 -7970> 2012-10-11 13:43:50.748844 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1453, time: 2012-10-11 13:43:50.748844, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.3f; ) v1 -7969> 2012-10-11 13:43:50.748836 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4081 0x1f951b0 -7968> 2012-10-11 13:43:50.748863 7f4402a29700 5 journal submit_entry seq 4081 len 969 (0x2faf090) -7967> 2012-10-11 13:43:50.748880 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7966> 2012-10-11 13:43:50.748870 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1453, time: 2012-10-11 13:43:50.748870, event: started, request: osd pg remove(epoch 7; pg2.3f; ) v1 -7965> 2012-10-11 13:43:50.748897 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.3f -7964> 2012-10-11 13:43:50.748890 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7963> 2012-10-11 13:43:50.748938 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.e6 0x2468a70)/0x2468a70 -7962> 2012-10-11 13:43:50.748959 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.3f 0x3176750)/0x3176750 -7961> 2012-10-11 13:43:50.748972 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7960> 2012-10-11 13:43:50.748979 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7959> 2012-10-11 13:43:50.748986 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4082 0x31cba20 -7958> 2012-10-11 13:43:50.748995 7f440532f700 5 journal submit_entry seq 4082 len 205 (0x320bc60) -7957> 2012-10-11 13:43:50.749001 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7956> 2012-10-11 13:43:50.749014 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7955> 2012-10-11 13:43:50.749018 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7954> 2012-10-11 13:43:50.749030 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7953> 2012-10-11 13:43:50.749058 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1453, time: 2012-10-11 13:43:50.749058, event: done, request: osd pg remove(epoch 7; pg2.3f; ) v1 -7952> 2012-10-11 13:43:50.749069 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4083 0x1f95cf0 -7951> 2012-10-11 13:43:50.749084 7f4402a29700 5 journal submit_entry seq 4083 len 969 (0x2b5d540) -7950> 2012-10-11 13:43:50.749092 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7949> 2012-10-11 13:43:50.749099 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7948> 2012-10-11 13:43:50.749133 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.ec 0x2468ee0)/0x2468ee0 -7947> 2012-10-11 13:43:50.749144 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 108929) -7946> 2012-10-11 13:43:50.749157 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 888 ==== pg_info(1 pgs e6:0.d7) v3 ==== 471+0+0 (1270785823 0 0) 0x2a27a80 con 0x2fe2140 -7945> 2012-10-11 13:43:50.749172 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7944> 2012-10-11 13:43:50.749193 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7943> 2012-10-11 13:43:50.749200 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4084 0x1f95240 -7942> 2012-10-11 13:43:50.749182 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1454, time: 2012-10-11 13:43:48.982094, event: header_read, request: pg_info(1 pgs e6:0.d7) v3 -7941> 2012-10-11 13:43:50.749214 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1454, time: 2012-10-11 13:43:48.982098, event: throttled, request: pg_info(1 pgs e6:0.d7) v3 -7940> 2012-10-11 13:43:50.749223 7f4402a29700 5 journal submit_entry seq 4084 len 969 (0x2719390) -7939> 2012-10-11 13:43:50.749236 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7938> 2012-10-11 13:43:50.749241 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1454, time: 2012-10-11 13:43:48.982106, event: all_read, request: pg_info(1 pgs e6:0.d7) v3 -7937> 2012-10-11 13:43:50.749281 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1454, time: 2012-10-11 13:43:50.749180, event: dispatched, request: pg_info(1 pgs e6:0.d7) v3 -7936> 2012-10-11 13:43:50.749294 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7935> 2012-10-11 13:43:50.749335 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.6 0x1d712d0)/0x1d712d0 -7934> 2012-10-11 13:43:50.749344 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1454, time: 2012-10-11 13:43:50.749344, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.d7) v3 -7933> 2012-10-11 13:43:50.749361 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1454, time: 2012-10-11 13:43:50.749361, event: started, request: pg_info(1 pgs e6:0.d7) v3 -7932> 2012-10-11 13:43:50.749381 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1454, time: 2012-10-11 13:43:50.749381, event: done, request: pg_info(1 pgs e6:0.d7) v3 -7931> 2012-10-11 13:43:50.749401 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 108458) -7930> 2012-10-11 13:43:50.749391 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7929> 2012-10-11 13:43:50.749414 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7928> 2012-10-11 13:43:50.749422 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4085 0x1f95630 -7927> 2012-10-11 13:43:50.749446 7f4402a29700 5 journal submit_entry seq 4085 len 963 (0x2881f00) -7926> 2012-10-11 13:43:50.749454 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7925> 2012-10-11 13:43:50.749429 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 544 ==== osd pg remove(epoch 7; pg2.43; ) v1 ==== 25+0+0 (256394767 0 0) 0x311ca80 con 0x2fe2280 -7924> 2012-10-11 13:43:50.749469 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1455, time: 2012-10-11 13:43:50.044033, event: header_read, request: osd pg remove(epoch 7; pg2.43; ) v1 -7923> 2012-10-11 13:43:50.749477 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 963 -7922> 2012-10-11 13:43:50.749767 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1455, time: 2012-10-11 13:43:50.044040, event: throttled, request: osd pg remove(epoch 7; pg2.43; ) v1 -7921> 2012-10-11 13:43:50.749785 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1455, time: 2012-10-11 13:43:50.044047, event: all_read, request: osd pg remove(epoch 7; pg2.43; ) v1 -7920> 2012-10-11 13:43:50.749796 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1455, time: 2012-10-11 13:43:50.749467, event: dispatched, request: osd pg remove(epoch 7; pg2.43; ) v1 -7919> 2012-10-11 13:43:50.749520 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.ee 0x2468fd0)/0x2468fd0 -7918> 2012-10-11 13:43:50.749823 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7917> 2012-10-11 13:43:50.749811 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1455, time: 2012-10-11 13:43:50.749811, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.43; ) v1 -7916> 2012-10-11 13:43:50.749842 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1455, time: 2012-10-11 13:43:50.749842, event: started, request: osd pg remove(epoch 7; pg2.43; ) v1 -7915> 2012-10-11 13:43:50.749833 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7914> 2012-10-11 13:43:50.749858 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4086 0x1f95ea0 -7913> 2012-10-11 13:43:50.749868 7f4402a29700 5 journal submit_entry seq 4086 len 969 (0x216eab0) -7912> 2012-10-11 13:43:50.749874 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.43 -7911> 2012-10-11 13:43:50.749899 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.43 0x1d71ce0)/0x1d71ce0 -7910> 2012-10-11 13:43:50.749906 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7909> 2012-10-11 13:43:50.749917 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7908> 2012-10-11 13:43:50.749953 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.f0 0x2468c00)/0x2468c00 -7907> 2012-10-11 13:43:50.749962 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7906> 2012-10-11 13:43:50.749973 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7905> 2012-10-11 13:43:50.749980 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4087 0x2062d80 -7904> 2012-10-11 13:43:50.749989 7f440532f700 5 journal submit_entry seq 4087 len 205 (0x325b060) -7903> 2012-10-11 13:43:50.749997 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7902> 2012-10-11 13:43:50.750004 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7901> 2012-10-11 13:43:50.750012 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7900> 2012-10-11 13:43:50.750021 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7899> 2012-10-11 13:43:50.750047 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1455, time: 2012-10-11 13:43:50.750047, event: done, request: osd pg remove(epoch 7; pg2.43; ) v1 -7898> 2012-10-11 13:43:50.750058 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4088 0x1f95000 -7897> 2012-10-11 13:43:50.750072 7f4402a29700 5 journal submit_entry seq 4088 len 969 (0x325b9f0) -7896> 2012-10-11 13:43:50.750080 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7895> 2012-10-11 13:43:50.750087 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7894> 2012-10-11 13:43:50.750131 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.f3 0x2468cd0)/0x2468cd0 -7893> 2012-10-11 13:43:50.750096 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 108433) -7892> 2012-10-11 13:43:50.750149 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 889 ==== pg_info(1 pgs e6:2.d7) v3 ==== 471+0+0 (972993957 0 0) 0x2a278c0 con 0x2fe2140 -7891> 2012-10-11 13:43:50.750167 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1456, time: 2012-10-11 13:43:48.982111, event: header_read, request: pg_info(1 pgs e6:2.d7) v3 -7890> 2012-10-11 13:43:50.750178 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1456, time: 2012-10-11 13:43:48.982114, event: throttled, request: pg_info(1 pgs e6:2.d7) v3 -7889> 2012-10-11 13:43:50.750187 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7888> 2012-10-11 13:43:50.750198 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1456, time: 2012-10-11 13:43:48.982123, event: all_read, request: pg_info(1 pgs e6:2.d7) v3 -7887> 2012-10-11 13:43:50.750205 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7886> 2012-10-11 13:43:50.750218 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4089 0x1f956c0 -7885> 2012-10-11 13:43:50.750235 7f4402a29700 5 journal submit_entry seq 4089 len 969 (0x3235930) -7884> 2012-10-11 13:43:50.750224 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1456, time: 2012-10-11 13:43:50.750164, event: dispatched, request: pg_info(1 pgs e6:2.d7) v3 -7883> 2012-10-11 13:43:50.750249 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1456, time: 2012-10-11 13:43:50.750249, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.d7) v3 -7882> 2012-10-11 13:43:50.750257 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7881> 2012-10-11 13:43:50.750268 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7880> 2012-10-11 13:43:50.750311 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.f1 0x2468c40)/0x2468c40 -7879> 2012-10-11 13:43:50.750274 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1456, time: 2012-10-11 13:43:50.750274, event: started, request: pg_info(1 pgs e6:2.d7) v3 -7878> 2012-10-11 13:43:50.750338 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1456, time: 2012-10-11 13:43:50.750338, event: done, request: pg_info(1 pgs e6:2.d7) v3 -7877> 2012-10-11 13:43:50.750353 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 107962) -7876> 2012-10-11 13:43:50.750362 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7875> 2012-10-11 13:43:50.750381 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7874> 2012-10-11 13:43:50.750389 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4090 0x1f95870 -7873> 2012-10-11 13:43:50.750367 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 545 ==== osd pg remove(epoch 7; pg2.45; ) v1 ==== 25+0+0 (3157081644 0 0) 0x24af700 con 0x2fe2280 -7872> 2012-10-11 13:43:50.750404 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1457, time: 2012-10-11 13:43:50.044084, event: header_read, request: osd pg remove(epoch 7; pg2.45; ) v1 -7871> 2012-10-11 13:43:50.750414 7f4402a29700 5 journal submit_entry seq 4090 len 969 (0x1f507b0) -7870> 2012-10-11 13:43:50.750426 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7869> 2012-10-11 13:43:50.750440 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7868> 2012-10-11 13:43:50.750431 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1457, time: 2012-10-11 13:43:50.044092, event: throttled, request: osd pg remove(epoch 7; pg2.45; ) v1 -7867> 2012-10-11 13:43:50.750488 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1457, time: 2012-10-11 13:43:50.044097, event: all_read, request: osd pg remove(epoch 7; pg2.45; ) v1 -7866> 2012-10-11 13:43:50.750500 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1457, time: 2012-10-11 13:43:50.750402, event: dispatched, request: osd pg remove(epoch 7; pg2.45; ) v1 -7865> 2012-10-11 13:43:50.750511 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1457, time: 2012-10-11 13:43:50.750511, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.45; ) v1 -7864> 2012-10-11 13:43:50.750523 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1457, time: 2012-10-11 13:43:50.750523, event: started, request: osd pg remove(epoch 7; pg2.45; ) v1 -7863> 2012-10-11 13:43:50.750478 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.f9 0x25cf3c0)/0x25cf3c0 -7862> 2012-10-11 13:43:50.750539 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.45 -7861> 2012-10-11 13:43:50.750546 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7860> 2012-10-11 13:43:50.750569 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.45 0x1d71f70)/0x1d71f70 -7859> 2012-10-11 13:43:50.750575 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7858> 2012-10-11 13:43:50.750586 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4091 0x1f95900 -7857> 2012-10-11 13:43:50.750595 7f4402a29700 5 journal submit_entry seq 4091 len 969 (0x33b05d0) -7856> 2012-10-11 13:43:50.750603 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7855> 2012-10-11 13:43:50.750614 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7854> 2012-10-11 13:43:50.750619 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7853> 2012-10-11 13:43:50.750658 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.f7 0x25cf420)/0x25cf420 -7852> 2012-10-11 13:43:50.750665 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7851> 2012-10-11 13:43:50.750677 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4092 0x20623f0 -7850> 2012-10-11 13:43:50.750686 7f440532f700 5 journal submit_entry seq 4092 len 205 (0x325bf90) -7849> 2012-10-11 13:43:50.750694 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7848> 2012-10-11 13:43:50.750701 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7847> 2012-10-11 13:43:50.750723 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1457, time: 2012-10-11 13:43:50.750723, event: done, request: osd pg remove(epoch 7; pg2.45; ) v1 -7846> 2012-10-11 13:43:50.750735 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7845> 2012-10-11 13:43:50.750746 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7844> 2012-10-11 13:43:50.750753 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4093 0x1f95990 -7843> 2012-10-11 13:43:50.750762 7f4402a29700 5 journal submit_entry seq 4093 len 969 (0x33f3c90) -7842> 2012-10-11 13:43:50.750784 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7841> 2012-10-11 13:43:50.750791 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7840> 2012-10-11 13:43:50.750776 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 107937) -7839> 2012-10-11 13:43:50.750804 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 890 ==== pg_info(1 pgs e6:1.d4) v3 ==== 471+0+0 (3169827214 0 0) 0x2a27700 con 0x2fe2140 -7838> 2012-10-11 13:43:50.750858 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1458, time: 2012-10-11 13:43:48.982127, event: header_read, request: pg_info(1 pgs e6:1.d4) v3 -7837> 2012-10-11 13:43:50.750870 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1458, time: 2012-10-11 13:43:48.982131, event: throttled, request: pg_info(1 pgs e6:1.d4) v3 -7836> 2012-10-11 13:43:50.750881 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1458, time: 2012-10-11 13:43:48.982139, event: all_read, request: pg_info(1 pgs e6:1.d4) v3 -7835> 2012-10-11 13:43:50.750846 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.fa 0x25cf390)/0x25cf390 -7834> 2012-10-11 13:43:50.750897 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7833> 2012-10-11 13:43:50.750911 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7832> 2012-10-11 13:43:50.750902 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1458, time: 2012-10-11 13:43:50.750856, event: dispatched, request: pg_info(1 pgs e6:1.d4) v3 -7831> 2012-10-11 13:43:50.750925 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1458, time: 2012-10-11 13:43:50.750925, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.d4) v3 -7830> 2012-10-11 13:43:50.750932 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4094 0x1f95090 -7829> 2012-10-11 13:43:50.750946 7f4402a29700 5 journal submit_entry seq 4094 len 969 (0x1ee5480) -7828> 2012-10-11 13:43:50.750963 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7827> 2012-10-11 13:43:50.750953 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1458, time: 2012-10-11 13:43:50.750953, event: started, request: pg_info(1 pgs e6:1.d4) v3 -7826> 2012-10-11 13:43:50.750989 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1458, time: 2012-10-11 13:43:50.750989, event: done, request: pg_info(1 pgs e6:1.d4) v3 -7825> 2012-10-11 13:43:50.750973 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7824> 2012-10-11 13:43:50.751031 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.8d 0x2adbd30)/0x2adbd30 -7823> 2012-10-11 13:43:50.751044 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 107466) -7822> 2012-10-11 13:43:50.751058 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 546 ==== osd pg remove(epoch 7; pg2.20; ) v1 ==== 25+0+0 (3272372173 0 0) 0x24af540 con 0x2fe2280 -7821> 2012-10-11 13:43:50.751080 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1459, time: 2012-10-11 13:43:50.044134, event: header_read, request: osd pg remove(epoch 7; pg2.20; ) v1 -7820> 2012-10-11 13:43:50.751072 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7819> 2012-10-11 13:43:50.751097 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7818> 2012-10-11 13:43:50.751104 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4095 0x1f952d0 -7817> 2012-10-11 13:43:50.751121 7f4402a29700 5 journal submit_entry seq 4095 len 969 (0x1e960f0) -7816> 2012-10-11 13:43:50.751110 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1459, time: 2012-10-11 13:43:50.044142, event: throttled, request: osd pg remove(epoch 7; pg2.20; ) v1 -7815> 2012-10-11 13:43:50.751136 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1459, time: 2012-10-11 13:43:50.044147, event: all_read, request: osd pg remove(epoch 7; pg2.20; ) v1 -7814> 2012-10-11 13:43:50.751144 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7813> 2012-10-11 13:43:50.751155 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -7812> 2012-10-11 13:43:50.751180 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.db) v3 -- ?+0 0x30438c0 -7811> 2012-10-11 13:43:50.751160 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1459, time: 2012-10-11 13:43:50.751078, event: dispatched, request: osd pg remove(epoch 7; pg2.20; ) v1 -7810> 2012-10-11 13:43:50.751201 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1459, time: 2012-10-11 13:43:50.751201, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.20; ) v1 -7809> 2012-10-11 13:43:50.751214 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1459, time: 2012-10-11 13:43:50.751214, event: started, request: osd pg remove(epoch 7; pg2.20; ) v1 -7808> 2012-10-11 13:43:50.751232 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.20 -7807> 2012-10-11 13:43:50.751309 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.20 0x31764c0)/0x31764c0 -7806> 2012-10-11 13:43:50.751285 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(1.db 0x2e38a90)/0x2e38a90 -7805> 2012-10-11 13:43:50.751321 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7804> 2012-10-11 13:43:50.751335 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7803> 2012-10-11 13:43:50.751339 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7802> 2012-10-11 13:43:50.751352 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4096 0x2062990 -7801> 2012-10-11 13:43:50.751357 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7800> 2012-10-11 13:43:50.751370 7f440532f700 5 journal submit_entry seq 4096 len 205 (0x325bc30) -7799> 2012-10-11 13:43:50.751379 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7798> 2012-10-11 13:43:50.751386 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7797> 2012-10-11 13:43:50.751410 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1459, time: 2012-10-11 13:43:50.751410, event: done, request: osd pg remove(epoch 7; pg2.20; ) v1 -7796> 2012-10-11 13:43:50.751421 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4097 0x1f95c60 -7795> 2012-10-11 13:43:50.751435 7f4402a29700 5 journal submit_entry seq 4097 len 682 (0x33ab6c0) -7794> 2012-10-11 13:43:50.751443 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7793> 2012-10-11 13:43:50.751450 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -7792> 2012-10-11 13:43:50.751466 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.db) v3 -- ?+0 0x3043a80 -7791> 2012-10-11 13:43:50.751492 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 107441) -7790> 2012-10-11 13:43:50.751549 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 891 ==== pg_info(1 pgs e6:0.d5) v3 ==== 471+0+0 (1037438171 0 0) 0x2a27540 con 0x2fe2140 -7789> 2012-10-11 13:43:50.751538 7f4402a29700 5 filestore(/data/osd.0) queue_transactions existing osr(2.db 0x25cf0f0)/0x25cf0f0 -7788> 2012-10-11 13:43:50.751574 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1460, time: 2012-10-11 13:43:48.982143, event: header_read, request: pg_info(1 pgs e6:0.d5) v3 -7787> 2012-10-11 13:43:50.751584 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) wait -7786> 2012-10-11 13:43:50.751595 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) wait -7785> 2012-10-11 13:43:50.751602 7f4402a29700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4098 0x1f95a20 -7784> 2012-10-11 13:43:50.751619 7f4402a29700 5 journal submit_entry seq 4098 len 682 (0x33f34b0) -7783> 2012-10-11 13:43:50.751608 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1460, time: 2012-10-11 13:43:48.982147, event: throttled, request: pg_info(1 pgs e6:0.d5) v3 -7782> 2012-10-11 13:43:50.751633 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1460, time: 2012-10-11 13:43:48.982155, event: all_read, request: pg_info(1 pgs e6:0.d5) v3 -7781> 2012-10-11 13:43:50.751641 7f4402a29700 5 throttle(filestore_ops 0x1dc5328) take 1 -7780> 2012-10-11 13:43:50.751653 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1460, time: 2012-10-11 13:43:50.751571, event: dispatched, request: pg_info(1 pgs e6:0.d5) v3 -7779> 2012-10-11 13:43:50.751660 7f4402a29700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -7778> 2012-10-11 13:43:50.751678 7f4402a29700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_notify(1.5b(2),1.63(2),1.64(2),1.6a(2),1.6b(2),1.6c(2),1.70(2),1.73(2),1.74(2),1.76(2),1.7d(2),1.7f(2),1.82(2),1.83(2),2.22(2),2.2a(2),2.2d(2),2.30(2),2.31(2),2.36(2),2.3a(2),2.3e(2),2.56(2),2.5a(2),2.62(2),2.63(2),2.69(2),2.6a(2),2.6b(2),2.6f(2),2.72(2),2.73(2),2.75(2),2.7c(2),2.7e(2),2.81(2),2.82(2),2.83(2),2.84(2),2.87(2) epoch 8) v4 -- ?+0 0x24af700 -7777> 2012-10-11 13:43:50.751709 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1460, time: 2012-10-11 13:43:50.751709, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.d5) v3 -7776> 2012-10-11 13:43:50.751726 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1460, time: 2012-10-11 13:43:50.751726, event: started, request: pg_info(1 pgs e6:0.d5) v3 -7775> 2012-10-11 13:43:50.751746 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1460, time: 2012-10-11 13:43:50.751746, event: done, request: pg_info(1 pgs e6:0.d5) v3 -7774> 2012-10-11 13:43:50.751765 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 106970) -7773> 2012-10-11 13:43:50.752081 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 547 ==== osd pg remove(epoch 7; pg2.4a; ) v1 ==== 25+0+0 (72302578 0 0) 0x31ac700 con 0x2fe2280 -7772> 2012-10-11 13:43:50.752058 7f4402a29700 5 --OSD::tracker-- reqid: mds.0.1:23, seq: 10, time: 2012-10-11 13:43:50.752058, event: reached_pg, request: osd_op(mds.0.1:23 mds0_inotable [writefull 0~29] 1.b852b893) v4 -7771> 2012-10-11 13:43:50.752109 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1461, time: 2012-10-11 13:43:50.044184, event: header_read, request: osd pg remove(epoch 7; pg2.4a; ) v1 -7770> 2012-10-11 13:43:50.752121 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1461, time: 2012-10-11 13:43:50.044191, event: throttled, request: osd pg remove(epoch 7; pg2.4a; ) v1 -7769> 2012-10-11 13:43:50.752131 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1461, time: 2012-10-11 13:43:50.044196, event: all_read, request: osd pg remove(epoch 7; pg2.4a; ) v1 -7768> 2012-10-11 13:43:50.752141 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1461, time: 2012-10-11 13:43:50.752097, event: dispatched, request: osd pg remove(epoch 7; pg2.4a; ) v1 -7767> 2012-10-11 13:43:50.752152 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1461, time: 2012-10-11 13:43:50.752152, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.4a; ) v1 -7766> 2012-10-11 13:43:50.752164 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1461, time: 2012-10-11 13:43:50.752164, event: started, request: osd pg remove(epoch 7; pg2.4a; ) v1 -7765> 2012-10-11 13:43:50.752175 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.4a -7764> 2012-10-11 13:43:50.752197 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.4a 0x3176820)/0x3176820 -7763> 2012-10-11 13:43:50.752207 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7762> 2012-10-11 13:43:50.752214 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7761> 2012-10-11 13:43:50.752221 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4099 0x2062750 -7760> 2012-10-11 13:43:50.752230 7f440532f700 5 journal submit_entry seq 4099 len 205 (0x204d9c0) -7759> 2012-10-11 13:43:50.752239 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7758> 2012-10-11 13:43:50.752246 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7757> 2012-10-11 13:43:50.752270 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1461, time: 2012-10-11 13:43:50.752270, event: done, request: osd pg remove(epoch 7; pg2.4a; ) v1 -7756> 2012-10-11 13:43:50.752287 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 106945) -7755> 2012-10-11 13:43:50.752295 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 892 ==== pg_info(1 pgs e6:0.d4) v3 ==== 471+0+0 (2432375315 0 0) 0x2a27380 con 0x2fe2140 -7754> 2012-10-11 13:43:50.752312 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1462, time: 2012-10-11 13:43:48.982159, event: header_read, request: pg_info(1 pgs e6:0.d4) v3 -7753> 2012-10-11 13:43:50.752323 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1462, time: 2012-10-11 13:43:48.982162, event: throttled, request: pg_info(1 pgs e6:0.d4) v3 -7752> 2012-10-11 13:43:50.752333 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1462, time: 2012-10-11 13:43:48.982170, event: all_read, request: pg_info(1 pgs e6:0.d4) v3 -7751> 2012-10-11 13:43:50.752343 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1462, time: 2012-10-11 13:43:50.752310, event: dispatched, request: pg_info(1 pgs e6:0.d4) v3 -7750> 2012-10-11 13:43:50.752354 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1462, time: 2012-10-11 13:43:50.752354, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.d4) v3 -7749> 2012-10-11 13:43:50.752365 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1462, time: 2012-10-11 13:43:50.752365, event: started, request: pg_info(1 pgs e6:0.d4) v3 -7748> 2012-10-11 13:43:50.752385 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1462, time: 2012-10-11 13:43:50.752385, event: done, request: pg_info(1 pgs e6:0.d4) v3 -7747> 2012-10-11 13:43:50.752398 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 106474) -7746> 2012-10-11 13:43:50.752407 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 548 ==== osd pg remove(epoch 7; pg2.46; ) v1 ==== 25+0+0 (1734981957 0 0) 0x31ac540 con 0x2fe2280 -7745> 2012-10-11 13:43:50.752422 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1463, time: 2012-10-11 13:43:50.044233, event: header_read, request: osd pg remove(epoch 7; pg2.46; ) v1 -7744> 2012-10-11 13:43:50.752433 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1463, time: 2012-10-11 13:43:50.044241, event: throttled, request: osd pg remove(epoch 7; pg2.46; ) v1 -7743> 2012-10-11 13:43:50.752444 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1463, time: 2012-10-11 13:43:50.044246, event: all_read, request: osd pg remove(epoch 7; pg2.46; ) v1 -7742> 2012-10-11 13:43:50.752454 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1463, time: 2012-10-11 13:43:50.752420, event: dispatched, request: osd pg remove(epoch 7; pg2.46; ) v1 -7741> 2012-10-11 13:43:50.752467 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1463, time: 2012-10-11 13:43:50.752467, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.46; ) v1 -7740> 2012-10-11 13:43:50.752478 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1463, time: 2012-10-11 13:43:50.752478, event: started, request: osd pg remove(epoch 7; pg2.46; ) v1 -7739> 2012-10-11 13:43:50.752488 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.46 -7738> 2012-10-11 13:43:50.752508 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.46 0x1d71fb0)/0x1d71fb0 -7737> 2012-10-11 13:43:50.752518 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7736> 2012-10-11 13:43:50.752525 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7735> 2012-10-11 13:43:50.752531 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4100 0x2062f30 -7734> 2012-10-11 13:43:50.752540 7f440532f700 5 journal submit_entry seq 4100 len 205 (0x216e9c0) -7733> 2012-10-11 13:43:50.752549 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7732> 2012-10-11 13:43:50.752556 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7731> 2012-10-11 13:43:50.752577 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1463, time: 2012-10-11 13:43:50.752577, event: done, request: osd pg remove(epoch 7; pg2.46; ) v1 -7730> 2012-10-11 13:43:50.752593 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 106449) -7729> 2012-10-11 13:43:50.752602 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 893 ==== pg_info(1 pgs e6:1.d3) v3 ==== 471+0+0 (1705881486 0 0) 0x2a271c0 con 0x2fe2140 -7728> 2012-10-11 13:43:50.752617 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1464, time: 2012-10-11 13:43:48.982174, event: header_read, request: pg_info(1 pgs e6:1.d3) v3 -7727> 2012-10-11 13:43:50.752629 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1464, time: 2012-10-11 13:43:48.982178, event: throttled, request: pg_info(1 pgs e6:1.d3) v3 -7726> 2012-10-11 13:43:50.752639 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1464, time: 2012-10-11 13:43:48.982185, event: all_read, request: pg_info(1 pgs e6:1.d3) v3 -7725> 2012-10-11 13:43:50.752649 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1464, time: 2012-10-11 13:43:50.752615, event: dispatched, request: pg_info(1 pgs e6:1.d3) v3 -7724> 2012-10-11 13:43:50.752660 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1464, time: 2012-10-11 13:43:50.752660, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.d3) v3 -7723> 2012-10-11 13:43:50.752671 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1464, time: 2012-10-11 13:43:50.752671, event: started, request: pg_info(1 pgs e6:1.d3) v3 -7722> 2012-10-11 13:43:50.752690 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1464, time: 2012-10-11 13:43:50.752689, event: done, request: pg_info(1 pgs e6:1.d3) v3 -7721> 2012-10-11 13:43:50.752702 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 105978) -7720> 2012-10-11 13:43:50.752711 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 549 ==== osd pg remove(epoch 7; pg2.50; ) v1 ==== 25+0+0 (1350224082 0 0) 0x31ac380 con 0x2fe2280 -7719> 2012-10-11 13:43:50.752725 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1465, time: 2012-10-11 13:43:50.044283, event: header_read, request: osd pg remove(epoch 7; pg2.50; ) v1 -7718> 2012-10-11 13:43:50.752736 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1465, time: 2012-10-11 13:43:50.044290, event: throttled, request: osd pg remove(epoch 7; pg2.50; ) v1 -7717> 2012-10-11 13:43:50.752747 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1465, time: 2012-10-11 13:43:50.044295, event: all_read, request: osd pg remove(epoch 7; pg2.50; ) v1 -7716> 2012-10-11 13:43:50.752757 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1465, time: 2012-10-11 13:43:50.752724, event: dispatched, request: osd pg remove(epoch 7; pg2.50; ) v1 -7715> 2012-10-11 13:43:50.752768 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1465, time: 2012-10-11 13:43:50.752768, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.50; ) v1 -7714> 2012-10-11 13:43:50.752779 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1465, time: 2012-10-11 13:43:50.752779, event: started, request: osd pg remove(epoch 7; pg2.50; ) v1 -7713> 2012-10-11 13:43:50.752789 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.50 -7712> 2012-10-11 13:43:50.752808 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.50 0x21300d0)/0x21300d0 -7711> 2012-10-11 13:43:50.752818 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7710> 2012-10-11 13:43:50.752825 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7709> 2012-10-11 13:43:50.752832 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4101 0x2062510 -7708> 2012-10-11 13:43:50.752840 7f440532f700 5 journal submit_entry seq 4101 len 205 (0x216e480) -7707> 2012-10-11 13:43:50.752849 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7706> 2012-10-11 13:43:50.752855 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7705> 2012-10-11 13:43:50.752878 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1465, time: 2012-10-11 13:43:50.752878, event: done, request: osd pg remove(epoch 7; pg2.50; ) v1 -7704> 2012-10-11 13:43:50.752896 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 105953) -7703> 2012-10-11 13:43:50.752905 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 894 ==== pg_info(1 pgs e6:2.d3) v3 ==== 471+0+0 (2622111893 0 0) 0x2a27000 con 0x2fe2140 -7702> 2012-10-11 13:43:50.752921 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1466, time: 2012-10-11 13:43:48.982190, event: header_read, request: pg_info(1 pgs e6:2.d3) v3 -7701> 2012-10-11 13:43:50.752932 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1466, time: 2012-10-11 13:43:48.982194, event: throttled, request: pg_info(1 pgs e6:2.d3) v3 -7700> 2012-10-11 13:43:50.752942 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1466, time: 2012-10-11 13:43:48.982201, event: all_read, request: pg_info(1 pgs e6:2.d3) v3 -7699> 2012-10-11 13:43:50.752952 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1466, time: 2012-10-11 13:43:50.752919, event: dispatched, request: pg_info(1 pgs e6:2.d3) v3 -7698> 2012-10-11 13:43:50.752962 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1466, time: 2012-10-11 13:43:50.752962, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.d3) v3 -7697> 2012-10-11 13:43:50.752974 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1466, time: 2012-10-11 13:43:50.752974, event: started, request: pg_info(1 pgs e6:2.d3) v3 -7696> 2012-10-11 13:43:50.752993 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1466, time: 2012-10-11 13:43:50.752993, event: done, request: pg_info(1 pgs e6:2.d3) v3 -7695> 2012-10-11 13:43:50.753007 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 105482) -7694> 2012-10-11 13:43:50.753015 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 550 ==== osd pg remove(epoch 7; pg2.58; ) v1 ==== 25+0+0 (306301960 0 0) 0x31ac1c0 con 0x2fe2280 -7693> 2012-10-11 13:43:50.753030 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1467, time: 2012-10-11 13:43:50.044336, event: header_read, request: osd pg remove(epoch 7; pg2.58; ) v1 -7692> 2012-10-11 13:43:50.753042 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1467, time: 2012-10-11 13:43:50.044343, event: throttled, request: osd pg remove(epoch 7; pg2.58; ) v1 -7691> 2012-10-11 13:43:50.753052 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1467, time: 2012-10-11 13:43:50.044348, event: all_read, request: osd pg remove(epoch 7; pg2.58; ) v1 -7690> 2012-10-11 13:43:50.753062 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1467, time: 2012-10-11 13:43:50.753029, event: dispatched, request: osd pg remove(epoch 7; pg2.58; ) v1 -7689> 2012-10-11 13:43:50.753073 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1467, time: 2012-10-11 13:43:50.753073, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.58; ) v1 -7688> 2012-10-11 13:43:50.753084 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1467, time: 2012-10-11 13:43:50.753084, event: started, request: osd pg remove(epoch 7; pg2.58; ) v1 -7687> 2012-10-11 13:43:50.753095 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.58 -7686> 2012-10-11 13:43:50.753114 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.58 0x2130390)/0x2130390 -7685> 2012-10-11 13:43:50.753124 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7684> 2012-10-11 13:43:50.753131 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7683> 2012-10-11 13:43:50.753138 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4102 0x2062090 -7682> 2012-10-11 13:43:50.753146 7f440532f700 5 journal submit_entry seq 4102 len 205 (0x21cf390) -7681> 2012-10-11 13:43:50.753155 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7680> 2012-10-11 13:43:50.753161 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7679> 2012-10-11 13:43:50.753183 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1467, time: 2012-10-11 13:43:50.753183, event: done, request: osd pg remove(epoch 7; pg2.58; ) v1 -7678> 2012-10-11 13:43:50.753199 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 105457) -7677> 2012-10-11 13:43:50.753208 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 895 ==== pg_info(1 pgs e6:2.d2) v3 ==== 471+0+0 (275567612 0 0) 0x206de00 con 0x2fe2140 -7676> 2012-10-11 13:43:50.753223 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1468, time: 2012-10-11 13:43:48.982205, event: header_read, request: pg_info(1 pgs e6:2.d2) v3 -7675> 2012-10-11 13:43:50.753234 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1468, time: 2012-10-11 13:43:48.982219, event: throttled, request: pg_info(1 pgs e6:2.d2) v3 -7674> 2012-10-11 13:43:50.753246 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1468, time: 2012-10-11 13:43:48.982229, event: all_read, request: pg_info(1 pgs e6:2.d2) v3 -7673> 2012-10-11 13:43:50.753265 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1468, time: 2012-10-11 13:43:50.753222, event: dispatched, request: pg_info(1 pgs e6:2.d2) v3 -7672> 2012-10-11 13:43:50.753276 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1468, time: 2012-10-11 13:43:50.753276, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.d2) v3 -7671> 2012-10-11 13:43:50.753287 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1468, time: 2012-10-11 13:43:50.753287, event: started, request: pg_info(1 pgs e6:2.d2) v3 -7670> 2012-10-11 13:43:50.753306 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1468, time: 2012-10-11 13:43:50.753306, event: done, request: pg_info(1 pgs e6:2.d2) v3 -7669> 2012-10-11 13:43:50.753321 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 104986) -7668> 2012-10-11 13:43:50.753329 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 551 ==== osd pg remove(epoch 7; pg2.59; ) v1 ==== 25+0+0 (1534964015 0 0) 0x31ac000 con 0x2fe2280 -7667> 2012-10-11 13:43:50.753344 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1469, time: 2012-10-11 13:43:50.044385, event: header_read, request: osd pg remove(epoch 7; pg2.59; ) v1 -7666> 2012-10-11 13:43:50.753355 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1469, time: 2012-10-11 13:43:50.044392, event: throttled, request: osd pg remove(epoch 7; pg2.59; ) v1 -7665> 2012-10-11 13:43:50.753366 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1469, time: 2012-10-11 13:43:50.044397, event: all_read, request: osd pg remove(epoch 7; pg2.59; ) v1 -7664> 2012-10-11 13:43:50.753376 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1469, time: 2012-10-11 13:43:50.753342, event: dispatched, request: osd pg remove(epoch 7; pg2.59; ) v1 -7663> 2012-10-11 13:43:50.753387 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1469, time: 2012-10-11 13:43:50.753387, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.59; ) v1 -7662> 2012-10-11 13:43:50.753399 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1469, time: 2012-10-11 13:43:50.753399, event: started, request: osd pg remove(epoch 7; pg2.59; ) v1 -7661> 2012-10-11 13:43:50.753409 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.59 -7660> 2012-10-11 13:43:50.753429 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.59 0x2130430)/0x2130430 -7659> 2012-10-11 13:43:50.753439 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7658> 2012-10-11 13:43:50.753446 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7657> 2012-10-11 13:43:50.753453 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4103 0x2062e10 -7656> 2012-10-11 13:43:50.753461 7f440532f700 5 journal submit_entry seq 4103 len 205 (0x21cfc00) -7655> 2012-10-11 13:43:50.753469 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7654> 2012-10-11 13:43:50.753476 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7653> 2012-10-11 13:43:50.753497 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1469, time: 2012-10-11 13:43:50.753497, event: done, request: osd pg remove(epoch 7; pg2.59; ) v1 -7652> 2012-10-11 13:43:50.753514 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 104961) -7651> 2012-10-11 13:43:50.753522 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 896 ==== pg_info(1 pgs e6:2.cc) v3 ==== 471+0+0 (2898664668 0 0) 0x206dc40 con 0x2fe2140 -7650> 2012-10-11 13:43:50.753537 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1470, time: 2012-10-11 13:43:48.982233, event: header_read, request: pg_info(1 pgs e6:2.cc) v3 -7649> 2012-10-11 13:43:50.753548 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1470, time: 2012-10-11 13:43:48.982237, event: throttled, request: pg_info(1 pgs e6:2.cc) v3 -7648> 2012-10-11 13:43:50.753559 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1470, time: 2012-10-11 13:43:48.982245, event: all_read, request: pg_info(1 pgs e6:2.cc) v3 -7647> 2012-10-11 13:43:50.753569 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1470, time: 2012-10-11 13:43:50.753536, event: dispatched, request: pg_info(1 pgs e6:2.cc) v3 -7646> 2012-10-11 13:43:50.753579 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1470, time: 2012-10-11 13:43:50.753579, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.cc) v3 -7645> 2012-10-11 13:43:50.753591 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1470, time: 2012-10-11 13:43:50.753591, event: started, request: pg_info(1 pgs e6:2.cc) v3 -7644> 2012-10-11 13:43:50.753609 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1470, time: 2012-10-11 13:43:50.753609, event: done, request: pg_info(1 pgs e6:2.cc) v3 -7643> 2012-10-11 13:43:50.753622 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 104490) -7642> 2012-10-11 13:43:50.753630 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 552 ==== osd pg remove(epoch 7; pg2.5e; ) v1 ==== 25+0+0 (2703537195 0 0) 0x28c98c0 con 0x2fe2280 -7641> 2012-10-11 13:43:50.753644 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1471, time: 2012-10-11 13:43:50.044434, event: header_read, request: osd pg remove(epoch 7; pg2.5e; ) v1 -7640> 2012-10-11 13:43:50.753656 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1471, time: 2012-10-11 13:43:50.044441, event: throttled, request: osd pg remove(epoch 7; pg2.5e; ) v1 -7639> 2012-10-11 13:43:50.753666 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1471, time: 2012-10-11 13:43:50.044452, event: all_read, request: osd pg remove(epoch 7; pg2.5e; ) v1 -7638> 2012-10-11 13:43:50.753676 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1471, time: 2012-10-11 13:43:50.753643, event: dispatched, request: osd pg remove(epoch 7; pg2.5e; ) v1 -7637> 2012-10-11 13:43:50.753687 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1471, time: 2012-10-11 13:43:50.753687, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.5e; ) v1 -7636> 2012-10-11 13:43:50.753699 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1471, time: 2012-10-11 13:43:50.753699, event: started, request: osd pg remove(epoch 7; pg2.5e; ) v1 -7635> 2012-10-11 13:43:50.753709 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.5e -7634> 2012-10-11 13:43:50.753729 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.5e 0x21302b0)/0x21302b0 -7633> 2012-10-11 13:43:50.753738 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7632> 2012-10-11 13:43:50.753745 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7631> 2012-10-11 13:43:50.753752 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4104 0x20622d0 -7630> 2012-10-11 13:43:50.753761 7f440532f700 5 journal submit_entry seq 4104 len 205 (0x2496a50) -7629> 2012-10-11 13:43:50.753770 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7628> 2012-10-11 13:43:50.753777 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7627> 2012-10-11 13:43:50.753800 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1471, time: 2012-10-11 13:43:50.753800, event: done, request: osd pg remove(epoch 7; pg2.5e; ) v1 -7626> 2012-10-11 13:43:50.753816 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 104465) -7625> 2012-10-11 13:43:50.753825 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 897 ==== pg_info(1 pgs e6:0.ce) v3 ==== 471+0+0 (384808044 0 0) 0x206da80 con 0x2fe2140 -7624> 2012-10-11 13:43:50.753840 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1472, time: 2012-10-11 13:43:48.982249, event: header_read, request: pg_info(1 pgs e6:0.ce) v3 -7623> 2012-10-11 13:43:50.753851 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1472, time: 2012-10-11 13:43:48.982252, event: throttled, request: pg_info(1 pgs e6:0.ce) v3 -7622> 2012-10-11 13:43:50.753861 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1472, time: 2012-10-11 13:43:48.982260, event: all_read, request: pg_info(1 pgs e6:0.ce) v3 -7621> 2012-10-11 13:43:50.753871 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1472, time: 2012-10-11 13:43:50.753839, event: dispatched, request: pg_info(1 pgs e6:0.ce) v3 -7620> 2012-10-11 13:43:50.753882 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1472, time: 2012-10-11 13:43:50.753882, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.ce) v3 -7619> 2012-10-11 13:43:50.753894 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1472, time: 2012-10-11 13:43:50.753894, event: started, request: pg_info(1 pgs e6:0.ce) v3 -7618> 2012-10-11 13:43:50.753913 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1472, time: 2012-10-11 13:43:50.753912, event: done, request: pg_info(1 pgs e6:0.ce) v3 -7617> 2012-10-11 13:43:50.753925 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 103994) -7616> 2012-10-11 13:43:50.753934 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 553 ==== osd pg remove(epoch 7; pg2.47; ) v1 ==== 25+0+0 (777372770 0 0) 0x28c9c40 con 0x2fe2280 -7615> 2012-10-11 13:43:50.753948 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1473, time: 2012-10-11 13:43:50.044492, event: header_read, request: osd pg remove(epoch 7; pg2.47; ) v1 -7614> 2012-10-11 13:43:50.753959 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1473, time: 2012-10-11 13:43:50.044499, event: throttled, request: osd pg remove(epoch 7; pg2.47; ) v1 -7613> 2012-10-11 13:43:50.753970 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1473, time: 2012-10-11 13:43:50.044504, event: all_read, request: osd pg remove(epoch 7; pg2.47; ) v1 -7612> 2012-10-11 13:43:50.753980 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1473, time: 2012-10-11 13:43:50.753947, event: dispatched, request: osd pg remove(epoch 7; pg2.47; ) v1 -7611> 2012-10-11 13:43:50.753991 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1473, time: 2012-10-11 13:43:50.753991, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.47; ) v1 -7610> 2012-10-11 13:43:50.754002 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1473, time: 2012-10-11 13:43:50.754002, event: started, request: osd pg remove(epoch 7; pg2.47; ) v1 -7609> 2012-10-11 13:43:50.754013 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.47 -7608> 2012-10-11 13:43:50.754032 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.47 0x1d71dd0)/0x1d71dd0 -7607> 2012-10-11 13:43:50.754042 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7606> 2012-10-11 13:43:50.754048 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7605> 2012-10-11 13:43:50.754055 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4105 0x2062ea0 -7604> 2012-10-11 13:43:50.754064 7f440532f700 5 journal submit_entry seq 4105 len 205 (0x23e2720) -7603> 2012-10-11 13:43:50.754072 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7602> 2012-10-11 13:43:50.754079 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7601> 2012-10-11 13:43:50.754101 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1473, time: 2012-10-11 13:43:50.754101, event: done, request: osd pg remove(epoch 7; pg2.47; ) v1 -7600> 2012-10-11 13:43:50.754117 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 103969) -7599> 2012-10-11 13:43:50.754129 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 898 ==== pg_info(1 pgs e6:0.cd) v3 ==== 471+0+0 (2650740862 0 0) 0x206d8c0 con 0x2fe2140 -7598> 2012-10-11 13:43:50.754145 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1474, time: 2012-10-11 13:43:48.982264, event: header_read, request: pg_info(1 pgs e6:0.cd) v3 -7597> 2012-10-11 13:43:50.754156 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1474, time: 2012-10-11 13:43:48.982268, event: throttled, request: pg_info(1 pgs e6:0.cd) v3 -7596> 2012-10-11 13:43:50.754166 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1474, time: 2012-10-11 13:43:48.982276, event: all_read, request: pg_info(1 pgs e6:0.cd) v3 -7595> 2012-10-11 13:43:50.754176 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1474, time: 2012-10-11 13:43:50.754143, event: dispatched, request: pg_info(1 pgs e6:0.cd) v3 -7594> 2012-10-11 13:43:50.754187 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1474, time: 2012-10-11 13:43:50.754187, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.cd) v3 -7593> 2012-10-11 13:43:50.754198 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1474, time: 2012-10-11 13:43:50.754198, event: started, request: pg_info(1 pgs e6:0.cd) v3 -7592> 2012-10-11 13:43:50.754217 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1474, time: 2012-10-11 13:43:50.754217, event: done, request: pg_info(1 pgs e6:0.cd) v3 -7591> 2012-10-11 13:43:50.754230 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 103498) -7590> 2012-10-11 13:43:50.754238 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 554 ==== osd pg remove(epoch 7; pg2.6d; ) v1 ==== 25+0+0 (4078329711 0 0) 0x2c18000 con 0x2fe2280 -7589> 2012-10-11 13:43:50.754253 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1475, time: 2012-10-11 13:43:50.044541, event: header_read, request: osd pg remove(epoch 7; pg2.6d; ) v1 -7588> 2012-10-11 13:43:50.754264 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1475, time: 2012-10-11 13:43:50.044548, event: throttled, request: osd pg remove(epoch 7; pg2.6d; ) v1 -7587> 2012-10-11 13:43:50.754275 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1475, time: 2012-10-11 13:43:50.044553, event: all_read, request: osd pg remove(epoch 7; pg2.6d; ) v1 -7586> 2012-10-11 13:43:50.754285 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1475, time: 2012-10-11 13:43:50.754252, event: dispatched, request: osd pg remove(epoch 7; pg2.6d; ) v1 -7585> 2012-10-11 13:43:50.754296 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1475, time: 2012-10-11 13:43:50.754296, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.6d; ) v1 -7584> 2012-10-11 13:43:50.754307 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1475, time: 2012-10-11 13:43:50.754307, event: started, request: osd pg remove(epoch 7; pg2.6d; ) v1 -7583> 2012-10-11 13:43:50.754318 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.6d -7582> 2012-10-11 13:43:50.754337 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.6d 0x2130620)/0x2130620 -7581> 2012-10-11 13:43:50.754347 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7580> 2012-10-11 13:43:50.754354 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7579> 2012-10-11 13:43:50.754361 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4106 0x2062360 -7578> 2012-10-11 13:43:50.754369 7f440532f700 5 journal submit_entry seq 4106 len 205 (0x216e2d0) -7577> 2012-10-11 13:43:50.754377 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7576> 2012-10-11 13:43:50.754384 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7575> 2012-10-11 13:43:50.754406 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1475, time: 2012-10-11 13:43:50.754405, event: done, request: osd pg remove(epoch 7; pg2.6d; ) v1 -7574> 2012-10-11 13:43:50.754422 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 103473) -7573> 2012-10-11 13:43:50.754430 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 899 ==== pg_info(1 pgs e6:1.cc) v3 ==== 471+0+0 (3362507097 0 0) 0x206d700 con 0x2fe2140 -7572> 2012-10-11 13:43:50.754446 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1476, time: 2012-10-11 13:43:48.982280, event: header_read, request: pg_info(1 pgs e6:1.cc) v3 -7571> 2012-10-11 13:43:50.754457 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1476, time: 2012-10-11 13:43:48.982284, event: throttled, request: pg_info(1 pgs e6:1.cc) v3 -7570> 2012-10-11 13:43:50.754467 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1476, time: 2012-10-11 13:43:48.982291, event: all_read, request: pg_info(1 pgs e6:1.cc) v3 -7569> 2012-10-11 13:43:50.754477 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1476, time: 2012-10-11 13:43:50.754444, event: dispatched, request: pg_info(1 pgs e6:1.cc) v3 -7568> 2012-10-11 13:43:50.754487 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1476, time: 2012-10-11 13:43:50.754487, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.cc) v3 -7567> 2012-10-11 13:43:50.754500 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1476, time: 2012-10-11 13:43:50.754500, event: started, request: pg_info(1 pgs e6:1.cc) v3 -7566> 2012-10-11 13:43:50.754518 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1476, time: 2012-10-11 13:43:50.754518, event: done, request: pg_info(1 pgs e6:1.cc) v3 -7565> 2012-10-11 13:43:50.754531 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 103002) -7564> 2012-10-11 13:43:50.754540 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 555 ==== osd pg remove(epoch 7; pg2.6c; ) v1 ==== 25+0+0 (3123323464 0 0) 0x2c18c40 con 0x2fe2280 -7563> 2012-10-11 13:43:50.754554 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1477, time: 2012-10-11 13:43:50.044590, event: header_read, request: osd pg remove(epoch 7; pg2.6c; ) v1 -7562> 2012-10-11 13:43:50.754565 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1477, time: 2012-10-11 13:43:50.044597, event: throttled, request: osd pg remove(epoch 7; pg2.6c; ) v1 -7561> 2012-10-11 13:43:50.754579 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1477, time: 2012-10-11 13:43:50.044602, event: all_read, request: osd pg remove(epoch 7; pg2.6c; ) v1 -7560> 2012-10-11 13:43:50.754590 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1477, time: 2012-10-11 13:43:50.754553, event: dispatched, request: osd pg remove(epoch 7; pg2.6c; ) v1 -7559> 2012-10-11 13:43:50.754600 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1477, time: 2012-10-11 13:43:50.754600, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.6c; ) v1 -7558> 2012-10-11 13:43:50.754612 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1477, time: 2012-10-11 13:43:50.754612, event: started, request: osd pg remove(epoch 7; pg2.6c; ) v1 -7557> 2012-10-11 13:43:50.754622 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.6c -7556> 2012-10-11 13:43:50.754642 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.6c 0x3176a00)/0x3176a00 -7555> 2012-10-11 13:43:50.754652 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7554> 2012-10-11 13:43:50.754659 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7553> 2012-10-11 13:43:50.754666 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4107 0x2062c60 -7552> 2012-10-11 13:43:50.754675 7f440532f700 5 journal submit_entry seq 4107 len 205 (0x32e8270) -7551> 2012-10-11 13:43:50.754683 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7550> 2012-10-11 13:43:50.754690 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7549> 2012-10-11 13:43:50.754711 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1477, time: 2012-10-11 13:43:50.754710, event: done, request: osd pg remove(epoch 7; pg2.6c; ) v1 -7548> 2012-10-11 13:43:50.754726 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 102977) -7547> 2012-10-11 13:43:50.754735 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 900 ==== pg_info(1 pgs e6:1.cd) v3 ==== 471+0+0 (2924492036 0 0) 0x206d540 con 0x2fe2140 -7546> 2012-10-11 13:43:50.754750 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1478, time: 2012-10-11 13:43:48.982294, event: header_read, request: pg_info(1 pgs e6:1.cd) v3 -7545> 2012-10-11 13:43:50.754761 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1478, time: 2012-10-11 13:43:48.982299, event: throttled, request: pg_info(1 pgs e6:1.cd) v3 -7544> 2012-10-11 13:43:50.754771 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1478, time: 2012-10-11 13:43:48.982308, event: all_read, request: pg_info(1 pgs e6:1.cd) v3 -7543> 2012-10-11 13:43:50.754781 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1478, time: 2012-10-11 13:43:50.754749, event: dispatched, request: pg_info(1 pgs e6:1.cd) v3 -7542> 2012-10-11 13:43:50.754792 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1478, time: 2012-10-11 13:43:50.754792, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.cd) v3 -7541> 2012-10-11 13:43:50.754803 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1478, time: 2012-10-11 13:43:50.754803, event: started, request: pg_info(1 pgs e6:1.cd) v3 -7540> 2012-10-11 13:43:50.754823 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1478, time: 2012-10-11 13:43:50.754823, event: done, request: pg_info(1 pgs e6:1.cd) v3 -7539> 2012-10-11 13:43:50.754837 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 102506) -7538> 2012-10-11 13:43:50.754845 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 556 ==== osd pg remove(epoch 7; pg2.71; ) v1 ==== 25+0+0 (340185196 0 0) 0x1ed6e00 con 0x2fe2280 -7537> 2012-10-11 13:43:50.754860 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1479, time: 2012-10-11 13:43:50.044639, event: header_read, request: osd pg remove(epoch 7; pg2.71; ) v1 -7536> 2012-10-11 13:43:50.754871 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1479, time: 2012-10-11 13:43:50.044646, event: throttled, request: osd pg remove(epoch 7; pg2.71; ) v1 -7535> 2012-10-11 13:43:50.754882 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1479, time: 2012-10-11 13:43:50.044652, event: all_read, request: osd pg remove(epoch 7; pg2.71; ) v1 -7534> 2012-10-11 13:43:50.754892 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1479, time: 2012-10-11 13:43:50.754858, event: dispatched, request: osd pg remove(epoch 7; pg2.71; ) v1 -7533> 2012-10-11 13:43:50.754903 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1479, time: 2012-10-11 13:43:50.754903, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.71; ) v1 -7532> 2012-10-11 13:43:50.754914 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1479, time: 2012-10-11 13:43:50.754914, event: started, request: osd pg remove(epoch 7; pg2.71; ) v1 -7531> 2012-10-11 13:43:50.754925 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.71 -7530> 2012-10-11 13:43:50.754944 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.71 0x2130770)/0x2130770 -7529> 2012-10-11 13:43:50.754954 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7528> 2012-10-11 13:43:50.754960 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7527> 2012-10-11 13:43:50.754967 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4108 0x2062ab0 -7526> 2012-10-11 13:43:50.754976 7f440532f700 5 journal submit_entry seq 4108 len 205 (0x32e8420) -7525> 2012-10-11 13:43:50.754984 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7524> 2012-10-11 13:43:50.754991 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7523> 2012-10-11 13:43:50.755014 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1479, time: 2012-10-11 13:43:50.755014, event: done, request: osd pg remove(epoch 7; pg2.71; ) v1 -7522> 2012-10-11 13:43:50.755030 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 102481) -7521> 2012-10-11 13:43:50.755039 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 901 ==== pg_info(1 pgs e6:2.cb) v3 ==== 471+0+0 (2942161918 0 0) 0x206d380 con 0x2fe2140 -7520> 2012-10-11 13:43:50.755055 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1480, time: 2012-10-11 13:43:48.982313, event: header_read, request: pg_info(1 pgs e6:2.cb) v3 -7519> 2012-10-11 13:43:50.755065 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1480, time: 2012-10-11 13:43:48.982315, event: throttled, request: pg_info(1 pgs e6:2.cb) v3 -7518> 2012-10-11 13:43:50.755076 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1480, time: 2012-10-11 13:43:48.982323, event: all_read, request: pg_info(1 pgs e6:2.cb) v3 -7517> 2012-10-11 13:43:50.755086 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1480, time: 2012-10-11 13:43:50.755053, event: dispatched, request: pg_info(1 pgs e6:2.cb) v3 -7516> 2012-10-11 13:43:50.755096 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1480, time: 2012-10-11 13:43:50.755096, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.cb) v3 -7515> 2012-10-11 13:43:50.755108 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1480, time: 2012-10-11 13:43:50.755108, event: started, request: pg_info(1 pgs e6:2.cb) v3 -7514> 2012-10-11 13:43:50.755127 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1480, time: 2012-10-11 13:43:50.755127, event: done, request: pg_info(1 pgs e6:2.cb) v3 -7513> 2012-10-11 13:43:50.755139 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 102010) -7512> 2012-10-11 13:43:50.755147 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 557 ==== osd pg remove(epoch 7; pg2.78; ) v1 ==== 25+0+0 (524396945 0 0) 0x1ed68c0 con 0x2fe2280 -7511> 2012-10-11 13:43:50.755162 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1481, time: 2012-10-11 13:43:50.044690, event: header_read, request: osd pg remove(epoch 7; pg2.78; ) v1 -7510> 2012-10-11 13:43:50.755173 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1481, time: 2012-10-11 13:43:50.044697, event: throttled, request: osd pg remove(epoch 7; pg2.78; ) v1 -7509> 2012-10-11 13:43:50.755183 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1481, time: 2012-10-11 13:43:50.044702, event: all_read, request: osd pg remove(epoch 7; pg2.78; ) v1 -7508> 2012-10-11 13:43:50.755194 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1481, time: 2012-10-11 13:43:50.755161, event: dispatched, request: osd pg remove(epoch 7; pg2.78; ) v1 -7507> 2012-10-11 13:43:50.755204 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1481, time: 2012-10-11 13:43:50.755204, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.78; ) v1 -7506> 2012-10-11 13:43:50.755216 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1481, time: 2012-10-11 13:43:50.755216, event: started, request: osd pg remove(epoch 7; pg2.78; ) v1 -7505> 2012-10-11 13:43:50.755229 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.78 -7504> 2012-10-11 13:43:50.755248 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.78 0x21307b0)/0x21307b0 -7503> 2012-10-11 13:43:50.755259 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7502> 2012-10-11 13:43:50.755265 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7501> 2012-10-11 13:43:50.755272 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4109 0x20626c0 -7500> 2012-10-11 13:43:50.755281 7f440532f700 5 journal submit_entry seq 4109 len 205 (0x32e87b0) -7499> 2012-10-11 13:43:50.755290 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7498> 2012-10-11 13:43:50.755296 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7497> 2012-10-11 13:43:50.755318 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1481, time: 2012-10-11 13:43:50.755318, event: done, request: osd pg remove(epoch 7; pg2.78; ) v1 -7496> 2012-10-11 13:43:50.755334 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 101985) -7495> 2012-10-11 13:43:50.755343 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 902 ==== pg_info(1 pgs e6:0.c8) v3 ==== 471+0+0 (3657259705 0 0) 0x206d1c0 con 0x2fe2140 -7494> 2012-10-11 13:43:50.755358 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1482, time: 2012-10-11 13:43:48.982325, event: header_read, request: pg_info(1 pgs e6:0.c8) v3 -7493> 2012-10-11 13:43:50.755369 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1482, time: 2012-10-11 13:43:48.982327, event: throttled, request: pg_info(1 pgs e6:0.c8) v3 -7492> 2012-10-11 13:43:50.755380 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1482, time: 2012-10-11 13:43:48.982335, event: all_read, request: pg_info(1 pgs e6:0.c8) v3 -7491> 2012-10-11 13:43:50.755390 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1482, time: 2012-10-11 13:43:50.755357, event: dispatched, request: pg_info(1 pgs e6:0.c8) v3 -7490> 2012-10-11 13:43:50.755400 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1482, time: 2012-10-11 13:43:50.755400, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.c8) v3 -7489> 2012-10-11 13:43:50.755412 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1482, time: 2012-10-11 13:43:50.755412, event: started, request: pg_info(1 pgs e6:0.c8) v3 -7488> 2012-10-11 13:43:50.755430 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1482, time: 2012-10-11 13:43:50.755430, event: done, request: pg_info(1 pgs e6:0.c8) v3 -7487> 2012-10-11 13:43:50.755443 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 101514) -7486> 2012-10-11 13:43:50.755452 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 558 ==== osd pg remove(epoch 7; pg2.86; ) v1 ==== 25+0+0 (1231610899 0 0) 0x1ed6700 con 0x2fe2280 -7485> 2012-10-11 13:43:50.755466 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1483, time: 2012-10-11 13:43:50.044740, event: header_read, request: osd pg remove(epoch 7; pg2.86; ) v1 -7484> 2012-10-11 13:43:50.755477 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1483, time: 2012-10-11 13:43:50.044747, event: throttled, request: osd pg remove(epoch 7; pg2.86; ) v1 -7483> 2012-10-11 13:43:50.755487 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1483, time: 2012-10-11 13:43:50.044752, event: all_read, request: osd pg remove(epoch 7; pg2.86; ) v1 -7482> 2012-10-11 13:43:50.755498 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1483, time: 2012-10-11 13:43:50.755465, event: dispatched, request: osd pg remove(epoch 7; pg2.86; ) v1 -7481> 2012-10-11 13:43:50.755508 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1483, time: 2012-10-11 13:43:50.755508, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.86; ) v1 -7480> 2012-10-11 13:43:50.755520 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1483, time: 2012-10-11 13:43:50.755519, event: started, request: osd pg remove(epoch 7; pg2.86; ) v1 -7479> 2012-10-11 13:43:50.755530 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.86 -7478> 2012-10-11 13:43:50.755549 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.86 0x2130a10)/0x2130a10 -7477> 2012-10-11 13:43:50.755559 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7476> 2012-10-11 13:43:50.755566 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7475> 2012-10-11 13:43:50.755573 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4110 0x20625a0 -7474> 2012-10-11 13:43:50.755582 7f440532f700 5 journal submit_entry seq 4110 len 205 (0x331bbd0) -7473> 2012-10-11 13:43:50.755590 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7472> 2012-10-11 13:43:50.755597 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7471> 2012-10-11 13:43:50.755619 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1483, time: 2012-10-11 13:43:50.755619, event: done, request: osd pg remove(epoch 7; pg2.86; ) v1 -7470> 2012-10-11 13:43:50.755636 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 101489) -7469> 2012-10-11 13:43:50.755645 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 903 ==== pg_info(1 pgs e6:2.c5) v3 ==== 471+0+0 (3406672884 0 0) 0x206d000 con 0x2fe2140 -7468> 2012-10-11 13:43:50.755660 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1484, time: 2012-10-11 13:43:48.982337, event: header_read, request: pg_info(1 pgs e6:2.c5) v3 -7467> 2012-10-11 13:43:50.755671 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1484, time: 2012-10-11 13:43:48.982341, event: throttled, request: pg_info(1 pgs e6:2.c5) v3 -7466> 2012-10-11 13:43:50.755681 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1484, time: 2012-10-11 13:43:48.982349, event: all_read, request: pg_info(1 pgs e6:2.c5) v3 -7465> 2012-10-11 13:43:50.755691 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1484, time: 2012-10-11 13:43:50.755658, event: dispatched, request: pg_info(1 pgs e6:2.c5) v3 -7464> 2012-10-11 13:43:50.755701 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1484, time: 2012-10-11 13:43:50.755701, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.c5) v3 -7463> 2012-10-11 13:43:50.755713 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1484, time: 2012-10-11 13:43:50.755713, event: started, request: pg_info(1 pgs e6:2.c5) v3 -7462> 2012-10-11 13:43:50.755732 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1484, time: 2012-10-11 13:43:50.755732, event: done, request: pg_info(1 pgs e6:2.c5) v3 -7461> 2012-10-11 13:43:50.755745 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 101018) -7460> 2012-10-11 13:43:50.755753 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 559 ==== osd pg remove(epoch 7; pg2.79; ) v1 ==== 25+0+0 (1451087030 0 0) 0x311c000 con 0x2fe2280 -7459> 2012-10-11 13:43:50.755768 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1485, time: 2012-10-11 13:43:50.044789, event: header_read, request: osd pg remove(epoch 7; pg2.79; ) v1 -7458> 2012-10-11 13:43:50.755779 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1485, time: 2012-10-11 13:43:50.044796, event: throttled, request: osd pg remove(epoch 7; pg2.79; ) v1 -7457> 2012-10-11 13:43:50.755789 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1485, time: 2012-10-11 13:43:50.044801, event: all_read, request: osd pg remove(epoch 7; pg2.79; ) v1 -7456> 2012-10-11 13:43:50.755800 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1485, time: 2012-10-11 13:43:50.755766, event: dispatched, request: osd pg remove(epoch 7; pg2.79; ) v1 -7455> 2012-10-11 13:43:50.755810 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1485, time: 2012-10-11 13:43:50.755810, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.79; ) v1 -7454> 2012-10-11 13:43:50.755822 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1485, time: 2012-10-11 13:43:50.755822, event: started, request: osd pg remove(epoch 7; pg2.79; ) v1 -7453> 2012-10-11 13:43:50.755832 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.79 -7452> 2012-10-11 13:43:50.755852 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.79 0x21308e0)/0x21308e0 -7451> 2012-10-11 13:43:50.755861 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7450> 2012-10-11 13:43:50.755868 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7449> 2012-10-11 13:43:50.755875 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4111 0x2062cf0 -7448> 2012-10-11 13:43:50.755884 7f440532f700 5 journal submit_entry seq 4111 len 205 (0x3339e10) -7447> 2012-10-11 13:43:50.755892 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7446> 2012-10-11 13:43:50.755898 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7445> 2012-10-11 13:43:50.755920 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1485, time: 2012-10-11 13:43:50.755919, event: done, request: osd pg remove(epoch 7; pg2.79; ) v1 -7444> 2012-10-11 13:43:50.755935 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 100993) -7443> 2012-10-11 13:43:50.755944 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 904 ==== pg_info(1 pgs e6:1.c6) v3 ==== 471+0+0 (830057380 0 0) 0x309ee00 con 0x2fe2140 -7442> 2012-10-11 13:43:50.755959 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1486, time: 2012-10-11 13:43:48.982351, event: header_read, request: pg_info(1 pgs e6:1.c6) v3 -7441> 2012-10-11 13:43:50.755970 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1486, time: 2012-10-11 13:43:48.982354, event: throttled, request: pg_info(1 pgs e6:1.c6) v3 -7440> 2012-10-11 13:43:50.755980 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1486, time: 2012-10-11 13:43:48.982362, event: all_read, request: pg_info(1 pgs e6:1.c6) v3 -7439> 2012-10-11 13:43:50.755991 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1486, time: 2012-10-11 13:43:50.755957, event: dispatched, request: pg_info(1 pgs e6:1.c6) v3 -7438> 2012-10-11 13:43:50.756003 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1486, time: 2012-10-11 13:43:50.756003, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.c6) v3 -7437> 2012-10-11 13:43:50.756015 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1486, time: 2012-10-11 13:43:50.756015, event: started, request: pg_info(1 pgs e6:1.c6) v3 -7436> 2012-10-11 13:43:50.756034 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1486, time: 2012-10-11 13:43:50.756034, event: done, request: pg_info(1 pgs e6:1.c6) v3 -7435> 2012-10-11 13:43:50.756047 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 100522) -7434> 2012-10-11 13:43:50.756055 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 560 ==== osd pg remove(epoch 7; pg2.90; ) v1 ==== 25+0+0 (2122028420 0 0) 0x311c1c0 con 0x2fe2280 -7433> 2012-10-11 13:43:50.756070 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1487, time: 2012-10-11 13:43:50.044839, event: header_read, request: osd pg remove(epoch 7; pg2.90; ) v1 -7432> 2012-10-11 13:43:50.756081 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1487, time: 2012-10-11 13:43:50.044847, event: throttled, request: osd pg remove(epoch 7; pg2.90; ) v1 -7431> 2012-10-11 13:43:50.756091 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1487, time: 2012-10-11 13:43:50.044852, event: all_read, request: osd pg remove(epoch 7; pg2.90; ) v1 -7430> 2012-10-11 13:43:50.756102 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1487, time: 2012-10-11 13:43:50.756068, event: dispatched, request: osd pg remove(epoch 7; pg2.90; ) v1 -7429> 2012-10-11 13:43:50.756113 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1487, time: 2012-10-11 13:43:50.756113, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.90; ) v1 -7428> 2012-10-11 13:43:50.756125 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1487, time: 2012-10-11 13:43:50.756125, event: started, request: osd pg remove(epoch 7; pg2.90; ) v1 -7427> 2012-10-11 13:43:50.756135 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.90 -7426> 2012-10-11 13:43:50.756155 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.90 0x2130b50)/0x2130b50 -7425> 2012-10-11 13:43:50.756164 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7424> 2012-10-11 13:43:50.756171 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7423> 2012-10-11 13:43:50.756178 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4112 0x2062b40 -7422> 2012-10-11 13:43:50.756187 7f440532f700 5 journal submit_entry seq 4112 len 205 (0x331ba20) -7421> 2012-10-11 13:43:50.756195 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7420> 2012-10-11 13:43:50.756202 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7419> 2012-10-11 13:43:50.756222 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1487, time: 2012-10-11 13:43:50.756222, event: done, request: osd pg remove(epoch 7; pg2.90; ) v1 -7418> 2012-10-11 13:43:50.756238 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 100497) -7417> 2012-10-11 13:43:50.756247 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 905 ==== pg_info(1 pgs e6:0.c7) v3 ==== 471+0+0 (829735399 0 0) 0x309ec40 con 0x2fe2140 -7416> 2012-10-11 13:43:50.756262 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1488, time: 2012-10-11 13:43:48.982365, event: header_read, request: pg_info(1 pgs e6:0.c7) v3 -7415> 2012-10-11 13:43:50.756273 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1488, time: 2012-10-11 13:43:48.982367, event: throttled, request: pg_info(1 pgs e6:0.c7) v3 -7414> 2012-10-11 13:43:50.756283 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1488, time: 2012-10-11 13:43:48.982374, event: all_read, request: pg_info(1 pgs e6:0.c7) v3 -7413> 2012-10-11 13:43:50.756293 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1488, time: 2012-10-11 13:43:50.756261, event: dispatched, request: pg_info(1 pgs e6:0.c7) v3 -7412> 2012-10-11 13:43:50.756304 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1488, time: 2012-10-11 13:43:50.756304, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.c7) v3 -7411> 2012-10-11 13:43:50.756316 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1488, time: 2012-10-11 13:43:50.756316, event: started, request: pg_info(1 pgs e6:0.c7) v3 -7410> 2012-10-11 13:43:50.756334 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1488, time: 2012-10-11 13:43:50.756334, event: done, request: pg_info(1 pgs e6:0.c7) v3 -7409> 2012-10-11 13:43:50.756347 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 100026) -7408> 2012-10-11 13:43:50.756355 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 561 ==== osd pg remove(epoch 7; pg2.91; ) v1 ==== 25+0+0 (927459491 0 0) 0x311c380 con 0x2fe2280 -7407> 2012-10-11 13:43:50.756370 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1489, time: 2012-10-11 13:43:50.044891, event: header_read, request: osd pg remove(epoch 7; pg2.91; ) v1 -7406> 2012-10-11 13:43:50.756381 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1489, time: 2012-10-11 13:43:50.044898, event: throttled, request: osd pg remove(epoch 7; pg2.91; ) v1 -7405> 2012-10-11 13:43:50.756392 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1489, time: 2012-10-11 13:43:50.044903, event: all_read, request: osd pg remove(epoch 7; pg2.91; ) v1 -7404> 2012-10-11 13:43:50.756402 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1489, time: 2012-10-11 13:43:50.756369, event: dispatched, request: osd pg remove(epoch 7; pg2.91; ) v1 -7403> 2012-10-11 13:43:50.756412 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1489, time: 2012-10-11 13:43:50.756412, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.91; ) v1 -7402> 2012-10-11 13:43:50.756424 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1489, time: 2012-10-11 13:43:50.756424, event: started, request: osd pg remove(epoch 7; pg2.91; ) v1 -7401> 2012-10-11 13:43:50.756434 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.91 -7400> 2012-10-11 13:43:50.756453 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.91 0x2130bf0)/0x2130bf0 -7399> 2012-10-11 13:43:50.756462 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7398> 2012-10-11 13:43:50.756469 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7397> 2012-10-11 13:43:50.756476 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4113 0x2062000 -7396> 2012-10-11 13:43:50.756485 7f440532f700 5 journal submit_entry seq 4113 len 205 (0x23e9d20) -7395> 2012-10-11 13:43:50.756493 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7394> 2012-10-11 13:43:50.756500 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7393> 2012-10-11 13:43:50.756520 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1489, time: 2012-10-11 13:43:50.756520, event: done, request: osd pg remove(epoch 7; pg2.91; ) v1 -7392> 2012-10-11 13:43:50.756536 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 100001) -7391> 2012-10-11 13:43:50.756544 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 906 ==== pg_info(1 pgs e6:1.c7) v3 ==== 471+0+0 (3648320388 0 0) 0x309ea80 con 0x2fe2140 -7390> 2012-10-11 13:43:50.756560 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1490, time: 2012-10-11 13:43:49.140143, event: header_read, request: pg_info(1 pgs e6:1.c7) v3 -7389> 2012-10-11 13:43:50.756571 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1490, time: 2012-10-11 13:43:49.140155, event: throttled, request: pg_info(1 pgs e6:1.c7) v3 -7388> 2012-10-11 13:43:50.756581 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1490, time: 2012-10-11 13:43:49.140170, event: all_read, request: pg_info(1 pgs e6:1.c7) v3 -7387> 2012-10-11 13:43:50.756592 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1490, time: 2012-10-11 13:43:50.756559, event: dispatched, request: pg_info(1 pgs e6:1.c7) v3 -7386> 2012-10-11 13:43:50.756602 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1490, time: 2012-10-11 13:43:50.756602, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.c7) v3 -7385> 2012-10-11 13:43:50.756614 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1490, time: 2012-10-11 13:43:50.756614, event: started, request: pg_info(1 pgs e6:1.c7) v3 -7384> 2012-10-11 13:43:50.756633 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1490, time: 2012-10-11 13:43:50.756633, event: done, request: pg_info(1 pgs e6:1.c7) v3 -7383> 2012-10-11 13:43:50.756647 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 99530) -7382> 2012-10-11 13:43:50.756655 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 562 ==== osd pg remove(epoch 7; pg2.8f; ) v1 ==== 25+0+0 (1114611182 0 0) 0x311c540 con 0x2fe2280 -7381> 2012-10-11 13:43:50.756670 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1491, time: 2012-10-11 13:43:50.044944, event: header_read, request: osd pg remove(epoch 7; pg2.8f; ) v1 -7380> 2012-10-11 13:43:50.756681 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1491, time: 2012-10-11 13:43:50.044951, event: throttled, request: osd pg remove(epoch 7; pg2.8f; ) v1 -7379> 2012-10-11 13:43:50.756692 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1491, time: 2012-10-11 13:43:50.044957, event: all_read, request: osd pg remove(epoch 7; pg2.8f; ) v1 -7378> 2012-10-11 13:43:50.756702 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1491, time: 2012-10-11 13:43:50.756669, event: dispatched, request: osd pg remove(epoch 7; pg2.8f; ) v1 -7377> 2012-10-11 13:43:50.756712 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1491, time: 2012-10-11 13:43:50.756712, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.8f; ) v1 -7376> 2012-10-11 13:43:50.756724 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1491, time: 2012-10-11 13:43:50.756724, event: started, request: osd pg remove(epoch 7; pg2.8f; ) v1 -7375> 2012-10-11 13:43:50.756735 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.8f -7374> 2012-10-11 13:43:50.756754 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.8f 0x2130b90)/0x2130b90 -7373> 2012-10-11 13:43:50.756764 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7372> 2012-10-11 13:43:50.756770 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7371> 2012-10-11 13:43:50.756777 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4114 0x20621b0 -7370> 2012-10-11 13:43:50.756786 7f440532f700 5 journal submit_entry seq 4114 len 205 (0x338e570) -7369> 2012-10-11 13:43:50.756794 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7368> 2012-10-11 13:43:50.756801 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7367> 2012-10-11 13:43:50.756822 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1491, time: 2012-10-11 13:43:50.756821, event: done, request: osd pg remove(epoch 7; pg2.8f; ) v1 -7366> 2012-10-11 13:43:50.756838 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 99505) -7365> 2012-10-11 13:43:50.756847 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 907 ==== pg_info(1 pgs e6:2.c6) v3 ==== 471+0+0 (1710803474 0 0) 0x309e8c0 con 0x2fe2140 -7364> 2012-10-11 13:43:50.756862 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1492, time: 2012-10-11 13:43:49.140177, event: header_read, request: pg_info(1 pgs e6:2.c6) v3 -7363> 2012-10-11 13:43:50.756873 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1492, time: 2012-10-11 13:43:49.140182, event: throttled, request: pg_info(1 pgs e6:2.c6) v3 -7362> 2012-10-11 13:43:50.756883 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1492, time: 2012-10-11 13:43:49.140191, event: all_read, request: pg_info(1 pgs e6:2.c6) v3 -7361> 2012-10-11 13:43:50.756894 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1492, time: 2012-10-11 13:43:50.756860, event: dispatched, request: pg_info(1 pgs e6:2.c6) v3 -7360> 2012-10-11 13:43:50.756904 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1492, time: 2012-10-11 13:43:50.756904, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.c6) v3 -7359> 2012-10-11 13:43:50.756915 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1492, time: 2012-10-11 13:43:50.756915, event: started, request: pg_info(1 pgs e6:2.c6) v3 -7358> 2012-10-11 13:43:50.756934 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1492, time: 2012-10-11 13:43:50.756934, event: done, request: pg_info(1 pgs e6:2.c6) v3 -7357> 2012-10-11 13:43:50.756948 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 99034) -7356> 2012-10-11 13:43:50.756956 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 563 ==== osd pg remove(epoch 7; pg2.8e; ) v1 ==== 25+0+0 (190046409 0 0) 0x311c700 con 0x2fe2280 -7355> 2012-10-11 13:43:50.756971 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1493, time: 2012-10-11 13:43:50.044995, event: header_read, request: osd pg remove(epoch 7; pg2.8e; ) v1 -7354> 2012-10-11 13:43:50.756982 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1493, time: 2012-10-11 13:43:50.045003, event: throttled, request: osd pg remove(epoch 7; pg2.8e; ) v1 -7353> 2012-10-11 13:43:50.756993 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1493, time: 2012-10-11 13:43:50.045008, event: all_read, request: osd pg remove(epoch 7; pg2.8e; ) v1 -7352> 2012-10-11 13:43:50.757003 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1493, time: 2012-10-11 13:43:50.756969, event: dispatched, request: osd pg remove(epoch 7; pg2.8e; ) v1 -7351> 2012-10-11 13:43:50.757014 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1493, time: 2012-10-11 13:43:50.757014, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.8e; ) v1 -7350> 2012-10-11 13:43:50.757025 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1493, time: 2012-10-11 13:43:50.757025, event: started, request: osd pg remove(epoch 7; pg2.8e; ) v1 -7349> 2012-10-11 13:43:50.757035 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.8e -7348> 2012-10-11 13:43:50.757054 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.8e 0x2130e70)/0x2130e70 -7347> 2012-10-11 13:43:50.757064 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7346> 2012-10-11 13:43:50.757071 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7345> 2012-10-11 13:43:50.757078 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4115 0x2d176c0 -7344> 2012-10-11 13:43:50.757086 7f440532f700 5 journal submit_entry seq 4115 len 205 (0x23e9ed0) -7343> 2012-10-11 13:43:50.757095 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7342> 2012-10-11 13:43:50.757102 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7341> 2012-10-11 13:43:50.757128 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1493, time: 2012-10-11 13:43:50.757128, event: done, request: osd pg remove(epoch 7; pg2.8e; ) v1 -7340> 2012-10-11 13:43:50.757149 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 99009) -7339> 2012-10-11 13:43:50.757157 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 908 ==== pg_info(1 pgs e6:2.bd) v3 ==== 471+0+0 (2086020362 0 0) 0x309e700 con 0x2fe2140 -7338> 2012-10-11 13:43:50.757173 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1494, time: 2012-10-11 13:43:49.140194, event: header_read, request: pg_info(1 pgs e6:2.bd) v3 -7337> 2012-10-11 13:43:50.757184 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1494, time: 2012-10-11 13:43:49.140198, event: throttled, request: pg_info(1 pgs e6:2.bd) v3 -7336> 2012-10-11 13:43:50.757194 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1494, time: 2012-10-11 13:43:49.140207, event: all_read, request: pg_info(1 pgs e6:2.bd) v3 -7335> 2012-10-11 13:43:50.757204 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1494, time: 2012-10-11 13:43:50.757171, event: dispatched, request: pg_info(1 pgs e6:2.bd) v3 -7334> 2012-10-11 13:43:50.757215 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1494, time: 2012-10-11 13:43:50.757215, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.bd) v3 -7333> 2012-10-11 13:43:50.757227 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1494, time: 2012-10-11 13:43:50.757227, event: started, request: pg_info(1 pgs e6:2.bd) v3 -7332> 2012-10-11 13:43:50.757246 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1494, time: 2012-10-11 13:43:50.757246, event: done, request: pg_info(1 pgs e6:2.bd) v3 -7331> 2012-10-11 13:43:50.757267 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 98538) -7330> 2012-10-11 13:43:50.757276 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 564 ==== osd pg remove(epoch 7; pg0.45; ) v1 ==== 25+0+0 (1574523681 0 0) 0x3099a80 con 0x2fe2280 -7329> 2012-10-11 13:43:50.757290 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1495, time: 2012-10-11 13:43:50.045046, event: header_read, request: osd pg remove(epoch 7; pg0.45; ) v1 -7328> 2012-10-11 13:43:50.757301 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1495, time: 2012-10-11 13:43:50.045053, event: throttled, request: osd pg remove(epoch 7; pg0.45; ) v1 -7327> 2012-10-11 13:43:50.757312 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1495, time: 2012-10-11 13:43:50.045058, event: all_read, request: osd pg remove(epoch 7; pg0.45; ) v1 -7326> 2012-10-11 13:43:50.757322 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1495, time: 2012-10-11 13:43:50.757289, event: dispatched, request: osd pg remove(epoch 7; pg0.45; ) v1 -7325> 2012-10-11 13:43:50.757336 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1495, time: 2012-10-11 13:43:50.757336, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.45; ) v1 -7324> 2012-10-11 13:43:50.757348 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1495, time: 2012-10-11 13:43:50.757348, event: started, request: osd pg remove(epoch 7; pg0.45; ) v1 -7323> 2012-10-11 13:43:50.757358 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.45 -7322> 2012-10-11 13:43:50.757378 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.45 0x1d71fc0)/0x1d71fc0 -7321> 2012-10-11 13:43:50.757387 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7320> 2012-10-11 13:43:50.757394 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7319> 2012-10-11 13:43:50.757401 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4116 0x2d17c60 -7318> 2012-10-11 13:43:50.757410 7f440532f700 5 journal submit_entry seq 4116 len 205 (0x23e9690) -7317> 2012-10-11 13:43:50.757418 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7316> 2012-10-11 13:43:50.757425 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7315> 2012-10-11 13:43:50.757448 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1495, time: 2012-10-11 13:43:50.757447, event: done, request: osd pg remove(epoch 7; pg0.45; ) v1 -7314> 2012-10-11 13:43:50.757464 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98513) -7313> 2012-10-11 13:43:50.757472 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 909 ==== osd pg remove(epoch 7; pg1.b6; ) v1 ==== 25+0+0 (3555125453 0 0) 0x309e540 con 0x2fe2140 -7312> 2012-10-11 13:43:50.757488 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1496, time: 2012-10-11 13:43:49.140210, event: header_read, request: osd pg remove(epoch 7; pg1.b6; ) v1 -7311> 2012-10-11 13:43:50.757500 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1496, time: 2012-10-11 13:43:49.140214, event: throttled, request: osd pg remove(epoch 7; pg1.b6; ) v1 -7310> 2012-10-11 13:43:50.757510 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1496, time: 2012-10-11 13:43:49.140219, event: all_read, request: osd pg remove(epoch 7; pg1.b6; ) v1 -7309> 2012-10-11 13:43:50.757520 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1496, time: 2012-10-11 13:43:50.757486, event: dispatched, request: osd pg remove(epoch 7; pg1.b6; ) v1 -7308> 2012-10-11 13:43:50.757531 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1496, time: 2012-10-11 13:43:50.757531, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.b6; ) v1 -7307> 2012-10-11 13:43:50.757543 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1496, time: 2012-10-11 13:43:50.757542, event: started, request: osd pg remove(epoch 7; pg1.b6; ) v1 -7306> 2012-10-11 13:43:50.757553 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.b6 -7305> 2012-10-11 13:43:50.757575 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.b6 0x2e38580)/0x2e38580 -7304> 2012-10-11 13:43:50.757584 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7303> 2012-10-11 13:43:50.757591 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7302> 2012-10-11 13:43:50.757598 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4117 0x2a06f30 -7301> 2012-10-11 13:43:50.757606 7f440532f700 5 journal submit_entry seq 4117 len 205 (0x20ade70) -7300> 2012-10-11 13:43:50.757615 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7299> 2012-10-11 13:43:50.757621 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7298> 2012-10-11 13:43:50.757646 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1496, time: 2012-10-11 13:43:50.757646, event: done, request: osd pg remove(epoch 7; pg1.b6; ) v1 -7297> 2012-10-11 13:43:50.757662 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98488) -7296> 2012-10-11 13:43:50.757670 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 565 ==== osd pg remove(epoch 7; pg0.48; ) v1 ==== 25+0+0 (2009311409 0 0) 0x3099700 con 0x2fe2280 -7295> 2012-10-11 13:43:50.757686 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1497, time: 2012-10-11 13:43:50.045095, event: header_read, request: osd pg remove(epoch 7; pg0.48; ) v1 -7294> 2012-10-11 13:43:50.757697 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1497, time: 2012-10-11 13:43:50.045103, event: throttled, request: osd pg remove(epoch 7; pg0.48; ) v1 -7293> 2012-10-11 13:43:50.757707 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1497, time: 2012-10-11 13:43:50.045108, event: all_read, request: osd pg remove(epoch 7; pg0.48; ) v1 -7292> 2012-10-11 13:43:50.757718 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1497, time: 2012-10-11 13:43:50.757684, event: dispatched, request: osd pg remove(epoch 7; pg0.48; ) v1 -7291> 2012-10-11 13:43:50.757728 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1497, time: 2012-10-11 13:43:50.757728, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.48; ) v1 -7290> 2012-10-11 13:43:50.757740 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1497, time: 2012-10-11 13:43:50.757740, event: started, request: osd pg remove(epoch 7; pg0.48; ) v1 -7289> 2012-10-11 13:43:50.757750 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.48 -7288> 2012-10-11 13:43:50.757769 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.48 0x1d71f30)/0x1d71f30 -7287> 2012-10-11 13:43:50.757779 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7286> 2012-10-11 13:43:50.757786 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7285> 2012-10-11 13:43:50.757793 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4118 0x2a06cf0 -7284> 2012-10-11 13:43:50.757801 7f440532f700 5 journal submit_entry seq 4118 len 205 (0x2f0e480) -7283> 2012-10-11 13:43:50.757810 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7282> 2012-10-11 13:43:50.757816 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7281> 2012-10-11 13:43:50.757838 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1497, time: 2012-10-11 13:43:50.757837, event: done, request: osd pg remove(epoch 7; pg0.48; ) v1 -7280> 2012-10-11 13:43:50.757854 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98463) -7279> 2012-10-11 13:43:50.757864 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 910 ==== osd pg remove(epoch 7; pg1.b5; ) v1 ==== 25+0+0 (144863140 0 0) 0x309e380 con 0x2fe2140 -7278> 2012-10-11 13:43:50.757879 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1498, time: 2012-10-11 13:43:49.140221, event: header_read, request: osd pg remove(epoch 7; pg1.b5; ) v1 -7277> 2012-10-11 13:43:50.757890 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1498, time: 2012-10-11 13:43:49.140225, event: throttled, request: osd pg remove(epoch 7; pg1.b5; ) v1 -7276> 2012-10-11 13:43:50.757900 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1498, time: 2012-10-11 13:43:49.140228, event: all_read, request: osd pg remove(epoch 7; pg1.b5; ) v1 -7275> 2012-10-11 13:43:50.757911 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1498, time: 2012-10-11 13:43:50.757877, event: dispatched, request: osd pg remove(epoch 7; pg1.b5; ) v1 -7274> 2012-10-11 13:43:50.757921 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1498, time: 2012-10-11 13:43:50.757921, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.b5; ) v1 -7273> 2012-10-11 13:43:50.757933 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1498, time: 2012-10-11 13:43:50.757933, event: started, request: osd pg remove(epoch 7; pg1.b5; ) v1 -7272> 2012-10-11 13:43:50.757943 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.b5 -7271> 2012-10-11 13:43:50.757962 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.b5 0x2e385b0)/0x2e385b0 -7270> 2012-10-11 13:43:50.757972 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7269> 2012-10-11 13:43:50.757978 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7268> 2012-10-11 13:43:50.757986 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4119 0x2a06bd0 -7267> 2012-10-11 13:43:50.757994 7f440532f700 5 journal submit_entry seq 4119 len 205 (0x210b360) -7266> 2012-10-11 13:43:50.758002 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7265> 2012-10-11 13:43:50.758009 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7264> 2012-10-11 13:43:50.758029 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1498, time: 2012-10-11 13:43:50.758028, event: done, request: osd pg remove(epoch 7; pg1.b5; ) v1 -7263> 2012-10-11 13:43:50.758044 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98438) -7262> 2012-10-11 13:43:50.758053 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 566 ==== osd pg remove(epoch 7; pg0.47; ) v1 ==== 25+0+0 (3483478383 0 0) 0x30998c0 con 0x2fe2280 -7261> 2012-10-11 13:43:50.758068 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1499, time: 2012-10-11 13:43:50.045150, event: header_read, request: osd pg remove(epoch 7; pg0.47; ) v1 -7260> 2012-10-11 13:43:50.758079 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1499, time: 2012-10-11 13:43:50.045157, event: throttled, request: osd pg remove(epoch 7; pg0.47; ) v1 -7259> 2012-10-11 13:43:50.758090 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1499, time: 2012-10-11 13:43:50.045163, event: all_read, request: osd pg remove(epoch 7; pg0.47; ) v1 -7258> 2012-10-11 13:43:50.758100 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1499, time: 2012-10-11 13:43:50.758067, event: dispatched, request: osd pg remove(epoch 7; pg0.47; ) v1 -7257> 2012-10-11 13:43:50.758110 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1499, time: 2012-10-11 13:43:50.758110, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.47; ) v1 -7256> 2012-10-11 13:43:50.758122 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1499, time: 2012-10-11 13:43:50.758122, event: started, request: osd pg remove(epoch 7; pg0.47; ) v1 -7255> 2012-10-11 13:43:50.758132 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.47 -7254> 2012-10-11 13:43:50.758151 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.47 0x1d71f60)/0x1d71f60 -7253> 2012-10-11 13:43:50.758161 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7252> 2012-10-11 13:43:50.758168 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7251> 2012-10-11 13:43:50.758175 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4120 0x2a06ab0 -7250> 2012-10-11 13:43:50.758183 7f440532f700 5 journal submit_entry seq 4120 len 205 (0x2eb6c60) -7249> 2012-10-11 13:43:50.758191 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7248> 2012-10-11 13:43:50.758198 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7247> 2012-10-11 13:43:50.758218 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1499, time: 2012-10-11 13:43:50.758218, event: done, request: osd pg remove(epoch 7; pg0.47; ) v1 -7246> 2012-10-11 13:43:50.758234 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98413) -7245> 2012-10-11 13:43:50.758243 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 911 ==== osd pg remove(epoch 7; pg1.b2; ) v1 ==== 25+0+0 (4076563104 0 0) 0x309e1c0 con 0x2fe2140 -7244> 2012-10-11 13:43:50.758258 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1500, time: 2012-10-11 13:43:49.140231, event: header_read, request: osd pg remove(epoch 7; pg1.b2; ) v1 -7243> 2012-10-11 13:43:50.758269 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1500, time: 2012-10-11 13:43:49.140235, event: throttled, request: osd pg remove(epoch 7; pg1.b2; ) v1 -7242> 2012-10-11 13:43:50.758280 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1500, time: 2012-10-11 13:43:49.140239, event: all_read, request: osd pg remove(epoch 7; pg1.b2; ) v1 -7241> 2012-10-11 13:43:50.758290 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1500, time: 2012-10-11 13:43:50.758257, event: dispatched, request: osd pg remove(epoch 7; pg1.b2; ) v1 -7240> 2012-10-11 13:43:50.758300 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1500, time: 2012-10-11 13:43:50.758300, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.b2; ) v1 -7239> 2012-10-11 13:43:50.758312 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1500, time: 2012-10-11 13:43:50.758312, event: started, request: osd pg remove(epoch 7; pg1.b2; ) v1 -7238> 2012-10-11 13:43:50.758326 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.b2 -7237> 2012-10-11 13:43:50.758345 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.b2 0x2e38240)/0x2e38240 -7236> 2012-10-11 13:43:50.758355 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7235> 2012-10-11 13:43:50.758362 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7234> 2012-10-11 13:43:50.758369 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4121 0x2a06e10 -7233> 2012-10-11 13:43:50.758377 7f440532f700 5 journal submit_entry seq 4121 len 205 (0x210b510) -7232> 2012-10-11 13:43:50.758385 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7231> 2012-10-11 13:43:50.758392 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7230> 2012-10-11 13:43:50.758413 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1500, time: 2012-10-11 13:43:50.758413, event: done, request: osd pg remove(epoch 7; pg1.b2; ) v1 -7229> 2012-10-11 13:43:50.758429 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98388) -7228> 2012-10-11 13:43:50.758438 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 567 ==== osd pg remove(epoch 7; pg0.4c; ) v1 ==== 25+0+0 (1457400540 0 0) 0x2bbf380 con 0x2fe2280 -7227> 2012-10-11 13:43:50.758454 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1501, time: 2012-10-11 13:43:50.045200, event: header_read, request: osd pg remove(epoch 7; pg0.4c; ) v1 -7226> 2012-10-11 13:43:50.758465 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1501, time: 2012-10-11 13:43:50.045207, event: throttled, request: osd pg remove(epoch 7; pg0.4c; ) v1 -7225> 2012-10-11 13:43:50.758475 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1501, time: 2012-10-11 13:43:50.045212, event: all_read, request: osd pg remove(epoch 7; pg0.4c; ) v1 -7224> 2012-10-11 13:43:50.758486 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1501, time: 2012-10-11 13:43:50.758452, event: dispatched, request: osd pg remove(epoch 7; pg0.4c; ) v1 -7223> 2012-10-11 13:43:50.758496 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1501, time: 2012-10-11 13:43:50.758496, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.4c; ) v1 -7222> 2012-10-11 13:43:50.758508 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1501, time: 2012-10-11 13:43:50.758508, event: started, request: osd pg remove(epoch 7; pg0.4c; ) v1 -7221> 2012-10-11 13:43:50.758518 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.4c -7220> 2012-10-11 13:43:50.758537 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.4c 0x21300c0)/0x21300c0 -7219> 2012-10-11 13:43:50.758546 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7218> 2012-10-11 13:43:50.758553 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7217> 2012-10-11 13:43:50.758560 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4122 0x2a061b0 -7216> 2012-10-11 13:43:50.758569 7f440532f700 5 journal submit_entry seq 4122 len 205 (0x2eb6810) -7215> 2012-10-11 13:43:50.758577 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7214> 2012-10-11 13:43:50.758584 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7213> 2012-10-11 13:43:50.758605 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1501, time: 2012-10-11 13:43:50.758605, event: done, request: osd pg remove(epoch 7; pg0.4c; ) v1 -7212> 2012-10-11 13:43:50.758621 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98363) -7211> 2012-10-11 13:43:50.758629 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 912 ==== osd pg remove(epoch 7; pg1.a0; ) v1 ==== 25+0+0 (3841300826 0 0) 0x309e000 con 0x2fe2140 -7210> 2012-10-11 13:43:50.758645 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1502, time: 2012-10-11 13:43:49.140241, event: header_read, request: osd pg remove(epoch 7; pg1.a0; ) v1 -7209> 2012-10-11 13:43:50.758656 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1502, time: 2012-10-11 13:43:49.140244, event: throttled, request: osd pg remove(epoch 7; pg1.a0; ) v1 -7208> 2012-10-11 13:43:50.758666 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1502, time: 2012-10-11 13:43:49.140248, event: all_read, request: osd pg remove(epoch 7; pg1.a0; ) v1 -7207> 2012-10-11 13:43:50.758676 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1502, time: 2012-10-11 13:43:50.758643, event: dispatched, request: osd pg remove(epoch 7; pg1.a0; ) v1 -7206> 2012-10-11 13:43:50.758687 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1502, time: 2012-10-11 13:43:50.758687, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.a0; ) v1 -7205> 2012-10-11 13:43:50.758698 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1502, time: 2012-10-11 13:43:50.758698, event: started, request: osd pg remove(epoch 7; pg1.a0; ) v1 -7204> 2012-10-11 13:43:50.758709 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.a0 -7203> 2012-10-11 13:43:50.758728 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.a0 0x2e381a0)/0x2e381a0 -7202> 2012-10-11 13:43:50.758738 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7201> 2012-10-11 13:43:50.758744 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7200> 2012-10-11 13:43:50.758752 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4123 0x2a06360 -7199> 2012-10-11 13:43:50.758760 7f440532f700 5 journal submit_entry seq 4123 len 205 (0x210b8a0) -7198> 2012-10-11 13:43:50.758768 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7197> 2012-10-11 13:43:50.758775 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7196> 2012-10-11 13:43:50.758800 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1502, time: 2012-10-11 13:43:50.758800, event: done, request: osd pg remove(epoch 7; pg1.a0; ) v1 -7195> 2012-10-11 13:43:50.758817 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98338) -7194> 2012-10-11 13:43:50.758825 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 568 ==== osd pg remove(epoch 7; pg0.49; ) v1 ==== 25+0+0 (1056953750 0 0) 0x2bbf000 con 0x2fe2280 -7193> 2012-10-11 13:43:50.758842 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1503, time: 2012-10-11 13:43:50.045259, event: header_read, request: osd pg remove(epoch 7; pg0.49; ) v1 -7192> 2012-10-11 13:43:50.758853 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1503, time: 2012-10-11 13:43:50.045267, event: throttled, request: osd pg remove(epoch 7; pg0.49; ) v1 -7191> 2012-10-11 13:43:50.758864 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1503, time: 2012-10-11 13:43:50.045272, event: all_read, request: osd pg remove(epoch 7; pg0.49; ) v1 -7190> 2012-10-11 13:43:50.758874 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1503, time: 2012-10-11 13:43:50.758841, event: dispatched, request: osd pg remove(epoch 7; pg0.49; ) v1 -7189> 2012-10-11 13:43:50.758884 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1503, time: 2012-10-11 13:43:50.758884, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.49; ) v1 -7188> 2012-10-11 13:43:50.758896 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1503, time: 2012-10-11 13:43:50.758896, event: started, request: osd pg remove(epoch 7; pg0.49; ) v1 -7187> 2012-10-11 13:43:50.758906 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.49 -7186> 2012-10-11 13:43:50.758925 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.49 0x2130150)/0x2130150 -7185> 2012-10-11 13:43:50.758935 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7184> 2012-10-11 13:43:50.758941 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7183> 2012-10-11 13:43:50.758948 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4124 0x2a065a0 -7182> 2012-10-11 13:43:50.758957 7f440532f700 5 journal submit_entry seq 4124 len 205 (0x2e139f0) -7181> 2012-10-11 13:43:50.758965 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7180> 2012-10-11 13:43:50.758972 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7179> 2012-10-11 13:43:50.758994 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1503, time: 2012-10-11 13:43:50.758994, event: done, request: osd pg remove(epoch 7; pg0.49; ) v1 -7178> 2012-10-11 13:43:50.759010 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98313) -7177> 2012-10-11 13:43:50.759019 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 913 ==== pg_info(1 pgs e6:0.d) v3 ==== 471+0+0 (155108500 0 0) 0x20b0700 con 0x2fe2140 -7176> 2012-10-11 13:43:50.759034 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1504, time: 2012-10-11 13:43:49.140250, event: header_read, request: pg_info(1 pgs e6:0.d) v3 -7175> 2012-10-11 13:43:50.759045 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1504, time: 2012-10-11 13:43:49.140254, event: throttled, request: pg_info(1 pgs e6:0.d) v3 -7174> 2012-10-11 13:43:50.759055 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1504, time: 2012-10-11 13:43:49.140276, event: all_read, request: pg_info(1 pgs e6:0.d) v3 -7173> 2012-10-11 13:43:50.759065 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1504, time: 2012-10-11 13:43:50.759033, event: dispatched, request: pg_info(1 pgs e6:0.d) v3 -7172> 2012-10-11 13:43:50.759075 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1504, time: 2012-10-11 13:43:50.759075, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.d) v3 -7171> 2012-10-11 13:43:50.759087 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1504, time: 2012-10-11 13:43:50.759087, event: started, request: pg_info(1 pgs e6:0.d) v3 -7170> 2012-10-11 13:43:50.759106 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1504, time: 2012-10-11 13:43:50.759106, event: done, request: pg_info(1 pgs e6:0.d) v3 -7169> 2012-10-11 13:43:50.759119 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 97842) -7168> 2012-10-11 13:43:50.759127 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 569 ==== osd pg remove(epoch 7; pg0.52; ) v1 ==== 25+0+0 (603348881 0 0) 0x232b540 con 0x2fe2280 -7167> 2012-10-11 13:43:50.759142 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1505, time: 2012-10-11 13:43:50.045312, event: header_read, request: osd pg remove(epoch 7; pg0.52; ) v1 -7166> 2012-10-11 13:43:50.759153 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1505, time: 2012-10-11 13:43:50.045320, event: throttled, request: osd pg remove(epoch 7; pg0.52; ) v1 -7165> 2012-10-11 13:43:50.759163 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1505, time: 2012-10-11 13:43:50.045326, event: all_read, request: osd pg remove(epoch 7; pg0.52; ) v1 -7164> 2012-10-11 13:43:50.759173 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1505, time: 2012-10-11 13:43:50.759140, event: dispatched, request: osd pg remove(epoch 7; pg0.52; ) v1 -7163> 2012-10-11 13:43:50.759184 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1505, time: 2012-10-11 13:43:50.759184, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.52; ) v1 -7162> 2012-10-11 13:43:50.759195 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1505, time: 2012-10-11 13:43:50.759195, event: started, request: osd pg remove(epoch 7; pg0.52; ) v1 -7161> 2012-10-11 13:43:50.759208 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.52 -7160> 2012-10-11 13:43:50.759227 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.52 0x2130270)/0x2130270 -7159> 2012-10-11 13:43:50.759237 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7158> 2012-10-11 13:43:50.759243 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7157> 2012-10-11 13:43:50.759250 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4125 0x2a062d0 -7156> 2012-10-11 13:43:50.759259 7f440532f700 5 journal submit_entry seq 4125 len 205 (0x210b1b0) -7155> 2012-10-11 13:43:50.759267 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7154> 2012-10-11 13:43:50.759273 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7153> 2012-10-11 13:43:50.759296 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1505, time: 2012-10-11 13:43:50.759296, event: done, request: osd pg remove(epoch 7; pg0.52; ) v1 -7152> 2012-10-11 13:43:50.759312 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 97817) -7151> 2012-10-11 13:43:50.759321 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 914 ==== pg_info(1 pgs e6:1.c) v3 ==== 471+0+0 (181155183 0 0) 0x20b0540 con 0x2fe2140 -7150> 2012-10-11 13:43:50.759337 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1506, time: 2012-10-11 13:43:49.140280, event: header_read, request: pg_info(1 pgs e6:1.c) v3 -7149> 2012-10-11 13:43:50.759349 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1506, time: 2012-10-11 13:43:49.140285, event: throttled, request: pg_info(1 pgs e6:1.c) v3 -7148> 2012-10-11 13:43:50.759359 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1506, time: 2012-10-11 13:43:49.140294, event: all_read, request: pg_info(1 pgs e6:1.c) v3 -7147> 2012-10-11 13:43:50.759369 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1506, time: 2012-10-11 13:43:50.759335, event: dispatched, request: pg_info(1 pgs e6:1.c) v3 -7146> 2012-10-11 13:43:50.759380 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1506, time: 2012-10-11 13:43:50.759380, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.c) v3 -7145> 2012-10-11 13:43:50.759392 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1506, time: 2012-10-11 13:43:50.759391, event: started, request: pg_info(1 pgs e6:1.c) v3 -7144> 2012-10-11 13:43:50.759410 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1506, time: 2012-10-11 13:43:50.759410, event: done, request: pg_info(1 pgs e6:1.c) v3 -7143> 2012-10-11 13:43:50.759423 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 97346) -7142> 2012-10-11 13:43:50.759431 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 570 ==== osd pg remove(epoch 7; pg0.5a; ) v1 ==== 25+0+0 (1640848203 0 0) 0x232b700 con 0x2fe2280 -7141> 2012-10-11 13:43:50.759446 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1507, time: 2012-10-11 13:43:50.045364, event: header_read, request: osd pg remove(epoch 7; pg0.5a; ) v1 -7140> 2012-10-11 13:43:50.759457 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1507, time: 2012-10-11 13:43:50.045372, event: throttled, request: osd pg remove(epoch 7; pg0.5a; ) v1 -7139> 2012-10-11 13:43:50.759468 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1507, time: 2012-10-11 13:43:50.045377, event: all_read, request: osd pg remove(epoch 7; pg0.5a; ) v1 -7138> 2012-10-11 13:43:50.759478 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1507, time: 2012-10-11 13:43:50.759444, event: dispatched, request: osd pg remove(epoch 7; pg0.5a; ) v1 -7137> 2012-10-11 13:43:50.759489 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1507, time: 2012-10-11 13:43:50.759489, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.5a; ) v1 -7136> 2012-10-11 13:43:50.759500 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1507, time: 2012-10-11 13:43:50.759500, event: started, request: osd pg remove(epoch 7; pg0.5a; ) v1 -7135> 2012-10-11 13:43:50.759510 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.5a -7134> 2012-10-11 13:43:50.759530 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.5a 0x21303e0)/0x21303e0 -7133> 2012-10-11 13:43:50.759539 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7132> 2012-10-11 13:43:50.759546 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7131> 2012-10-11 13:43:50.759553 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4126 0x2a06090 -7130> 2012-10-11 13:43:50.759562 7f440532f700 5 journal submit_entry seq 4126 len 205 (0x2165270) -7129> 2012-10-11 13:43:50.759570 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7128> 2012-10-11 13:43:50.759577 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7127> 2012-10-11 13:43:50.759597 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1507, time: 2012-10-11 13:43:50.759597, event: done, request: osd pg remove(epoch 7; pg0.5a; ) v1 -7126> 2012-10-11 13:43:50.759613 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 97321) -7125> 2012-10-11 13:43:50.759622 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 915 ==== pg_info(1 pgs e6:2.b) v3 ==== 471+0+0 (3422960530 0 0) 0x2229e00 con 0x2fe2140 -7124> 2012-10-11 13:43:50.759637 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1508, time: 2012-10-11 13:43:49.140296, event: header_read, request: pg_info(1 pgs e6:2.b) v3 -7123> 2012-10-11 13:43:50.759648 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1508, time: 2012-10-11 13:43:49.140300, event: throttled, request: pg_info(1 pgs e6:2.b) v3 -7122> 2012-10-11 13:43:50.759659 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1508, time: 2012-10-11 13:43:49.140309, event: all_read, request: pg_info(1 pgs e6:2.b) v3 -7121> 2012-10-11 13:43:50.759669 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1508, time: 2012-10-11 13:43:50.759636, event: dispatched, request: pg_info(1 pgs e6:2.b) v3 -7120> 2012-10-11 13:43:50.759679 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1508, time: 2012-10-11 13:43:50.759679, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.b) v3 -7119> 2012-10-11 13:43:50.759691 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1508, time: 2012-10-11 13:43:50.759691, event: started, request: pg_info(1 pgs e6:2.b) v3 -7118> 2012-10-11 13:43:50.759710 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1508, time: 2012-10-11 13:43:50.759710, event: done, request: pg_info(1 pgs e6:2.b) v3 -7117> 2012-10-11 13:43:50.759724 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 96850) -7116> 2012-10-11 13:43:50.759733 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 571 ==== osd pg remove(epoch 7; pg0.5b; ) v1 ==== 25+0+0 (686892652 0 0) 0x1e3b1c0 con 0x2fe2280 -7115> 2012-10-11 13:43:50.759748 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1509, time: 2012-10-11 13:43:50.045414, event: header_read, request: osd pg remove(epoch 7; pg0.5b; ) v1 -7114> 2012-10-11 13:43:50.759759 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1509, time: 2012-10-11 13:43:50.045422, event: throttled, request: osd pg remove(epoch 7; pg0.5b; ) v1 -7113> 2012-10-11 13:43:50.759770 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1509, time: 2012-10-11 13:43:50.045427, event: all_read, request: osd pg remove(epoch 7; pg0.5b; ) v1 -7112> 2012-10-11 13:43:50.759781 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1509, time: 2012-10-11 13:43:50.759746, event: dispatched, request: osd pg remove(epoch 7; pg0.5b; ) v1 -7111> 2012-10-11 13:43:50.759791 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1509, time: 2012-10-11 13:43:50.759791, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.5b; ) v1 -7110> 2012-10-11 13:43:50.759803 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1509, time: 2012-10-11 13:43:50.759803, event: started, request: osd pg remove(epoch 7; pg0.5b; ) v1 -7109> 2012-10-11 13:43:50.759814 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.5b -7108> 2012-10-11 13:43:50.759834 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.5b 0x21303b0)/0x21303b0 -7107> 2012-10-11 13:43:50.759843 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7106> 2012-10-11 13:43:50.759850 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7105> 2012-10-11 13:43:50.759857 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4127 0x2a06510 -7104> 2012-10-11 13:43:50.759866 7f440532f700 5 journal submit_entry seq 4127 len 205 (0x21c74e0) -7103> 2012-10-11 13:43:50.759874 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7102> 2012-10-11 13:43:50.759881 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7101> 2012-10-11 13:43:50.759904 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1509, time: 2012-10-11 13:43:50.759904, event: done, request: osd pg remove(epoch 7; pg0.5b; ) v1 -7100> 2012-10-11 13:43:50.759920 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 96825) -7099> 2012-10-11 13:43:50.759929 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 916 ==== pg_info(1 pgs e6:1.4) v3 ==== 471+0+0 (1347082235 0 0) 0x2229c40 con 0x2fe2140 -7098> 2012-10-11 13:43:50.759945 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1510, time: 2012-10-11 13:43:49.140312, event: header_read, request: pg_info(1 pgs e6:1.4) v3 -7097> 2012-10-11 13:43:50.759956 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1510, time: 2012-10-11 13:43:49.140316, event: throttled, request: pg_info(1 pgs e6:1.4) v3 -7096> 2012-10-11 13:43:50.759966 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1510, time: 2012-10-11 13:43:49.140324, event: all_read, request: pg_info(1 pgs e6:1.4) v3 -7095> 2012-10-11 13:43:50.759977 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1510, time: 2012-10-11 13:43:50.759943, event: dispatched, request: pg_info(1 pgs e6:1.4) v3 -7094> 2012-10-11 13:43:50.759988 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1510, time: 2012-10-11 13:43:50.759988, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.4) v3 -7093> 2012-10-11 13:43:50.759999 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1510, time: 2012-10-11 13:43:50.759999, event: started, request: pg_info(1 pgs e6:1.4) v3 -7092> 2012-10-11 13:43:50.760019 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1510, time: 2012-10-11 13:43:50.760019, event: done, request: pg_info(1 pgs e6:1.4) v3 -7091> 2012-10-11 13:43:50.760032 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 96354) -7090> 2012-10-11 13:43:50.760041 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 572 ==== osd pg remove(epoch 7; pg0.60; ) v1 ==== 25+0+0 (955828722 0 0) 0x2b878c0 con 0x2fe2280 -7089> 2012-10-11 13:43:50.760056 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1511, time: 2012-10-11 13:43:50.045464, event: header_read, request: osd pg remove(epoch 7; pg0.60; ) v1 -7088> 2012-10-11 13:43:50.760067 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1511, time: 2012-10-11 13:43:50.045472, event: throttled, request: osd pg remove(epoch 7; pg0.60; ) v1 -7087> 2012-10-11 13:43:50.760078 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1511, time: 2012-10-11 13:43:50.045477, event: all_read, request: osd pg remove(epoch 7; pg0.60; ) v1 -7086> 2012-10-11 13:43:50.760089 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1511, time: 2012-10-11 13:43:50.760054, event: dispatched, request: osd pg remove(epoch 7; pg0.60; ) v1 -7085> 2012-10-11 13:43:50.760100 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1511, time: 2012-10-11 13:43:50.760100, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.60; ) v1 -7084> 2012-10-11 13:43:50.760111 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1511, time: 2012-10-11 13:43:50.760111, event: started, request: osd pg remove(epoch 7; pg0.60; ) v1 -7083> 2012-10-11 13:43:50.760122 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.60 -7082> 2012-10-11 13:43:50.760142 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.60 0x21305d0)/0x21305d0 -7081> 2012-10-11 13:43:50.760151 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7080> 2012-10-11 13:43:50.760158 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7079> 2012-10-11 13:43:50.760165 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4128 0x2a06480 -7078> 2012-10-11 13:43:50.760174 7f440532f700 5 journal submit_entry seq 4128 len 205 (0x21c7330) -7077> 2012-10-11 13:43:50.760183 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7076> 2012-10-11 13:43:50.760191 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7075> 2012-10-11 13:43:50.760212 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1511, time: 2012-10-11 13:43:50.760212, event: done, request: osd pg remove(epoch 7; pg0.60; ) v1 -7074> 2012-10-11 13:43:50.760228 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 96329) -7073> 2012-10-11 13:43:50.760237 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 917 ==== pg_info(1 pgs e6:2.1) v3 ==== 471+0+0 (2625496194 0 0) 0x2229a80 con 0x2fe2140 -7072> 2012-10-11 13:43:50.760253 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1512, time: 2012-10-11 13:43:49.140327, event: header_read, request: pg_info(1 pgs e6:2.1) v3 -7071> 2012-10-11 13:43:50.760264 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1512, time: 2012-10-11 13:43:49.140330, event: throttled, request: pg_info(1 pgs e6:2.1) v3 -7070> 2012-10-11 13:43:50.760274 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1512, time: 2012-10-11 13:43:49.140339, event: all_read, request: pg_info(1 pgs e6:2.1) v3 -7069> 2012-10-11 13:43:50.760284 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1512, time: 2012-10-11 13:43:50.760251, event: dispatched, request: pg_info(1 pgs e6:2.1) v3 -7068> 2012-10-11 13:43:50.760295 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1512, time: 2012-10-11 13:43:50.760295, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.1) v3 -7067> 2012-10-11 13:43:50.760307 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1512, time: 2012-10-11 13:43:50.760307, event: started, request: pg_info(1 pgs e6:2.1) v3 -7066> 2012-10-11 13:43:50.760326 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1512, time: 2012-10-11 13:43:50.760326, event: done, request: pg_info(1 pgs e6:2.1) v3 -7065> 2012-10-11 13:43:50.760339 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 95858) -7064> 2012-10-11 13:43:50.760348 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 573 ==== osd pg remove(epoch 7; pg0.6e; ) v1 ==== 25+0+0 (3383145739 0 0) 0x2b87a80 con 0x2fe2280 -7063> 2012-10-11 13:43:50.760362 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1513, time: 2012-10-11 13:43:50.045515, event: header_read, request: osd pg remove(epoch 7; pg0.6e; ) v1 -7062> 2012-10-11 13:43:50.760373 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1513, time: 2012-10-11 13:43:50.045522, event: throttled, request: osd pg remove(epoch 7; pg0.6e; ) v1 -7061> 2012-10-11 13:43:50.760384 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1513, time: 2012-10-11 13:43:50.045527, event: all_read, request: osd pg remove(epoch 7; pg0.6e; ) v1 -7060> 2012-10-11 13:43:50.760395 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1513, time: 2012-10-11 13:43:50.760361, event: dispatched, request: osd pg remove(epoch 7; pg0.6e; ) v1 -7059> 2012-10-11 13:43:50.760405 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1513, time: 2012-10-11 13:43:50.760405, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.6e; ) v1 -7058> 2012-10-11 13:43:50.760417 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1513, time: 2012-10-11 13:43:50.760417, event: started, request: osd pg remove(epoch 7; pg0.6e; ) v1 -7057> 2012-10-11 13:43:50.760427 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.6e -7056> 2012-10-11 13:43:50.760447 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.6e 0x2130660)/0x2130660 -7055> 2012-10-11 13:43:50.760457 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7054> 2012-10-11 13:43:50.760464 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7053> 2012-10-11 13:43:50.760472 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4129 0x308f240 -7052> 2012-10-11 13:43:50.760480 7f440532f700 5 journal submit_entry seq 4129 len 205 (0x21c76c0) -7051> 2012-10-11 13:43:50.760489 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7050> 2012-10-11 13:43:50.760496 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7049> 2012-10-11 13:43:50.760518 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1513, time: 2012-10-11 13:43:50.760518, event: done, request: osd pg remove(epoch 7; pg0.6e; ) v1 -7048> 2012-10-11 13:43:50.760534 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 95833) -7047> 2012-10-11 13:43:50.760543 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 918 ==== pg_info(1 pgs e6:1.be) v3 ==== 471+0+0 (3302091799 0 0) 0x22298c0 con 0x2fe2140 -7046> 2012-10-11 13:43:50.760559 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1514, time: 2012-10-11 13:43:49.140342, event: header_read, request: pg_info(1 pgs e6:1.be) v3 -7045> 2012-10-11 13:43:50.760571 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1514, time: 2012-10-11 13:43:49.140345, event: throttled, request: pg_info(1 pgs e6:1.be) v3 -7044> 2012-10-11 13:43:50.760581 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1514, time: 2012-10-11 13:43:49.140354, event: all_read, request: pg_info(1 pgs e6:1.be) v3 -7043> 2012-10-11 13:43:50.760591 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1514, time: 2012-10-11 13:43:50.760557, event: dispatched, request: pg_info(1 pgs e6:1.be) v3 -7042> 2012-10-11 13:43:50.760602 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1514, time: 2012-10-11 13:43:50.760602, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.be) v3 -7041> 2012-10-11 13:43:50.760614 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1514, time: 2012-10-11 13:43:50.760613, event: started, request: pg_info(1 pgs e6:1.be) v3 -7040> 2012-10-11 13:43:50.760632 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1514, time: 2012-10-11 13:43:50.760632, event: done, request: pg_info(1 pgs e6:1.be) v3 -7039> 2012-10-11 13:43:50.760645 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 95362) -7038> 2012-10-11 13:43:50.760654 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 574 ==== osd pg remove(epoch 7; pg0.6f; ) v1 ==== 25+0+0 (2157627436 0 0) 0x2b87c40 con 0x2fe2280 -7037> 2012-10-11 13:43:50.760669 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1515, time: 2012-10-11 13:43:50.045565, event: header_read, request: osd pg remove(epoch 7; pg0.6f; ) v1 -7036> 2012-10-11 13:43:50.760680 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1515, time: 2012-10-11 13:43:50.045572, event: throttled, request: osd pg remove(epoch 7; pg0.6f; ) v1 -7035> 2012-10-11 13:43:50.760690 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1515, time: 2012-10-11 13:43:50.045577, event: all_read, request: osd pg remove(epoch 7; pg0.6f; ) v1 -7034> 2012-10-11 13:43:50.760700 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1515, time: 2012-10-11 13:43:50.760667, event: dispatched, request: osd pg remove(epoch 7; pg0.6f; ) v1 -7033> 2012-10-11 13:43:50.760711 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1515, time: 2012-10-11 13:43:50.760711, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.6f; ) v1 -7032> 2012-10-11 13:43:50.760723 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1515, time: 2012-10-11 13:43:50.760722, event: started, request: osd pg remove(epoch 7; pg0.6f; ) v1 -7031> 2012-10-11 13:43:50.760733 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.6f -7030> 2012-10-11 13:43:50.760752 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.6f 0x2130630)/0x2130630 -7029> 2012-10-11 13:43:50.760762 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7028> 2012-10-11 13:43:50.760769 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7027> 2012-10-11 13:43:50.760776 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4130 0x308f990 -7026> 2012-10-11 13:43:50.760785 7f440532f700 5 journal submit_entry seq 4130 len 205 (0x2274300) -7025> 2012-10-11 13:43:50.760793 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7024> 2012-10-11 13:43:50.760800 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7023> 2012-10-11 13:43:50.760821 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1515, time: 2012-10-11 13:43:50.760821, event: done, request: osd pg remove(epoch 7; pg0.6f; ) v1 -7022> 2012-10-11 13:43:50.760837 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 95337) -7021> 2012-10-11 13:43:50.760845 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 919 ==== pg_info(1 pgs e6:0.5) v3 ==== 471+0+0 (2832692046 0 0) 0x2229700 con 0x2fe2140 -7020> 2012-10-11 13:43:50.760861 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1516, time: 2012-10-11 13:43:49.140357, event: header_read, request: pg_info(1 pgs e6:0.5) v3 -7019> 2012-10-11 13:43:50.760872 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1516, time: 2012-10-11 13:43:49.140361, event: throttled, request: pg_info(1 pgs e6:0.5) v3 -7018> 2012-10-11 13:43:50.760883 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1516, time: 2012-10-11 13:43:49.140369, event: all_read, request: pg_info(1 pgs e6:0.5) v3 -7017> 2012-10-11 13:43:50.760893 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1516, time: 2012-10-11 13:43:50.760859, event: dispatched, request: pg_info(1 pgs e6:0.5) v3 -7016> 2012-10-11 13:43:50.760903 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1516, time: 2012-10-11 13:43:50.760903, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.5) v3 -7015> 2012-10-11 13:43:50.760915 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1516, time: 2012-10-11 13:43:50.760915, event: started, request: pg_info(1 pgs e6:0.5) v3 -7014> 2012-10-11 13:43:50.760934 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1516, time: 2012-10-11 13:43:50.760934, event: done, request: pg_info(1 pgs e6:0.5) v3 -7013> 2012-10-11 13:43:50.760948 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 94866) -7012> 2012-10-11 13:43:50.760956 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 575 ==== osd pg remove(epoch 7; pg0.73; ) v1 ==== 25+0+0 (1741309743 0 0) 0x2b87e00 con 0x2fe2280 -7011> 2012-10-11 13:43:50.760971 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1517, time: 2012-10-11 13:43:50.045614, event: header_read, request: osd pg remove(epoch 7; pg0.73; ) v1 -7010> 2012-10-11 13:43:50.760982 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1517, time: 2012-10-11 13:43:50.045621, event: throttled, request: osd pg remove(epoch 7; pg0.73; ) v1 -7009> 2012-10-11 13:43:50.760993 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1517, time: 2012-10-11 13:43:50.045626, event: all_read, request: osd pg remove(epoch 7; pg0.73; ) v1 -7008> 2012-10-11 13:43:50.761003 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1517, time: 2012-10-11 13:43:50.760970, event: dispatched, request: osd pg remove(epoch 7; pg0.73; ) v1 -7007> 2012-10-11 13:43:50.761014 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1517, time: 2012-10-11 13:43:50.761014, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.73; ) v1 -7006> 2012-10-11 13:43:50.761025 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1517, time: 2012-10-11 13:43:50.761025, event: started, request: osd pg remove(epoch 7; pg0.73; ) v1 -7005> 2012-10-11 13:43:50.761036 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.73 -7004> 2012-10-11 13:43:50.761056 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.73 0x21308c0)/0x21308c0 -7003> 2012-10-11 13:43:50.761066 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7002> 2012-10-11 13:43:50.761072 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7001> 2012-10-11 13:43:50.761080 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4131 0x308ff30 -7000> 2012-10-11 13:43:50.761088 7f440532f700 5 journal submit_entry seq 4131 len 205 (0x2274150) -6999> 2012-10-11 13:43:50.761097 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6998> 2012-10-11 13:43:50.761104 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6997> 2012-10-11 13:43:50.761126 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1517, time: 2012-10-11 13:43:50.761126, event: done, request: osd pg remove(epoch 7; pg0.73; ) v1 -6996> 2012-10-11 13:43:50.761142 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 94841) -7034> 2012-10-11 13:43:50.761151 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 920 ==== pg_info(1 pgs e6:1.2) v3 ==== 471+0+0 (534399019 0 0) 0x2229540 con 0x2fe2140 -7033> 2012-10-11 13:43:50.761167 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1518, time: 2012-10-11 13:43:49.140371, event: header_read, request: pg_info(1 pgs e6:1.2) v3 -7032> 2012-10-11 13:43:50.761178 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1518, time: 2012-10-11 13:43:49.140375, event: throttled, request: pg_info(1 pgs e6:1.2) v3 -7031> 2012-10-11 13:43:50.761188 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1518, time: 2012-10-11 13:43:49.140383, event: all_read, request: pg_info(1 pgs e6:1.2) v3 -7030> 2012-10-11 13:43:50.761199 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1518, time: 2012-10-11 13:43:50.761165, event: dispatched, request: pg_info(1 pgs e6:1.2) v3 -7029> 2012-10-11 13:43:50.761210 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1518, time: 2012-10-11 13:43:50.761210, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.2) v3 -7028> 2012-10-11 13:43:50.761222 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1518, time: 2012-10-11 13:43:50.761222, event: started, request: pg_info(1 pgs e6:1.2) v3 -7027> 2012-10-11 13:43:50.761240 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1518, time: 2012-10-11 13:43:50.761240, event: done, request: pg_info(1 pgs e6:1.2) v3 -7026> 2012-10-11 13:43:50.761264 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 94370) -7025> 2012-10-11 13:43:50.761273 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 576 ==== osd pg remove(epoch 7; pg0.7a; ) v1 ==== 25+0+0 (1825390290 0 0) 0x2b191c0 con 0x2fe2280 -7024> 2012-10-11 13:43:50.761288 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1519, time: 2012-10-11 13:43:50.045664, event: header_read, request: osd pg remove(epoch 7; pg0.7a; ) v1 -7023> 2012-10-11 13:43:50.761300 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1519, time: 2012-10-11 13:43:50.045671, event: throttled, request: osd pg remove(epoch 7; pg0.7a; ) v1 -7022> 2012-10-11 13:43:50.761310 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1519, time: 2012-10-11 13:43:50.045676, event: all_read, request: osd pg remove(epoch 7; pg0.7a; ) v1 -7021> 2012-10-11 13:43:50.761321 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1519, time: 2012-10-11 13:43:50.761287, event: dispatched, request: osd pg remove(epoch 7; pg0.7a; ) v1 -7023> 2012-10-11 13:43:50.761332 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1519, time: 2012-10-11 13:43:50.761332, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.7a; ) v1 -7025> 2012-10-11 13:43:50.761344 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1519, time: 2012-10-11 13:43:50.761344, event: started, request: osd pg remove(epoch 7; pg0.7a; ) v1 -7024> 2012-10-11 13:43:50.761355 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.7a -7023> 2012-10-11 13:43:50.761375 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.7a 0x2130ae0)/0x2130ae0 -7022> 2012-10-11 13:43:50.761385 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7029> 2012-10-11 13:43:50.761392 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7028> 2012-10-11 13:43:50.761399 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4132 0x308f000 -7030> 2012-10-11 13:43:50.761408 7f440532f700 5 journal submit_entry seq 4132 len 205 (0x2274690) -7029> 2012-10-11 13:43:50.761416 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7028> 2012-10-11 13:43:50.761424 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7027> 2012-10-11 13:43:50.761445 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1519, time: 2012-10-11 13:43:50.761445, event: done, request: osd pg remove(epoch 7; pg0.7a; ) v1 -7026> 2012-10-11 13:43:50.761461 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 94345) -7025> 2012-10-11 13:43:50.761470 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 921 ==== pg_info(1 pgs e6:0.3) v3 ==== 471+0+0 (12339234 0 0) 0x2229380 con 0x2fe2140 -7024> 2012-10-11 13:43:50.761486 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1520, time: 2012-10-11 13:43:49.140385, event: header_read, request: pg_info(1 pgs e6:0.3) v3 -7023> 2012-10-11 13:43:50.761496 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1520, time: 2012-10-11 13:43:49.140389, event: throttled, request: pg_info(1 pgs e6:0.3) v3 -7022> 2012-10-11 13:43:50.761507 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1520, time: 2012-10-11 13:43:49.140397, event: all_read, request: pg_info(1 pgs e6:0.3) v3 -7021> 2012-10-11 13:43:50.761517 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1520, time: 2012-10-11 13:43:50.761484, event: dispatched, request: pg_info(1 pgs e6:0.3) v3 -7020> 2012-10-11 13:43:50.761527 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1520, time: 2012-10-11 13:43:50.761527, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.3) v3 -7019> 2012-10-11 13:43:50.761539 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1520, time: 2012-10-11 13:43:50.761539, event: started, request: pg_info(1 pgs e6:0.3) v3 -7018> 2012-10-11 13:43:50.761557 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1520, time: 2012-10-11 13:43:50.761557, event: done, request: pg_info(1 pgs e6:0.3) v3 -7017> 2012-10-11 13:43:50.761570 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 93874) -7016> 2012-10-11 13:43:50.761578 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 577 ==== osd pg remove(epoch 7; pg0.7b; ) v1 ==== 25+0+0 (636568565 0 0) 0x2b19380 con 0x2fe2280 -7015> 2012-10-11 13:43:50.761594 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1521, time: 2012-10-11 13:43:50.045715, event: header_read, request: osd pg remove(epoch 7; pg0.7b; ) v1 -7014> 2012-10-11 13:43:50.761605 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1521, time: 2012-10-11 13:43:50.045723, event: throttled, request: osd pg remove(epoch 7; pg0.7b; ) v1 -7013> 2012-10-11 13:43:50.761615 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1521, time: 2012-10-11 13:43:50.045728, event: all_read, request: osd pg remove(epoch 7; pg0.7b; ) v1 -7012> 2012-10-11 13:43:50.761625 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1521, time: 2012-10-11 13:43:50.761592, event: dispatched, request: osd pg remove(epoch 7; pg0.7b; ) v1 -7011> 2012-10-11 13:43:50.761636 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1521, time: 2012-10-11 13:43:50.761636, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.7b; ) v1 -7010> 2012-10-11 13:43:50.761647 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1521, time: 2012-10-11 13:43:50.761647, event: started, request: osd pg remove(epoch 7; pg0.7b; ) v1 -7009> 2012-10-11 13:43:50.761657 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.7b -7008> 2012-10-11 13:43:50.761677 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.7b 0x2130ab0)/0x2130ab0 -7007> 2012-10-11 13:43:50.761686 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -7006> 2012-10-11 13:43:50.761693 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -7005> 2012-10-11 13:43:50.761700 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4133 0x308f120 -7004> 2012-10-11 13:43:50.761709 7f440532f700 5 journal submit_entry seq 4133 len 205 (0x22d4ab0) -7003> 2012-10-11 13:43:50.761721 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -7002> 2012-10-11 13:43:50.761728 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -7001> 2012-10-11 13:43:50.761749 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1521, time: 2012-10-11 13:43:50.761749, event: done, request: osd pg remove(epoch 7; pg0.7b; ) v1 -7000> 2012-10-11 13:43:50.761766 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 93849) -6999> 2012-10-11 13:43:50.761774 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 922 ==== pg_info(1 pgs e6:2.3) v3 ==== 471+0+0 (3081896990 0 0) 0x22291c0 con 0x2fe2140 -6998> 2012-10-11 13:43:50.761790 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1522, time: 2012-10-11 13:43:49.140400, event: header_read, request: pg_info(1 pgs e6:2.3) v3 -6997> 2012-10-11 13:43:50.761801 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1522, time: 2012-10-11 13:43:49.140404, event: throttled, request: pg_info(1 pgs e6:2.3) v3 -6996> 2012-10-11 13:43:50.761811 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1522, time: 2012-10-11 13:43:49.140411, event: all_read, request: pg_info(1 pgs e6:2.3) v3 -6995> 2012-10-11 13:43:50.761821 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1522, time: 2012-10-11 13:43:50.761788, event: dispatched, request: pg_info(1 pgs e6:2.3) v3 -6994> 2012-10-11 13:43:50.761832 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1522, time: 2012-10-11 13:43:50.761832, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.3) v3 -6993> 2012-10-11 13:43:50.761843 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1522, time: 2012-10-11 13:43:50.761843, event: started, request: pg_info(1 pgs e6:2.3) v3 -6992> 2012-10-11 13:43:50.761863 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1522, time: 2012-10-11 13:43:50.761863, event: done, request: pg_info(1 pgs e6:2.3) v3 -6991> 2012-10-11 13:43:50.761876 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 93378) -6990> 2012-10-11 13:43:50.761884 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 578 ==== osd pg remove(epoch 7; pg0.88; ) v1 ==== 25+0+0 (1505949159 0 0) 0x2b19a80 con 0x2fe2280 -6989> 2012-10-11 13:43:50.761899 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1523, time: 2012-10-11 13:43:50.045767, event: header_read, request: osd pg remove(epoch 7; pg0.88; ) v1 -6988> 2012-10-11 13:43:50.761910 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1523, time: 2012-10-11 13:43:50.045774, event: throttled, request: osd pg remove(epoch 7; pg0.88; ) v1 -6987> 2012-10-11 13:43:50.761920 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1523, time: 2012-10-11 13:43:50.045780, event: all_read, request: osd pg remove(epoch 7; pg0.88; ) v1 -6986> 2012-10-11 13:43:50.761930 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1523, time: 2012-10-11 13:43:50.761897, event: dispatched, request: osd pg remove(epoch 7; pg0.88; ) v1 -6985> 2012-10-11 13:43:50.761941 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1523, time: 2012-10-11 13:43:50.761941, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.88; ) v1 -6984> 2012-10-11 13:43:50.761953 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1523, time: 2012-10-11 13:43:50.761952, event: started, request: osd pg remove(epoch 7; pg0.88; ) v1 -6983> 2012-10-11 13:43:50.761964 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.88 -6982> 2012-10-11 13:43:50.761983 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.88 0x2130bd0)/0x2130bd0 -6981> 2012-10-11 13:43:50.761993 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6980> 2012-10-11 13:43:50.761999 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6979> 2012-10-11 13:43:50.762006 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4134 0x308fea0 -6978> 2012-10-11 13:43:50.762015 7f440532f700 5 journal submit_entry seq 4134 len 205 (0x22d4900) -6977> 2012-10-11 13:43:50.762023 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6976> 2012-10-11 13:43:50.762030 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6975> 2012-10-11 13:43:50.762055 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1523, time: 2012-10-11 13:43:50.762055, event: done, request: osd pg remove(epoch 7; pg0.88; ) v1 -6974> 2012-10-11 13:43:50.762071 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 93353) -6973> 2012-10-11 13:43:50.762080 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 923 ==== pg_info(1 pgs e6:0.f4) v3 ==== 471+0+0 (2401404325 0 0) 0x2229000 con 0x2fe2140 -6972> 2012-10-11 13:43:50.762096 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1524, time: 2012-10-11 13:43:49.140414, event: header_read, request: pg_info(1 pgs e6:0.f4) v3 -6971> 2012-10-11 13:43:50.762109 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1524, time: 2012-10-11 13:43:49.140417, event: throttled, request: pg_info(1 pgs e6:0.f4) v3 -6970> 2012-10-11 13:43:50.762120 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1524, time: 2012-10-11 13:43:49.140425, event: all_read, request: pg_info(1 pgs e6:0.f4) v3 -6969> 2012-10-11 13:43:50.762130 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1524, time: 2012-10-11 13:43:50.762094, event: dispatched, request: pg_info(1 pgs e6:0.f4) v3 -6968> 2012-10-11 13:43:50.762141 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1524, time: 2012-10-11 13:43:50.762140, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.f4) v3 -6967> 2012-10-11 13:43:50.762152 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1524, time: 2012-10-11 13:43:50.762152, event: started, request: pg_info(1 pgs e6:0.f4) v3 -6966> 2012-10-11 13:43:50.762171 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1524, time: 2012-10-11 13:43:50.762171, event: done, request: pg_info(1 pgs e6:0.f4) v3 -6965> 2012-10-11 13:43:50.762184 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 92882) -6964> 2012-10-11 13:43:50.762193 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 579 ==== osd pg remove(epoch 7; pg0.90; ) v1 ==== 25+0+0 (2677012617 0 0) 0x2b198c0 con 0x2fe2280 -6963> 2012-10-11 13:43:50.762208 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1525, time: 2012-10-11 13:43:50.045817, event: header_read, request: osd pg remove(epoch 7; pg0.90; ) v1 -6962> 2012-10-11 13:43:50.762219 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1525, time: 2012-10-11 13:43:50.045824, event: throttled, request: osd pg remove(epoch 7; pg0.90; ) v1 -6961> 2012-10-11 13:43:50.762229 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1525, time: 2012-10-11 13:43:50.045830, event: all_read, request: osd pg remove(epoch 7; pg0.90; ) v1 -6960> 2012-10-11 13:43:50.762240 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1525, time: 2012-10-11 13:43:50.762207, event: dispatched, request: osd pg remove(epoch 7; pg0.90; ) v1 -6959> 2012-10-11 13:43:50.762250 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1525, time: 2012-10-11 13:43:50.762250, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.90; ) v1 -6958> 2012-10-11 13:43:50.762261 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1525, time: 2012-10-11 13:43:50.762261, event: started, request: osd pg remove(epoch 7; pg0.90; ) v1 -6957> 2012-10-11 13:43:50.762272 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.90 -6956> 2012-10-11 13:43:50.762291 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.90 0x2130e00)/0x2130e00 -6955> 2012-10-11 13:43:50.762301 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6954> 2012-10-11 13:43:50.762308 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6953> 2012-10-11 13:43:50.762315 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4135 0x308fd80 -6952> 2012-10-11 13:43:50.762323 7f440532f700 5 journal submit_entry seq 4135 len 205 (0x2328cf0) -6951> 2012-10-11 13:43:50.762332 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6950> 2012-10-11 13:43:50.762341 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6949> 2012-10-11 13:43:50.762365 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1525, time: 2012-10-11 13:43:50.762365, event: done, request: osd pg remove(epoch 7; pg0.90; ) v1 -6948> 2012-10-11 13:43:50.762382 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 92857) -6947> 2012-10-11 13:43:50.762390 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 924 ==== pg_info(1 pgs e6:1.f3) v3 ==== 471+0+0 (2392835570 0 0) 0x3435e00 con 0x2fe2140 -6946> 2012-10-11 13:43:50.762406 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1526, time: 2012-10-11 13:43:49.140428, event: header_read, request: pg_info(1 pgs e6:1.f3) v3 -6945> 2012-10-11 13:43:50.762417 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1526, time: 2012-10-11 13:43:49.140431, event: throttled, request: pg_info(1 pgs e6:1.f3) v3 -6944> 2012-10-11 13:43:50.762427 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1526, time: 2012-10-11 13:43:49.140451, event: all_read, request: pg_info(1 pgs e6:1.f3) v3 -6943> 2012-10-11 13:43:50.762437 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1526, time: 2012-10-11 13:43:50.762404, event: dispatched, request: pg_info(1 pgs e6:1.f3) v3 -6942> 2012-10-11 13:43:50.762448 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1526, time: 2012-10-11 13:43:50.762448, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.f3) v3 -6941> 2012-10-11 13:43:50.762460 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1526, time: 2012-10-11 13:43:50.762460, event: started, request: pg_info(1 pgs e6:1.f3) v3 -6940> 2012-10-11 13:43:50.762480 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1526, time: 2012-10-11 13:43:50.762480, event: done, request: pg_info(1 pgs e6:1.f3) v3 -6939> 2012-10-11 13:43:50.762493 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 92386) -6938> 2012-10-11 13:43:50.762502 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 580 ==== osd pg remove(epoch 7; pg0.91; ) v1 ==== 25+0+0 (3602089390 0 0) 0x32168c0 con 0x2fe2280 -6937> 2012-10-11 13:43:50.762516 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1527, time: 2012-10-11 13:43:50.045867, event: header_read, request: osd pg remove(epoch 7; pg0.91; ) v1 -6936> 2012-10-11 13:43:50.762527 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1527, time: 2012-10-11 13:43:50.045874, event: throttled, request: osd pg remove(epoch 7; pg0.91; ) v1 -6935> 2012-10-11 13:43:50.762538 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1527, time: 2012-10-11 13:43:50.045880, event: all_read, request: osd pg remove(epoch 7; pg0.91; ) v1 -6934> 2012-10-11 13:43:50.762548 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1527, time: 2012-10-11 13:43:50.762515, event: dispatched, request: osd pg remove(epoch 7; pg0.91; ) v1 -6933> 2012-10-11 13:43:50.762559 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1527, time: 2012-10-11 13:43:50.762559, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.91; ) v1 -6932> 2012-10-11 13:43:50.762570 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1527, time: 2012-10-11 13:43:50.762570, event: started, request: osd pg remove(epoch 7; pg0.91; ) v1 -6931> 2012-10-11 13:43:50.762581 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.91 -6930> 2012-10-11 13:43:50.762600 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.91 0x2130dd0)/0x2130dd0 -6929> 2012-10-11 13:43:50.762610 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6928> 2012-10-11 13:43:50.762617 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6927> 2012-10-11 13:43:50.762624 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4136 0x308fc60 -6926> 2012-10-11 13:43:50.762632 7f440532f700 5 journal submit_entry seq 4136 len 205 (0x2388f60) -6925> 2012-10-11 13:43:50.762641 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6924> 2012-10-11 13:43:50.762647 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6923> 2012-10-11 13:43:50.762668 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1527, time: 2012-10-11 13:43:50.762668, event: done, request: osd pg remove(epoch 7; pg0.91; ) v1 -6922> 2012-10-11 13:43:50.762686 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 92361) -6921> 2012-10-11 13:43:50.762694 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 925 ==== pg_info(1 pgs e6:2.e1) v3 ==== 471+0+0 (601119241 0 0) 0x3435c40 con 0x2fe2140 -6920> 2012-10-11 13:43:50.762710 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1528, time: 2012-10-11 13:43:49.140454, event: header_read, request: pg_info(1 pgs e6:2.e1) v3 -6919> 2012-10-11 13:43:50.762722 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1528, time: 2012-10-11 13:43:49.140459, event: throttled, request: pg_info(1 pgs e6:2.e1) v3 -6918> 2012-10-11 13:43:50.762732 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1528, time: 2012-10-11 13:43:49.140467, event: all_read, request: pg_info(1 pgs e6:2.e1) v3 -6917> 2012-10-11 13:43:50.762742 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1528, time: 2012-10-11 13:43:50.762708, event: dispatched, request: pg_info(1 pgs e6:2.e1) v3 -6916> 2012-10-11 13:43:50.762753 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1528, time: 2012-10-11 13:43:50.762753, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.e1) v3 -6915> 2012-10-11 13:43:50.762765 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1528, time: 2012-10-11 13:43:50.762764, event: started, request: pg_info(1 pgs e6:2.e1) v3 -6914> 2012-10-11 13:43:50.762784 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1528, time: 2012-10-11 13:43:50.762784, event: done, request: pg_info(1 pgs e6:2.e1) v3 -6913> 2012-10-11 13:43:50.762798 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 91890) -6912> 2012-10-11 13:43:50.762807 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 581 ==== osd pg remove(epoch 7; pg0.92; ) v1 ==== 25+0+0 (234291911 0 0) 0x3216700 con 0x2fe2280 -6911> 2012-10-11 13:43:50.762821 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1529, time: 2012-10-11 13:43:50.045916, event: header_read, request: osd pg remove(epoch 7; pg0.92; ) v1 -6910> 2012-10-11 13:43:50.762832 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1529, time: 2012-10-11 13:43:50.045923, event: throttled, request: osd pg remove(epoch 7; pg0.92; ) v1 -6909> 2012-10-11 13:43:50.762843 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1529, time: 2012-10-11 13:43:50.045929, event: all_read, request: osd pg remove(epoch 7; pg0.92; ) v1 -6908> 2012-10-11 13:43:50.762853 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1529, time: 2012-10-11 13:43:50.762820, event: dispatched, request: osd pg remove(epoch 7; pg0.92; ) v1 -6907> 2012-10-11 13:43:50.762864 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1529, time: 2012-10-11 13:43:50.762864, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.92; ) v1 -6906> 2012-10-11 13:43:50.762875 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1529, time: 2012-10-11 13:43:50.762875, event: started, request: osd pg remove(epoch 7; pg0.92; ) v1 -6905> 2012-10-11 13:43:50.762886 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.92 -6904> 2012-10-11 13:43:50.762905 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.92 0x2130da0)/0x2130da0 -6903> 2012-10-11 13:43:50.762914 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6902> 2012-10-11 13:43:50.762921 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6901> 2012-10-11 13:43:50.762928 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4137 0x308fa20 -6900> 2012-10-11 13:43:50.762937 7f440532f700 5 journal submit_entry seq 4137 len 205 (0x2388db0) -6899> 2012-10-11 13:43:50.762945 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6898> 2012-10-11 13:43:50.762951 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6897> 2012-10-11 13:43:50.762974 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1529, time: 2012-10-11 13:43:50.762974, event: done, request: osd pg remove(epoch 7; pg0.92; ) v1 -6896> 2012-10-11 13:43:50.762990 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 91865) -6895> 2012-10-11 13:43:50.762998 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 926 ==== pg_info(1 pgs e6:0.bf) v3 ==== 471+0+0 (3131526332 0 0) 0x3435a80 con 0x2fe2140 -6894> 2012-10-11 13:43:50.763014 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1530, time: 2012-10-11 13:43:49.140470, event: header_read, request: pg_info(1 pgs e6:0.bf) v3 -6893> 2012-10-11 13:43:50.763025 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1530, time: 2012-10-11 13:43:49.140473, event: throttled, request: pg_info(1 pgs e6:0.bf) v3 -6892> 2012-10-11 13:43:50.763035 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1530, time: 2012-10-11 13:43:49.140482, event: all_read, request: pg_info(1 pgs e6:0.bf) v3 -6891> 2012-10-11 13:43:50.763045 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1530, time: 2012-10-11 13:43:50.763012, event: dispatched, request: pg_info(1 pgs e6:0.bf) v3 -6890> 2012-10-11 13:43:50.763056 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1530, time: 2012-10-11 13:43:50.763056, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.bf) v3 -6889> 2012-10-11 13:43:50.763068 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1530, time: 2012-10-11 13:43:50.763068, event: started, request: pg_info(1 pgs e6:0.bf) v3 -6888> 2012-10-11 13:43:50.763087 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1530, time: 2012-10-11 13:43:50.763087, event: done, request: pg_info(1 pgs e6:0.bf) v3 -6887> 2012-10-11 13:43:50.763104 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 91394) -6886> 2012-10-11 13:43:50.763113 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 582 ==== osd pg remove(epoch 7; pg0.93; ) v1 ==== 25+0+0 (1154187232 0 0) 0x3216e00 con 0x2fe2280 -6885> 2012-10-11 13:43:50.763128 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1531, time: 2012-10-11 13:43:50.045967, event: header_read, request: osd pg remove(epoch 7; pg0.93; ) v1 -6884> 2012-10-11 13:43:50.763139 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1531, time: 2012-10-11 13:43:50.045974, event: throttled, request: osd pg remove(epoch 7; pg0.93; ) v1 -6883> 2012-10-11 13:43:50.763150 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1531, time: 2012-10-11 13:43:50.045979, event: all_read, request: osd pg remove(epoch 7; pg0.93; ) v1 -6882> 2012-10-11 13:43:50.763160 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1531, time: 2012-10-11 13:43:50.763126, event: dispatched, request: osd pg remove(epoch 7; pg0.93; ) v1 -6881> 2012-10-11 13:43:50.763172 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1531, time: 2012-10-11 13:43:50.763172, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.93; ) v1 -6880> 2012-10-11 13:43:50.763184 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1531, time: 2012-10-11 13:43:50.763184, event: started, request: osd pg remove(epoch 7; pg0.93; ) v1 -6879> 2012-10-11 13:43:50.763195 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.93 -6878> 2012-10-11 13:43:50.763214 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.93 0x2130d70)/0x2130d70 -6877> 2012-10-11 13:43:50.763223 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6876> 2012-10-11 13:43:50.763230 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6875> 2012-10-11 13:43:50.763237 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4138 0x308f7e0 -6874> 2012-10-11 13:43:50.763246 7f440532f700 5 journal submit_entry seq 4138 len 205 (0x2388c00) -6873> 2012-10-11 13:43:50.763254 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6872> 2012-10-11 13:43:50.763261 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6871> 2012-10-11 13:43:50.763284 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1531, time: 2012-10-11 13:43:50.763284, event: done, request: osd pg remove(epoch 7; pg0.93; ) v1 -6870> 2012-10-11 13:43:50.763300 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 91369) -6869> 2012-10-11 13:43:50.763309 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 927 ==== pg_info(1 pgs e6:0.bd) v3 ==== 471+0+0 (2054811617 0 0) 0x34358c0 con 0x2fe2140 -6868> 2012-10-11 13:43:50.763325 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1532, time: 2012-10-11 13:43:49.140485, event: header_read, request: pg_info(1 pgs e6:0.bd) v3 -6867> 2012-10-11 13:43:50.763335 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1532, time: 2012-10-11 13:43:49.140488, event: throttled, request: pg_info(1 pgs e6:0.bd) v3 -6866> 2012-10-11 13:43:50.763345 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1532, time: 2012-10-11 13:43:49.140496, event: all_read, request: pg_info(1 pgs e6:0.bd) v3 -6865> 2012-10-11 13:43:50.763355 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1532, time: 2012-10-11 13:43:50.763323, event: dispatched, request: pg_info(1 pgs e6:0.bd) v3 -6864> 2012-10-11 13:43:50.763366 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1532, time: 2012-10-11 13:43:50.763366, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.bd) v3 -6863> 2012-10-11 13:43:50.763378 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1532, time: 2012-10-11 13:43:50.763378, event: started, request: pg_info(1 pgs e6:0.bd) v3 -6862> 2012-10-11 13:43:50.763396 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1532, time: 2012-10-11 13:43:50.763396, event: done, request: pg_info(1 pgs e6:0.bd) v3 -6861> 2012-10-11 13:43:50.763411 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 90898) -6860> 2012-10-11 13:43:50.763420 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 583 ==== osd pg remove(epoch 7; pg1.16; ) v1 ==== 25+0+0 (3941014320 0 0) 0x20b01c0 con 0x2fe2280 -6859> 2012-10-11 13:43:50.763435 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1533, time: 2012-10-11 13:43:50.046017, event: header_read, request: osd pg remove(epoch 7; pg1.16; ) v1 -6858> 2012-10-11 13:43:50.763446 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1533, time: 2012-10-11 13:43:50.046024, event: throttled, request: osd pg remove(epoch 7; pg1.16; ) v1 -6857> 2012-10-11 13:43:50.763456 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1533, time: 2012-10-11 13:43:50.046030, event: all_read, request: osd pg remove(epoch 7; pg1.16; ) v1 -6856> 2012-10-11 13:43:50.763467 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1533, time: 2012-10-11 13:43:50.763433, event: dispatched, request: osd pg remove(epoch 7; pg1.16; ) v1 -6855> 2012-10-11 13:43:50.763478 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1533, time: 2012-10-11 13:43:50.763478, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.16; ) v1 -6854> 2012-10-11 13:43:50.763489 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1533, time: 2012-10-11 13:43:50.763489, event: started, request: osd pg remove(epoch 7; pg1.16; ) v1 -6853> 2012-10-11 13:43:50.763500 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.16 -6852> 2012-10-11 13:43:50.763520 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.16 0x27a1780)/0x27a1780 -6851> 2012-10-11 13:43:50.763529 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6850> 2012-10-11 13:43:50.763536 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6849> 2012-10-11 13:43:50.763543 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4139 0x308f630 -6848> 2012-10-11 13:43:50.763552 7f440532f700 5 journal submit_entry seq 4139 len 205 (0x23e2450) -6847> 2012-10-11 13:43:50.763560 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6846> 2012-10-11 13:43:50.763567 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6845> 2012-10-11 13:43:50.763591 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1533, time: 2012-10-11 13:43:50.763590, event: done, request: osd pg remove(epoch 7; pg1.16; ) v1 -6844> 2012-10-11 13:43:50.763608 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 90873) -6843> 2012-10-11 13:43:50.763616 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 928 ==== pg_info(1 pgs e6:2.f2) v3 ==== 471+0+0 (53358402 0 0) 0x3435700 con 0x2fe2140 -6842> 2012-10-11 13:43:50.763631 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1534, time: 2012-10-11 13:43:49.140499, event: header_read, request: pg_info(1 pgs e6:2.f2) v3 -6841> 2012-10-11 13:43:50.763642 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1534, time: 2012-10-11 13:43:49.140503, event: throttled, request: pg_info(1 pgs e6:2.f2) v3 -6840> 2012-10-11 13:43:50.763652 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1534, time: 2012-10-11 13:43:49.140520, event: all_read, request: pg_info(1 pgs e6:2.f2) v3 -6839> 2012-10-11 13:43:50.763663 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1534, time: 2012-10-11 13:43:50.763630, event: dispatched, request: pg_info(1 pgs e6:2.f2) v3 -6838> 2012-10-11 13:43:50.763673 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1534, time: 2012-10-11 13:43:50.763673, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.f2) v3 -6837> 2012-10-11 13:43:50.763685 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1534, time: 2012-10-11 13:43:50.763685, event: started, request: pg_info(1 pgs e6:2.f2) v3 -6836> 2012-10-11 13:43:50.763704 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1534, time: 2012-10-11 13:43:50.763704, event: done, request: pg_info(1 pgs e6:2.f2) v3 -6835> 2012-10-11 13:43:50.763717 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 90402) -6834> 2012-10-11 13:43:50.763726 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 584 ==== osd pg remove(epoch 7; pg1.1c; ) v1 ==== 25+0+0 (983885220 0 0) 0x3009700 con 0x2fe2280 -6833> 2012-10-11 13:43:50.763740 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1535, time: 2012-10-11 13:43:50.046068, event: header_read, request: osd pg remove(epoch 7; pg1.1c; ) v1 -6832> 2012-10-11 13:43:50.763751 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1535, time: 2012-10-11 13:43:50.046075, event: throttled, request: osd pg remove(epoch 7; pg1.1c; ) v1 -6831> 2012-10-11 13:43:50.763762 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1535, time: 2012-10-11 13:43:50.046082, event: all_read, request: osd pg remove(epoch 7; pg1.1c; ) v1 -6830> 2012-10-11 13:43:50.763772 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1535, time: 2012-10-11 13:43:50.763739, event: dispatched, request: osd pg remove(epoch 7; pg1.1c; ) v1 -6829> 2012-10-11 13:43:50.763783 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1535, time: 2012-10-11 13:43:50.763783, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.1c; ) v1 -6828> 2012-10-11 13:43:50.763794 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1535, time: 2012-10-11 13:43:50.763794, event: started, request: osd pg remove(epoch 7; pg1.1c; ) v1 -6827> 2012-10-11 13:43:50.763805 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.1c -6826> 2012-10-11 13:43:50.763825 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.1c 0x27a1660)/0x27a1660 -6825> 2012-10-11 13:43:50.763834 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6824> 2012-10-11 13:43:50.763841 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6823> 2012-10-11 13:43:50.763849 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4140 0x308f6c0 -6822> 2012-10-11 13:43:50.763857 7f440532f700 5 journal submit_entry seq 4140 len 205 (0x28cc1b0) -6821> 2012-10-11 13:43:50.763865 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6820> 2012-10-11 13:43:50.763872 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6819> 2012-10-11 13:43:50.763898 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1535, time: 2012-10-11 13:43:50.763898, event: done, request: osd pg remove(epoch 7; pg1.1c; ) v1 -6818> 2012-10-11 13:43:50.763915 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 90377) -6817> 2012-10-11 13:43:50.763923 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 929 ==== pg_info(1 pgs e6:1.e2) v3 ==== 471+0+0 (1854904987 0 0) 0x3435540 con 0x2fe2140 -6816> 2012-10-11 13:43:50.763939 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1536, time: 2012-10-11 13:43:49.140523, event: header_read, request: pg_info(1 pgs e6:1.e2) v3 -6815> 2012-10-11 13:43:50.763950 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1536, time: 2012-10-11 13:43:49.140527, event: throttled, request: pg_info(1 pgs e6:1.e2) v3 -6814> 2012-10-11 13:43:50.763960 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1536, time: 2012-10-11 13:43:49.140535, event: all_read, request: pg_info(1 pgs e6:1.e2) v3 -6813> 2012-10-11 13:43:50.763970 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1536, time: 2012-10-11 13:43:50.763937, event: dispatched, request: pg_info(1 pgs e6:1.e2) v3 -6812> 2012-10-11 13:43:50.763981 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1536, time: 2012-10-11 13:43:50.763981, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.e2) v3 -6811> 2012-10-11 13:43:50.763992 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1536, time: 2012-10-11 13:43:50.763992, event: started, request: pg_info(1 pgs e6:1.e2) v3 -6810> 2012-10-11 13:43:50.764011 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1536, time: 2012-10-11 13:43:50.764011, event: done, request: pg_info(1 pgs e6:1.e2) v3 -6810> 2012-10-11 13:43:50.764024 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 89906) -6809> 2012-10-11 13:43:50.764032 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 585 ==== osd pg remove(epoch 7; pg1.1f; ) v1 ==== 25+0+0 (3789578957 0 0) 0x3009000 con 0x2fe2280 -6808> 2012-10-11 13:43:50.764047 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1537, time: 2012-10-11 13:43:50.046120, event: header_read, request: osd pg remove(epoch 7; pg1.1f; ) v1 -6807> 2012-10-11 13:43:50.764058 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1537, time: 2012-10-11 13:43:50.046127, event: throttled, request: osd pg remove(epoch 7; pg1.1f; ) v1 -6806> 2012-10-11 13:43:50.764069 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1537, time: 2012-10-11 13:43:50.046132, event: all_read, request: osd pg remove(epoch 7; pg1.1f; ) v1 -6805> 2012-10-11 13:43:50.764079 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1537, time: 2012-10-11 13:43:50.764045, event: dispatched, request: osd pg remove(epoch 7; pg1.1f; ) v1 -6804> 2012-10-11 13:43:50.764089 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1537, time: 2012-10-11 13:43:50.764089, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.1f; ) v1 -6811> 2012-10-11 13:43:50.764101 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1537, time: 2012-10-11 13:43:50.764101, event: started, request: osd pg remove(epoch 7; pg1.1f; ) v1 -6810> 2012-10-11 13:43:50.764113 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.1f -6809> 2012-10-11 13:43:50.764133 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.1f 0x27a19d0)/0x27a19d0 -6808> 2012-10-11 13:43:50.764142 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6807> 2012-10-11 13:43:50.764149 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6806> 2012-10-11 13:43:50.764156 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4141 0x308f360 -6805> 2012-10-11 13:43:50.764164 7f440532f700 5 journal submit_entry seq 4141 len 205 (0x28ccc60) -6804> 2012-10-11 13:43:50.764172 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6803> 2012-10-11 13:43:50.764179 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6802> 2012-10-11 13:43:50.764200 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1537, time: 2012-10-11 13:43:50.764200, event: done, request: osd pg remove(epoch 7; pg1.1f; ) v1 -6801> 2012-10-11 13:43:50.764216 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 89881) -6800> 2012-10-11 13:43:50.764226 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 930 ==== pg_info(1 pgs e6:0.e3) v3 ==== 471+0+0 (956401132 0 0) 0x3435380 con 0x2fe2140 -6799> 2012-10-11 13:43:50.764241 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1538, time: 2012-10-11 13:43:49.140537, event: header_read, request: pg_info(1 pgs e6:0.e3) v3 -6798> 2012-10-11 13:43:50.764252 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1538, time: 2012-10-11 13:43:49.140541, event: throttled, request: pg_info(1 pgs e6:0.e3) v3 -6797> 2012-10-11 13:43:50.764262 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1538, time: 2012-10-11 13:43:49.140549, event: all_read, request: pg_info(1 pgs e6:0.e3) v3 -6796> 2012-10-11 13:43:50.764273 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1538, time: 2012-10-11 13:43:50.764240, event: dispatched, request: pg_info(1 pgs e6:0.e3) v3 -6795> 2012-10-11 13:43:50.764283 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1538, time: 2012-10-11 13:43:50.764283, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.e3) v3 -6794> 2012-10-11 13:43:50.764295 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1538, time: 2012-10-11 13:43:50.764295, event: started, request: pg_info(1 pgs e6:0.e3) v3 -6793> 2012-10-11 13:43:50.764313 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1538, time: 2012-10-11 13:43:50.764313, event: done, request: pg_info(1 pgs e6:0.e3) v3 -6792> 2012-10-11 13:43:50.764326 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 89410) -6791> 2012-10-11 13:43:50.764334 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 586 ==== osd pg remove(epoch 7; pg1.20; ) v1 ==== 25+0+0 (3505655614 0 0) 0x3009a80 con 0x2fe2280 -6790> 2012-10-11 13:43:50.764349 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1539, time: 2012-10-11 13:43:50.046170, event: header_read, request: osd pg remove(epoch 7; pg1.20; ) v1 -6789> 2012-10-11 13:43:50.764361 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1539, time: 2012-10-11 13:43:50.046177, event: throttled, request: osd pg remove(epoch 7; pg1.20; ) v1 -6788> 2012-10-11 13:43:50.764371 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1539, time: 2012-10-11 13:43:50.046182, event: all_read, request: osd pg remove(epoch 7; pg1.20; ) v1 -6787> 2012-10-11 13:43:50.764381 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1539, time: 2012-10-11 13:43:50.764348, event: dispatched, request: osd pg remove(epoch 7; pg1.20; ) v1 -6786> 2012-10-11 13:43:50.764392 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1539, time: 2012-10-11 13:43:50.764392, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.20; ) v1 -6785> 2012-10-11 13:43:50.764403 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1539, time: 2012-10-11 13:43:50.764403, event: started, request: osd pg remove(epoch 7; pg1.20; ) v1 -6784> 2012-10-11 13:43:50.764414 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.20 -6783> 2012-10-11 13:43:50.764433 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.20 0x27a19a0)/0x27a19a0 -6782> 2012-10-11 13:43:50.764443 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6781> 2012-10-11 13:43:50.764449 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6780> 2012-10-11 13:43:50.764456 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4142 0x308f1b0 -6779> 2012-10-11 13:43:50.764465 7f440532f700 5 journal submit_entry seq 4142 len 205 (0x29220c0) -6778> 2012-10-11 13:43:50.764474 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6777> 2012-10-11 13:43:50.764481 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6776> 2012-10-11 13:43:50.764502 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1539, time: 2012-10-11 13:43:50.764501, event: done, request: osd pg remove(epoch 7; pg1.20; ) v1 -6775> 2012-10-11 13:43:50.764518 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 89385) -6774> 2012-10-11 13:43:50.764526 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 931 ==== pg_info(1 pgs e6:2.e3) v3 ==== 471+0+0 (1130231169 0 0) 0x34351c0 con 0x2fe2140 -6773> 2012-10-11 13:43:50.764542 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1540, time: 2012-10-11 13:43:49.140552, event: header_read, request: pg_info(1 pgs e6:2.e3) v3 -6772> 2012-10-11 13:43:50.764553 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1540, time: 2012-10-11 13:43:49.140554, event: throttled, request: pg_info(1 pgs e6:2.e3) v3 -6771> 2012-10-11 13:43:50.764564 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1540, time: 2012-10-11 13:43:49.140561, event: all_read, request: pg_info(1 pgs e6:2.e3) v3 -6770> 2012-10-11 13:43:50.764574 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1540, time: 2012-10-11 13:43:50.764541, event: dispatched, request: pg_info(1 pgs e6:2.e3) v3 -6769> 2012-10-11 13:43:50.764585 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1540, time: 2012-10-11 13:43:50.764584, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.e3) v3 -6768> 2012-10-11 13:43:50.764597 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1540, time: 2012-10-11 13:43:50.764597, event: started, request: pg_info(1 pgs e6:2.e3) v3 -6767> 2012-10-11 13:43:50.764616 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1540, time: 2012-10-11 13:43:50.764615, event: done, request: pg_info(1 pgs e6:2.e3) v3 -6766> 2012-10-11 13:43:50.764629 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 88914) -6765> 2012-10-11 13:43:50.764637 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 587 ==== osd pg remove(epoch 7; pg1.27; ) v1 ==== 25+0+0 (715983418 0 0) 0x30091c0 con 0x2fe2280 -6764> 2012-10-11 13:43:50.764652 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1541, time: 2012-10-11 13:43:50.046219, event: header_read, request: osd pg remove(epoch 7; pg1.27; ) v1 -6763> 2012-10-11 13:43:50.764663 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1541, time: 2012-10-11 13:43:50.046226, event: throttled, request: osd pg remove(epoch 7; pg1.27; ) v1 -6762> 2012-10-11 13:43:50.764674 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1541, time: 2012-10-11 13:43:50.046231, event: all_read, request: osd pg remove(epoch 7; pg1.27; ) v1 -6761> 2012-10-11 13:43:50.764685 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1541, time: 2012-10-11 13:43:50.764650, event: dispatched, request: osd pg remove(epoch 7; pg1.27; ) v1 -6760> 2012-10-11 13:43:50.764695 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1541, time: 2012-10-11 13:43:50.764695, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.27; ) v1 -6759> 2012-10-11 13:43:50.764707 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1541, time: 2012-10-11 13:43:50.764706, event: started, request: osd pg remove(epoch 7; pg1.27; ) v1 -6758> 2012-10-11 13:43:50.764717 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.27 -6757> 2012-10-11 13:43:50.764737 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.27 0x27a1850)/0x27a1850 -6756> 2012-10-11 13:43:50.764747 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6755> 2012-10-11 13:43:50.764753 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6754> 2012-10-11 13:43:50.764760 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4143 0x308f090 -6753> 2012-10-11 13:43:50.764769 7f440532f700 5 journal submit_entry seq 4143 len 205 (0x2922ae0) -6752> 2012-10-11 13:43:50.764777 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6751> 2012-10-11 13:43:50.764784 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6750> 2012-10-11 13:43:50.764808 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1541, time: 2012-10-11 13:43:50.764808, event: done, request: osd pg remove(epoch 7; pg1.27; ) v1 -6749> 2012-10-11 13:43:50.764824 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 88889) -6748> 2012-10-11 13:43:50.764832 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 932 ==== pg_info(1 pgs e6:2.e8) v3 ==== 471+0+0 (2729440305 0 0) 0x3435000 con 0x2fe2140 -6747> 2012-10-11 13:43:50.764848 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1542, time: 2012-10-11 13:43:49.140564, event: header_read, request: pg_info(1 pgs e6:2.e8) v3 -6746> 2012-10-11 13:43:50.764859 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1542, time: 2012-10-11 13:43:49.140566, event: throttled, request: pg_info(1 pgs e6:2.e8) v3 -6745> 2012-10-11 13:43:50.764870 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1542, time: 2012-10-11 13:43:49.140574, event: all_read, request: pg_info(1 pgs e6:2.e8) v3 -6744> 2012-10-11 13:43:50.764880 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1542, time: 2012-10-11 13:43:50.764847, event: dispatched, request: pg_info(1 pgs e6:2.e8) v3 -6743> 2012-10-11 13:43:50.764891 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1542, time: 2012-10-11 13:43:50.764891, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.e8) v3 -6742> 2012-10-11 13:43:50.764902 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1542, time: 2012-10-11 13:43:50.764902, event: started, request: pg_info(1 pgs e6:2.e8) v3 -6741> 2012-10-11 13:43:50.764921 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1542, time: 2012-10-11 13:43:50.764921, event: done, request: pg_info(1 pgs e6:2.e8) v3 -6740> 2012-10-11 13:43:50.764934 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 88418) -6739> 2012-10-11 13:43:50.764943 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 588 ==== osd pg remove(epoch 7; pg1.21; ) v1 ==== 25+0+0 (2580050457 0 0) 0x3009380 con 0x2fe2280 -6738> 2012-10-11 13:43:50.764957 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1543, time: 2012-10-11 13:43:50.046268, event: header_read, request: osd pg remove(epoch 7; pg1.21; ) v1 -6737> 2012-10-11 13:43:50.764969 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1543, time: 2012-10-11 13:43:50.046275, event: throttled, request: osd pg remove(epoch 7; pg1.21; ) v1 -6736> 2012-10-11 13:43:50.764980 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1543, time: 2012-10-11 13:43:50.046280, event: all_read, request: osd pg remove(epoch 7; pg1.21; ) v1 -6735> 2012-10-11 13:43:50.764990 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1543, time: 2012-10-11 13:43:50.764956, event: dispatched, request: osd pg remove(epoch 7; pg1.21; ) v1 -6734> 2012-10-11 13:43:50.765001 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1543, time: 2012-10-11 13:43:50.765001, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.21; ) v1 -6733> 2012-10-11 13:43:50.765012 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1543, time: 2012-10-11 13:43:50.765012, event: started, request: osd pg remove(epoch 7; pg1.21; ) v1 -6732> 2012-10-11 13:43:50.765023 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.21 -6731> 2012-10-11 13:43:50.765042 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.21 0x27a1970)/0x27a1970 -6730> 2012-10-11 13:43:50.765053 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6729> 2012-10-11 13:43:50.765059 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6728> 2012-10-11 13:43:50.765066 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4144 0x308f510 -6727> 2012-10-11 13:43:50.765075 7f440532f700 5 journal submit_entry seq 4144 len 205 (0x296f1b0) -6726> 2012-10-11 13:43:50.765083 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6725> 2012-10-11 13:43:50.765091 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6724> 2012-10-11 13:43:50.765111 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1543, time: 2012-10-11 13:43:50.765111, event: done, request: osd pg remove(epoch 7; pg1.21; ) v1 -6723> 2012-10-11 13:43:50.765128 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 88393) -6722> 2012-10-11 13:43:50.765136 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 933 ==== pg_info(1 pgs e6:1.dc) v3 ==== 471+0+0 (1439785208 0 0) 0x2dc6e00 con 0x2fe2140 -6721> 2012-10-11 13:43:50.765152 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1544, time: 2012-10-11 13:43:49.140576, event: header_read, request: pg_info(1 pgs e6:1.dc) v3 -6720> 2012-10-11 13:43:50.765163 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1544, time: 2012-10-11 13:43:49.140579, event: throttled, request: pg_info(1 pgs e6:1.dc) v3 -6719> 2012-10-11 13:43:50.765173 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1544, time: 2012-10-11 13:43:49.140589, event: all_read, request: pg_info(1 pgs e6:1.dc) v3 -6718> 2012-10-11 13:43:50.765184 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1544, time: 2012-10-11 13:43:50.765150, event: dispatched, request: pg_info(1 pgs e6:1.dc) v3 -6717> 2012-10-11 13:43:50.765194 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1544, time: 2012-10-11 13:43:50.765194, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.dc) v3 -6716> 2012-10-11 13:43:50.765206 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1544, time: 2012-10-11 13:43:50.765206, event: started, request: pg_info(1 pgs e6:1.dc) v3 -6715> 2012-10-11 13:43:50.765224 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1544, time: 2012-10-11 13:43:50.765224, event: done, request: pg_info(1 pgs e6:1.dc) v3 -6714> 2012-10-11 13:43:50.765238 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 87922) -6713> 2012-10-11 13:43:50.765246 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 589 ==== osd pg remove(epoch 7; pg1.33; ) v1 ==== 25+0+0 (2412151267 0 0) 0x3009540 con 0x2fe2280 -6712> 2012-10-11 13:43:50.765270 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1545, time: 2012-10-11 13:43:50.046318, event: header_read, request: osd pg remove(epoch 7; pg1.33; ) v1 -6711> 2012-10-11 13:43:50.765281 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1545, time: 2012-10-11 13:43:50.046325, event: throttled, request: osd pg remove(epoch 7; pg1.33; ) v1 -6710> 2012-10-11 13:43:50.765292 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1545, time: 2012-10-11 13:43:50.046330, event: all_read, request: osd pg remove(epoch 7; pg1.33; ) v1 -6709> 2012-10-11 13:43:50.765302 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1545, time: 2012-10-11 13:43:50.765268, event: dispatched, request: osd pg remove(epoch 7; pg1.33; ) v1 -6708> 2012-10-11 13:43:50.765313 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1545, time: 2012-10-11 13:43:50.765313, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.33; ) v1 -6707> 2012-10-11 13:43:50.765325 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1545, time: 2012-10-11 13:43:50.765325, event: started, request: osd pg remove(epoch 7; pg1.33; ) v1 -6706> 2012-10-11 13:43:50.765335 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.33 -6705> 2012-10-11 13:43:50.765355 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.33 0x27a1a10)/0x27a1a10 -6704> 2012-10-11 13:43:50.765366 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6703> 2012-10-11 13:43:50.765373 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6702> 2012-10-11 13:43:50.765380 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4145 0x308f480 -6701> 2012-10-11 13:43:50.765389 7f440532f700 5 journal submit_entry seq 4145 len 205 (0x2922900) -6700> 2012-10-11 13:43:50.765397 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6699> 2012-10-11 13:43:50.765404 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6698> 2012-10-11 13:43:50.765429 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1545, time: 2012-10-11 13:43:50.765429, event: done, request: osd pg remove(epoch 7; pg1.33; ) v1 -6697> 2012-10-11 13:43:50.765446 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 87897) -6696> 2012-10-11 13:43:50.765455 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 934 ==== pg_info(1 pgs e6:0.dd) v3 ==== 471+0+0 (2734311325 0 0) 0x2dc6c40 con 0x2fe2140 -6695> 2012-10-11 13:43:50.765471 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1546, time: 2012-10-11 13:43:49.140591, event: header_read, request: pg_info(1 pgs e6:0.dd) v3 -6694> 2012-10-11 13:43:50.765482 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1546, time: 2012-10-11 13:43:49.140594, event: throttled, request: pg_info(1 pgs e6:0.dd) v3 -6693> 2012-10-11 13:43:50.765492 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1546, time: 2012-10-11 13:43:49.140601, event: all_read, request: pg_info(1 pgs e6:0.dd) v3 -6692> 2012-10-11 13:43:50.765503 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1546, time: 2012-10-11 13:43:50.765469, event: dispatched, request: pg_info(1 pgs e6:0.dd) v3 -6691> 2012-10-11 13:43:50.765514 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1546, time: 2012-10-11 13:43:50.765514, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.dd) v3 -6690> 2012-10-11 13:43:50.765525 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1546, time: 2012-10-11 13:43:50.765525, event: started, request: pg_info(1 pgs e6:0.dd) v3 -6689> 2012-10-11 13:43:50.765544 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1546, time: 2012-10-11 13:43:50.765544, event: done, request: pg_info(1 pgs e6:0.dd) v3 -6688> 2012-10-11 13:43:50.765558 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 87426) -6687> 2012-10-11 13:43:50.765566 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 590 ==== osd pg remove(epoch 7; pg1.40; ) v1 ==== 25+0+0 (3354698133 0 0) 0x22bf000 con 0x2fe2280 -6686> 2012-10-11 13:43:50.765581 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1547, time: 2012-10-11 13:43:50.046368, event: header_read, request: osd pg remove(epoch 7; pg1.40; ) v1 -6685> 2012-10-11 13:43:50.765592 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1547, time: 2012-10-11 13:43:50.046375, event: throttled, request: osd pg remove(epoch 7; pg1.40; ) v1 -6684> 2012-10-11 13:43:50.765603 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1547, time: 2012-10-11 13:43:50.046380, event: all_read, request: osd pg remove(epoch 7; pg1.40; ) v1 -6683> 2012-10-11 13:43:50.765613 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1547, time: 2012-10-11 13:43:50.765580, event: dispatched, request: osd pg remove(epoch 7; pg1.40; ) v1 -6682> 2012-10-11 13:43:50.765624 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1547, time: 2012-10-11 13:43:50.765624, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.40; ) v1 -6681> 2012-10-11 13:43:50.765636 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1547, time: 2012-10-11 13:43:50.765636, event: started, request: osd pg remove(epoch 7; pg1.40; ) v1 -6680> 2012-10-11 13:43:50.765646 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.40 -6679> 2012-10-11 13:43:50.765665 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.40 0x27a1fa0)/0x27a1fa0 -6678> 2012-10-11 13:43:50.765675 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6677> 2012-10-11 13:43:50.765682 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6676> 2012-10-11 13:43:50.765689 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4146 0x308f2d0 -6675> 2012-10-11 13:43:50.765697 7f440532f700 5 journal submit_entry seq 4146 len 205 (0x29c6720) -6674> 2012-10-11 13:43:50.765706 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6673> 2012-10-11 13:43:50.765713 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6672> 2012-10-11 13:43:50.765735 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1547, time: 2012-10-11 13:43:50.765735, event: done, request: osd pg remove(epoch 7; pg1.40; ) v1 -6671> 2012-10-11 13:43:50.765752 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 87401) -6670> 2012-10-11 13:43:50.765760 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 935 ==== pg_info(1 pgs e6:0.ea) v3 ==== 471+0+0 (4089239491 0 0) 0x2dc6a80 con 0x2fe2140 -6669> 2012-10-11 13:43:50.765776 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1548, time: 2012-10-11 13:43:49.140604, event: header_read, request: pg_info(1 pgs e6:0.ea) v3 -6668> 2012-10-11 13:43:50.765786 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1548, time: 2012-10-11 13:43:49.140606, event: throttled, request: pg_info(1 pgs e6:0.ea) v3 -6667> 2012-10-11 13:43:50.765797 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1548, time: 2012-10-11 13:43:49.140614, event: all_read, request: pg_info(1 pgs e6:0.ea) v3 -6666> 2012-10-11 13:43:50.765808 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1548, time: 2012-10-11 13:43:50.765774, event: dispatched, request: pg_info(1 pgs e6:0.ea) v3 -6665> 2012-10-11 13:43:50.765819 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1548, time: 2012-10-11 13:43:50.765819, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.ea) v3 -6664> 2012-10-11 13:43:50.765830 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1548, time: 2012-10-11 13:43:50.765830, event: started, request: pg_info(1 pgs e6:0.ea) v3 -6663> 2012-10-11 13:43:50.765849 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1548, time: 2012-10-11 13:43:50.765849, event: done, request: pg_info(1 pgs e6:0.ea) v3 -6662> 2012-10-11 13:43:50.765862 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 86930) -6661> 2012-10-11 13:43:50.765870 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 591 ==== osd pg remove(epoch 7; pg1.44; ) v1 ==== 25+0+0 (3874038776 0 0) 0x22bf1c0 con 0x2fe2280 -6660> 2012-10-11 13:43:50.765885 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1549, time: 2012-10-11 13:43:50.046418, event: header_read, request: osd pg remove(epoch 7; pg1.44; ) v1 -6659> 2012-10-11 13:43:50.765896 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1549, time: 2012-10-11 13:43:50.046425, event: throttled, request: osd pg remove(epoch 7; pg1.44; ) v1 -6658> 2012-10-11 13:43:50.765907 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1549, time: 2012-10-11 13:43:50.046430, event: all_read, request: osd pg remove(epoch 7; pg1.44; ) v1 -6657> 2012-10-11 13:43:50.765917 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1549, time: 2012-10-11 13:43:50.765884, event: dispatched, request: osd pg remove(epoch 7; pg1.44; ) v1 -6656> 2012-10-11 13:43:50.765928 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1549, time: 2012-10-11 13:43:50.765928, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.44; ) v1 -6655> 2012-10-11 13:43:50.765939 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1549, time: 2012-10-11 13:43:50.765939, event: started, request: osd pg remove(epoch 7; pg1.44; ) v1 -6654> 2012-10-11 13:43:50.765949 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.44 -6653> 2012-10-11 13:43:50.765969 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.44 0x27a1ee0)/0x27a1ee0 -6652> 2012-10-11 13:43:50.765979 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6651> 2012-10-11 13:43:50.765985 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6650> 2012-10-11 13:43:50.765992 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4147 0x308fcf0 -6649> 2012-10-11 13:43:50.766001 7f440532f700 5 journal submit_entry seq 4147 len 205 (0x2a692a0) -6648> 2012-10-11 13:43:50.766009 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6647> 2012-10-11 13:43:50.766016 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6646> 2012-10-11 13:43:50.766038 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1549, time: 2012-10-11 13:43:50.766038, event: done, request: osd pg remove(epoch 7; pg1.44; ) v1 -6645> 2012-10-11 13:43:50.766055 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 86905) -6644> 2012-10-11 13:43:50.766063 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 936 ==== pg_info(1 pgs e6:0.dc) v3 ==== 471+0+0 (1544226545 0 0) 0x2dc68c0 con 0x2fe2140 -6643> 2012-10-11 13:43:50.766079 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1550, time: 2012-10-11 13:43:49.253430, event: header_read, request: pg_info(1 pgs e6:0.dc) v3 -6642> 2012-10-11 13:43:50.766090 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1550, time: 2012-10-11 13:43:49.253450, event: throttled, request: pg_info(1 pgs e6:0.dc) v3 -6641> 2012-10-11 13:43:50.766100 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1550, time: 2012-10-11 13:43:49.253470, event: all_read, request: pg_info(1 pgs e6:0.dc) v3 -6640> 2012-10-11 13:43:50.766111 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1550, time: 2012-10-11 13:43:50.766077, event: dispatched, request: pg_info(1 pgs e6:0.dc) v3 -6639> 2012-10-11 13:43:50.766122 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1550, time: 2012-10-11 13:43:50.766122, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.dc) v3 -6638> 2012-10-11 13:43:50.766133 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1550, time: 2012-10-11 13:43:50.766133, event: started, request: pg_info(1 pgs e6:0.dc) v3 -6637> 2012-10-11 13:43:50.766151 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1550, time: 2012-10-11 13:43:50.766151, event: done, request: pg_info(1 pgs e6:0.dc) v3 -6636> 2012-10-11 13:43:50.766165 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 86434) -6635> 2012-10-11 13:43:50.766173 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 592 ==== osd pg remove(epoch 7; pg1.46; ) v1 ==== 25+0+0 (1955715510 0 0) 0x22bf380 con 0x2fe2280 -6634> 2012-10-11 13:43:50.766190 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1551, time: 2012-10-11 13:43:50.046468, event: header_read, request: osd pg remove(epoch 7; pg1.46; ) v1 -6633> 2012-10-11 13:43:50.766201 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1551, time: 2012-10-11 13:43:50.046475, event: throttled, request: osd pg remove(epoch 7; pg1.46; ) v1 -6632> 2012-10-11 13:43:50.766212 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1551, time: 2012-10-11 13:43:50.046481, event: all_read, request: osd pg remove(epoch 7; pg1.46; ) v1 -6631> 2012-10-11 13:43:50.766222 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1551, time: 2012-10-11 13:43:50.766188, event: dispatched, request: osd pg remove(epoch 7; pg1.46; ) v1 -6630> 2012-10-11 13:43:50.766233 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1551, time: 2012-10-11 13:43:50.766233, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.46; ) v1 -6629> 2012-10-11 13:43:50.766245 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1551, time: 2012-10-11 13:43:50.766245, event: started, request: osd pg remove(epoch 7; pg1.46; ) v1 -6628> 2012-10-11 13:43:50.766255 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.46 -6627> 2012-10-11 13:43:50.766275 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.46 0x27a1e80)/0x27a1e80 -6626> 2012-10-11 13:43:50.766284 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6625> 2012-10-11 13:43:50.766291 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6624> 2012-10-11 13:43:50.766298 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4148 0x308fb40 -6623> 2012-10-11 13:43:50.766307 7f440532f700 5 journal submit_entry seq 4148 len 205 (0x2a69720) -6622> 2012-10-11 13:43:50.766315 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6621> 2012-10-11 13:43:50.766322 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6620> 2012-10-11 13:43:50.766343 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1551, time: 2012-10-11 13:43:50.766343, event: done, request: osd pg remove(epoch 7; pg1.46; ) v1 -6619> 2012-10-11 13:43:50.766359 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 86409) -6618> 2012-10-11 13:43:50.766368 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 937 ==== pg_info(1 pgs e6:1.e9) v3 ==== 471+0+0 (645353691 0 0) 0x2dc6700 con 0x2fe2140 -6617> 2012-10-11 13:43:50.766383 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1552, time: 2012-10-11 13:43:49.253477, event: header_read, request: pg_info(1 pgs e6:1.e9) v3 -6616> 2012-10-11 13:43:50.766394 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1552, time: 2012-10-11 13:43:49.253480, event: throttled, request: pg_info(1 pgs e6:1.e9) v3 -6615> 2012-10-11 13:43:50.766405 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1552, time: 2012-10-11 13:43:49.253490, event: all_read, request: pg_info(1 pgs e6:1.e9) v3 -6614> 2012-10-11 13:43:50.766415 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1552, time: 2012-10-11 13:43:50.766382, event: dispatched, request: pg_info(1 pgs e6:1.e9) v3 -6613> 2012-10-11 13:43:50.766425 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1552, time: 2012-10-11 13:43:50.766425, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.e9) v3 -6612> 2012-10-11 13:43:50.766437 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1552, time: 2012-10-11 13:43:50.766437, event: started, request: pg_info(1 pgs e6:1.e9) v3 -6611> 2012-10-11 13:43:50.766456 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1552, time: 2012-10-11 13:43:50.766456, event: done, request: pg_info(1 pgs e6:1.e9) v3 -6610> 2012-10-11 13:43:50.766469 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 85938) -6609> 2012-10-11 13:43:50.766478 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 593 ==== osd pg remove(epoch 7; pg1.47; ) v1 ==== 25+0+0 (1034790033 0 0) 0x22bf540 con 0x2fe2280 -6608> 2012-10-11 13:43:50.766493 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1553, time: 2012-10-11 13:43:50.046518, event: header_read, request: osd pg remove(epoch 7; pg1.47; ) v1 -6607> 2012-10-11 13:43:50.766504 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1553, time: 2012-10-11 13:43:50.046525, event: throttled, request: osd pg remove(epoch 7; pg1.47; ) v1 -6606> 2012-10-11 13:43:50.766515 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1553, time: 2012-10-11 13:43:50.046530, event: all_read, request: osd pg remove(epoch 7; pg1.47; ) v1 -6605> 2012-10-11 13:43:50.766526 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1553, time: 2012-10-11 13:43:50.766492, event: dispatched, request: osd pg remove(epoch 7; pg1.47; ) v1 -6604> 2012-10-11 13:43:50.766536 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1553, time: 2012-10-11 13:43:50.766536, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.47; ) v1 -6603> 2012-10-11 13:43:50.766548 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1553, time: 2012-10-11 13:43:50.766548, event: started, request: osd pg remove(epoch 7; pg1.47; ) v1 -6602> 2012-10-11 13:43:50.766559 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.47 -6601> 2012-10-11 13:43:50.766579 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.47 0x27a1e50)/0x27a1e50 -6600> 2012-10-11 13:43:50.766589 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6599> 2012-10-11 13:43:50.766596 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6598> 2012-10-11 13:43:50.766603 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4149 0x2a06a20 -6597> 2012-10-11 13:43:50.766612 7f440532f700 5 journal submit_entry seq 4149 len 205 (0x2a69d50) -6596> 2012-10-11 13:43:50.766620 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6595> 2012-10-11 13:43:50.766627 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6594> 2012-10-11 13:43:50.766648 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1553, time: 2012-10-11 13:43:50.766648, event: done, request: osd pg remove(epoch 7; pg1.47; ) v1 -6593> 2012-10-11 13:43:50.766664 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 85913) -6592> 2012-10-11 13:43:50.766673 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 938 ==== pg_info(1 pgs e6:1.e4) v3 ==== 471+0+0 (377124494 0 0) 0x2dc6540 con 0x2fe2140 -6591> 2012-10-11 13:43:50.766689 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1554, time: 2012-10-11 13:43:49.253493, event: header_read, request: pg_info(1 pgs e6:1.e4) v3 -6590> 2012-10-11 13:43:50.766700 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1554, time: 2012-10-11 13:43:49.253496, event: throttled, request: pg_info(1 pgs e6:1.e4) v3 -6589> 2012-10-11 13:43:50.766710 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1554, time: 2012-10-11 13:43:49.253504, event: all_read, request: pg_info(1 pgs e6:1.e4) v3 -6588> 2012-10-11 13:43:50.766720 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1554, time: 2012-10-11 13:43:50.766687, event: dispatched, request: pg_info(1 pgs e6:1.e4) v3 -6587> 2012-10-11 13:43:50.766731 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1554, time: 2012-10-11 13:43:50.766731, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.e4) v3 -6586> 2012-10-11 13:43:50.766743 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1554, time: 2012-10-11 13:43:50.766742, event: started, request: pg_info(1 pgs e6:1.e4) v3 -6585> 2012-10-11 13:43:50.766761 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1554, time: 2012-10-11 13:43:50.766761, event: done, request: pg_info(1 pgs e6:1.e4) v3 -6584> 2012-10-11 13:43:50.766774 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 85442) -6583> 2012-10-11 13:43:50.766783 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 594 ==== osd pg remove(epoch 7; pg1.48; ) v1 ==== 25+0+0 (2244977999 0 0) 0x22bf700 con 0x2fe2280 -6582> 2012-10-11 13:43:50.766798 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1555, time: 2012-10-11 13:43:50.046568, event: header_read, request: osd pg remove(epoch 7; pg1.48; ) v1 -6581> 2012-10-11 13:43:50.766809 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1555, time: 2012-10-11 13:43:50.046575, event: throttled, request: osd pg remove(epoch 7; pg1.48; ) v1 -6580> 2012-10-11 13:43:50.766819 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1555, time: 2012-10-11 13:43:50.046580, event: all_read, request: osd pg remove(epoch 7; pg1.48; ) v1 -6579> 2012-10-11 13:43:50.766830 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1555, time: 2012-10-11 13:43:50.766796, event: dispatched, request: osd pg remove(epoch 7; pg1.48; ) v1 -6578> 2012-10-11 13:43:50.766840 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1555, time: 2012-10-11 13:43:50.766840, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.48; ) v1 -6577> 2012-10-11 13:43:50.766852 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1555, time: 2012-10-11 13:43:50.766852, event: started, request: osd pg remove(epoch 7; pg1.48; ) v1 -6576> 2012-10-11 13:43:50.766862 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.48 -6575> 2012-10-11 13:43:50.766882 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.48 0x27a1e20)/0x27a1e20 -6574> 2012-10-11 13:43:50.766891 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6573> 2012-10-11 13:43:50.766898 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6572> 2012-10-11 13:43:50.766905 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4150 0x2a066c0 -6571> 2012-10-11 13:43:50.766914 7f440532f700 5 journal submit_entry seq 4150 len 205 (0x2ab5570) -6570> 2012-10-11 13:43:50.766925 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6569> 2012-10-11 13:43:50.766932 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6568> 2012-10-11 13:43:50.766954 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1555, time: 2012-10-11 13:43:50.766954, event: done, request: osd pg remove(epoch 7; pg1.48; ) v1 -6567> 2012-10-11 13:43:50.766971 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 85417) -6566> 2012-10-11 13:43:50.766980 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 939 ==== pg_info(1 pgs e6:0.e5) v3 ==== 471+0+0 (833661821 0 0) 0x2dc6380 con 0x2fe2140 -6565> 2012-10-11 13:43:50.766995 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1556, time: 2012-10-11 13:43:49.253507, event: header_read, request: pg_info(1 pgs e6:0.e5) v3 -6564> 2012-10-11 13:43:50.767007 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1556, time: 2012-10-11 13:43:49.253509, event: throttled, request: pg_info(1 pgs e6:0.e5) v3 -6563> 2012-10-11 13:43:50.767017 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1556, time: 2012-10-11 13:43:49.253516, event: all_read, request: pg_info(1 pgs e6:0.e5) v3 -6562> 2012-10-11 13:43:50.767027 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1556, time: 2012-10-11 13:43:50.766994, event: dispatched, request: pg_info(1 pgs e6:0.e5) v3 -6561> 2012-10-11 13:43:50.767038 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1556, time: 2012-10-11 13:43:50.767038, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.e5) v3 -6560> 2012-10-11 13:43:50.767049 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1556, time: 2012-10-11 13:43:50.767049, event: started, request: pg_info(1 pgs e6:0.e5) v3 -6559> 2012-10-11 13:43:50.767068 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1556, time: 2012-10-11 13:43:50.767068, event: done, request: pg_info(1 pgs e6:0.e5) v3 -6558> 2012-10-11 13:43:50.767082 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 84946) -6557> 2012-10-11 13:43:50.767091 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 595 ==== osd pg remove(epoch 7; pg1.4b; ) v1 ==== 25+0+0 (1586176550 0 0) 0x22bf8c0 con 0x2fe2280 -6556> 2012-10-11 13:43:50.767105 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1557, time: 2012-10-11 13:43:50.046617, event: header_read, request: osd pg remove(epoch 7; pg1.4b; ) v1 -6555> 2012-10-11 13:43:50.767116 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1557, time: 2012-10-11 13:43:50.046624, event: throttled, request: osd pg remove(epoch 7; pg1.4b; ) v1 -6554> 2012-10-11 13:43:50.767127 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1557, time: 2012-10-11 13:43:50.046629, event: all_read, request: osd pg remove(epoch 7; pg1.4b; ) v1 -6553> 2012-10-11 13:43:50.767137 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1557, time: 2012-10-11 13:43:50.767104, event: dispatched, request: osd pg remove(epoch 7; pg1.4b; ) v1 -6552> 2012-10-11 13:43:50.767148 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1557, time: 2012-10-11 13:43:50.767148, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.4b; ) v1 -6551> 2012-10-11 13:43:50.767159 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1557, time: 2012-10-11 13:43:50.767159, event: started, request: osd pg remove(epoch 7; pg1.4b; ) v1 -6550> 2012-10-11 13:43:50.767170 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.4b -6549> 2012-10-11 13:43:50.767189 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.4b 0x2adb190)/0x2adb190 -6557> 2012-10-11 13:43:50.767199 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6556> 2012-10-11 13:43:50.767206 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6555> 2012-10-11 13:43:50.767213 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4151 0x2a06d80 -6554> 2012-10-11 13:43:50.767221 7f440532f700 5 journal submit_entry seq 4151 len 205 (0x2ab5390) -6553> 2012-10-11 13:43:50.767230 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6552> 2012-10-11 13:43:50.767237 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6551> 2012-10-11 13:43:50.767261 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1557, time: 2012-10-11 13:43:50.767261, event: done, request: osd pg remove(epoch 7; pg1.4b; ) v1 -6550> 2012-10-11 13:43:50.767278 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 84921) -6549> 2012-10-11 13:43:50.767286 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 940 ==== pg_info(1 pgs e6:1.bc) v3 ==== 471+0+0 (3824830030 0 0) 0x2dc61c0 con 0x2fe2140 -6548> 2012-10-11 13:43:50.767302 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1558, time: 2012-10-11 13:43:49.253519, event: header_read, request: pg_info(1 pgs e6:1.bc) v3 -6547> 2012-10-11 13:43:50.767314 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1558, time: 2012-10-11 13:43:49.253522, event: throttled, request: pg_info(1 pgs e6:1.bc) v3 -6546> 2012-10-11 13:43:50.767324 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1558, time: 2012-10-11 13:43:49.253529, event: all_read, request: pg_info(1 pgs e6:1.bc) v3 -6545> 2012-10-11 13:43:50.767335 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1558, time: 2012-10-11 13:43:50.767300, event: dispatched, request: pg_info(1 pgs e6:1.bc) v3 -6544> 2012-10-11 13:43:50.767345 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1558, time: 2012-10-11 13:43:50.767345, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.bc) v3 -6543> 2012-10-11 13:43:50.767357 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1558, time: 2012-10-11 13:43:50.767357, event: started, request: pg_info(1 pgs e6:1.bc) v3 -6542> 2012-10-11 13:43:50.767377 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1558, time: 2012-10-11 13:43:50.767376, event: done, request: pg_info(1 pgs e6:1.bc) v3 -6541> 2012-10-11 13:43:50.767391 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 84450) -6540> 2012-10-11 13:43:50.767400 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 596 ==== osd pg remove(epoch 7; pg1.51; ) v1 ==== 25+0+0 (180278534 0 0) 0x22bfa80 con 0x2fe2280 -6539> 2012-10-11 13:43:50.767415 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1559, time: 2012-10-11 13:43:50.046666, event: header_read, request: osd pg remove(epoch 7; pg1.51; ) v1 -6538> 2012-10-11 13:43:50.767426 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1559, time: 2012-10-11 13:43:50.046673, event: throttled, request: osd pg remove(epoch 7; pg1.51; ) v1 -6537> 2012-10-11 13:43:50.767436 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1559, time: 2012-10-11 13:43:50.046678, event: all_read, request: osd pg remove(epoch 7; pg1.51; ) v1 -6536> 2012-10-11 13:43:50.767447 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1559, time: 2012-10-11 13:43:50.767413, event: dispatched, request: osd pg remove(epoch 7; pg1.51; ) v1 -6535> 2012-10-11 13:43:50.767457 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1559, time: 2012-10-11 13:43:50.767457, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.51; ) v1 -6534> 2012-10-11 13:43:50.767469 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1559, time: 2012-10-11 13:43:50.767469, event: started, request: osd pg remove(epoch 7; pg1.51; ) v1 -6533> 2012-10-11 13:43:50.767479 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.51 -6532> 2012-10-11 13:43:50.767499 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.51 0x2adb070)/0x2adb070 -6531> 2012-10-11 13:43:50.767508 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6530> 2012-10-11 13:43:50.767515 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6529> 2012-10-11 13:43:50.767522 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4152 0x2a06990 -6528> 2012-10-11 13:43:50.767531 7f440532f700 5 journal submit_entry seq 4152 len 205 (0x2ab59f0) -6527> 2012-10-11 13:43:50.767539 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6526> 2012-10-11 13:43:50.767546 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6525> 2012-10-11 13:43:50.767569 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1559, time: 2012-10-11 13:43:50.767569, event: done, request: osd pg remove(epoch 7; pg1.51; ) v1 -6524> 2012-10-11 13:43:50.767585 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 84425) -6523> 2012-10-11 13:43:50.767594 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 941 ==== pg_info(1 pgs e6:1.b8) v3 ==== 471+0+0 (3213085054 0 0) 0x2dc6000 con 0x2fe2140 -6522> 2012-10-11 13:43:50.767610 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1560, time: 2012-10-11 13:43:49.253532, event: header_read, request: pg_info(1 pgs e6:1.b8) v3 -6521> 2012-10-11 13:43:50.767621 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1560, time: 2012-10-11 13:43:49.253534, event: throttled, request: pg_info(1 pgs e6:1.b8) v3 -6520> 2012-10-11 13:43:50.767631 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1560, time: 2012-10-11 13:43:49.253543, event: all_read, request: pg_info(1 pgs e6:1.b8) v3 -6519> 2012-10-11 13:43:50.767642 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1560, time: 2012-10-11 13:43:50.767608, event: dispatched, request: pg_info(1 pgs e6:1.b8) v3 -6518> 2012-10-11 13:43:50.767652 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1560, time: 2012-10-11 13:43:50.767652, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.b8) v3 -6517> 2012-10-11 13:43:50.767664 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1560, time: 2012-10-11 13:43:50.767664, event: started, request: pg_info(1 pgs e6:1.b8) v3 -6516> 2012-10-11 13:43:50.767683 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1560, time: 2012-10-11 13:43:50.767683, event: done, request: pg_info(1 pgs e6:1.b8) v3 -6515> 2012-10-11 13:43:50.767696 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 83954) -6514> 2012-10-11 13:43:50.767705 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 597 ==== osd pg remove(epoch 7; pg1.59; ) v1 ==== 25+0+0 (1216729564 0 0) 0x22bfe00 con 0x2fe2280 -6513> 2012-10-11 13:43:50.767720 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1561, time: 2012-10-11 13:43:50.046716, event: header_read, request: osd pg remove(epoch 7; pg1.59; ) v1 -6512> 2012-10-11 13:43:50.767731 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1561, time: 2012-10-11 13:43:50.046723, event: throttled, request: osd pg remove(epoch 7; pg1.59; ) v1 -6511> 2012-10-11 13:43:50.767742 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1561, time: 2012-10-11 13:43:50.046728, event: all_read, request: osd pg remove(epoch 7; pg1.59; ) v1 -6510> 2012-10-11 13:43:50.767752 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1561, time: 2012-10-11 13:43:50.767718, event: dispatched, request: osd pg remove(epoch 7; pg1.59; ) v1 -6509> 2012-10-11 13:43:50.767763 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1561, time: 2012-10-11 13:43:50.767763, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.59; ) v1 -6508> 2012-10-11 13:43:50.767775 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1561, time: 2012-10-11 13:43:50.767774, event: started, request: osd pg remove(epoch 7; pg1.59; ) v1 -6507> 2012-10-11 13:43:50.767785 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.59 -6506> 2012-10-11 13:43:50.767804 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.59 0x2adb2f0)/0x2adb2f0 -6505> 2012-10-11 13:43:50.767814 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6504> 2012-10-11 13:43:50.767821 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6503> 2012-10-11 13:43:50.767828 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4153 0x2a06870 -6502> 2012-10-11 13:43:50.767836 7f440532f700 5 journal submit_entry seq 4153 len 205 (0x2b102a0) -6501> 2012-10-11 13:43:50.767845 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6500> 2012-10-11 13:43:50.767851 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6499> 2012-10-11 13:43:50.767874 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1561, time: 2012-10-11 13:43:50.767874, event: done, request: osd pg remove(epoch 7; pg1.59; ) v1 -6498> 2012-10-11 13:43:50.767891 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 83929) -6497> 2012-10-11 13:43:50.767899 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 942 ==== pg_info(1 pgs e6:0.b9) v3 ==== 471+0+0 (1270652237 0 0) 0x255ae00 con 0x2fe2140 -6496> 2012-10-11 13:43:50.767915 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1562, time: 2012-10-11 13:43:49.253546, event: header_read, request: pg_info(1 pgs e6:0.b9) v3 -6495> 2012-10-11 13:43:50.767926 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1562, time: 2012-10-11 13:43:49.253548, event: throttled, request: pg_info(1 pgs e6:0.b9) v3 -6494> 2012-10-11 13:43:50.767936 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1562, time: 2012-10-11 13:43:49.253558, event: all_read, request: pg_info(1 pgs e6:0.b9) v3 -6493> 2012-10-11 13:43:50.767946 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1562, time: 2012-10-11 13:43:50.767913, event: dispatched, request: pg_info(1 pgs e6:0.b9) v3 -6492> 2012-10-11 13:43:50.767957 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1562, time: 2012-10-11 13:43:50.767957, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.b9) v3 -6491> 2012-10-11 13:43:50.767969 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1562, time: 2012-10-11 13:43:50.767969, event: started, request: pg_info(1 pgs e6:0.b9) v3 -6490> 2012-10-11 13:43:50.767987 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1562, time: 2012-10-11 13:43:50.767987, event: done, request: pg_info(1 pgs e6:0.b9) v3 -6489> 2012-10-11 13:43:50.768001 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 83458) -6488> 2012-10-11 13:43:50.768009 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 598 ==== osd pg remove(epoch 7; pg1.5a; ) v1 ==== 25+0+0 (2478921397 0 0) 0x236ae00 con 0x2fe2280 -6487> 2012-10-11 13:43:50.768024 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1563, time: 2012-10-11 13:43:50.046766, event: header_read, request: osd pg remove(epoch 7; pg1.5a; ) v1 -6486> 2012-10-11 13:43:50.768035 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1563, time: 2012-10-11 13:43:50.046773, event: throttled, request: osd pg remove(epoch 7; pg1.5a; ) v1 -6485> 2012-10-11 13:43:50.768046 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1563, time: 2012-10-11 13:43:50.046780, event: all_read, request: osd pg remove(epoch 7; pg1.5a; ) v1 -6484> 2012-10-11 13:43:50.768056 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1563, time: 2012-10-11 13:43:50.768023, event: dispatched, request: osd pg remove(epoch 7; pg1.5a; ) v1 -6483> 2012-10-11 13:43:50.768067 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1563, time: 2012-10-11 13:43:50.768067, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.5a; ) v1 -6482> 2012-10-11 13:43:50.768079 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1563, time: 2012-10-11 13:43:50.768079, event: started, request: osd pg remove(epoch 7; pg1.5a; ) v1 -6481> 2012-10-11 13:43:50.768089 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.5a -6480> 2012-10-11 13:43:50.768110 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.5a 0x2adb2c0)/0x2adb2c0 -6479> 2012-10-11 13:43:50.768120 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6478> 2012-10-11 13:43:50.768127 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6477> 2012-10-11 13:43:50.768134 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4154 0x2a06630 -6476> 2012-10-11 13:43:50.768143 7f440532f700 5 journal submit_entry seq 4154 len 205 (0x2b5d390) -6475> 2012-10-11 13:43:50.768151 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6474> 2012-10-11 13:43:50.768158 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6473> 2012-10-11 13:43:50.768179 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1563, time: 2012-10-11 13:43:50.768179, event: done, request: osd pg remove(epoch 7; pg1.5a; ) v1 -6472> 2012-10-11 13:43:50.768195 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 83433) -6471> 2012-10-11 13:43:50.768204 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 943 ==== pg_info(1 pgs e6:2.bb) v3 ==== 471+0+0 (1995665427 0 0) 0x255ac40 con 0x2fe2140 -6470> 2012-10-11 13:43:50.768220 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1564, time: 2012-10-11 13:43:49.253561, event: header_read, request: pg_info(1 pgs e6:2.bb) v3 -6469> 2012-10-11 13:43:50.768231 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1564, time: 2012-10-11 13:43:49.253564, event: throttled, request: pg_info(1 pgs e6:2.bb) v3 -6468> 2012-10-11 13:43:50.768241 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1564, time: 2012-10-11 13:43:49.253571, event: all_read, request: pg_info(1 pgs e6:2.bb) v3 -6467> 2012-10-11 13:43:50.768251 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1564, time: 2012-10-11 13:43:50.768218, event: dispatched, request: pg_info(1 pgs e6:2.bb) v3 -6466> 2012-10-11 13:43:50.768262 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1564, time: 2012-10-11 13:43:50.768262, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.bb) v3 -6465> 2012-10-11 13:43:50.768273 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1564, time: 2012-10-11 13:43:50.768273, event: started, request: pg_info(1 pgs e6:2.bb) v3 -6464> 2012-10-11 13:43:50.768292 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1564, time: 2012-10-11 13:43:50.768291, event: done, request: pg_info(1 pgs e6:2.bb) v3 -6463> 2012-10-11 13:43:50.768305 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 82962) -6462> 2012-10-11 13:43:50.768313 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 599 ==== osd pg remove(epoch 7; pg1.5f; ) v1 ==== 25+0+0 (4225804799 0 0) 0x236ac40 con 0x2fe2280 -6461> 2012-10-11 13:43:50.768328 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1565, time: 2012-10-11 13:43:50.046818, event: header_read, request: osd pg remove(epoch 7; pg1.5f; ) v1 -6460> 2012-10-11 13:43:50.768339 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1565, time: 2012-10-11 13:43:50.046825, event: throttled, request: osd pg remove(epoch 7; pg1.5f; ) v1 -6459> 2012-10-11 13:43:50.768350 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1565, time: 2012-10-11 13:43:50.046831, event: all_read, request: osd pg remove(epoch 7; pg1.5f; ) v1 -6458> 2012-10-11 13:43:50.768360 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1565, time: 2012-10-11 13:43:50.768326, event: dispatched, request: osd pg remove(epoch 7; pg1.5f; ) v1 -6457> 2012-10-11 13:43:50.768371 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1565, time: 2012-10-11 13:43:50.768371, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.5f; ) v1 -6456> 2012-10-11 13:43:50.768383 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1565, time: 2012-10-11 13:43:50.768383, event: started, request: osd pg remove(epoch 7; pg1.5f; ) v1 -6455> 2012-10-11 13:43:50.768393 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.5f -6454> 2012-10-11 13:43:50.768413 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.5f 0x2adb5d0)/0x2adb5d0 -6453> 2012-10-11 13:43:50.768422 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6452> 2012-10-11 13:43:50.768429 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6451> 2012-10-11 13:43:50.768436 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4155 0x2a06750 -6450> 2012-10-11 13:43:50.768445 7f440532f700 5 journal submit_entry seq 4155 len 205 (0x2b5d1b0) -6449> 2012-10-11 13:43:50.768453 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6448> 2012-10-11 13:43:50.768461 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6447> 2012-10-11 13:43:50.768484 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1565, time: 2012-10-11 13:43:50.768484, event: done, request: osd pg remove(epoch 7; pg1.5f; ) v1 -6446> 2012-10-11 13:43:50.768502 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 82937) -6445> 2012-10-11 13:43:50.768511 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 944 ==== pg_info(1 pgs e6:2.b7) v3 ==== 471+0+0 (3389853670 0 0) 0x255aa80 con 0x2fe2140 -6444> 2012-10-11 13:43:50.768527 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1566, time: 2012-10-11 13:43:49.253574, event: header_read, request: pg_info(1 pgs e6:2.b7) v3 -6443> 2012-10-11 13:43:50.768538 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1566, time: 2012-10-11 13:43:49.253576, event: throttled, request: pg_info(1 pgs e6:2.b7) v3 -6442> 2012-10-11 13:43:50.768548 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1566, time: 2012-10-11 13:43:49.253584, event: all_read, request: pg_info(1 pgs e6:2.b7) v3 -6441> 2012-10-11 13:43:50.768558 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1566, time: 2012-10-11 13:43:50.768525, event: dispatched, request: pg_info(1 pgs e6:2.b7) v3 -6440> 2012-10-11 13:43:50.768569 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1566, time: 2012-10-11 13:43:50.768568, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.b7) v3 -6439> 2012-10-11 13:43:50.768580 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1566, time: 2012-10-11 13:43:50.768580, event: started, request: pg_info(1 pgs e6:2.b7) v3 -6438> 2012-10-11 13:43:50.768599 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1566, time: 2012-10-11 13:43:50.768599, event: done, request: pg_info(1 pgs e6:2.b7) v3 -6437> 2012-10-11 13:43:50.768612 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 82466) -6436> 2012-10-11 13:43:50.768621 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 600 ==== osd pg remove(epoch 7; pg1.6d; ) v1 ==== 25+0+0 (3773710236 0 0) 0x236aa80 con 0x2fe2280 -6435> 2012-10-11 13:43:50.768635 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1567, time: 2012-10-11 13:43:50.046869, event: header_read, request: osd pg remove(epoch 7; pg1.6d; ) v1 -6434> 2012-10-11 13:43:50.768646 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1567, time: 2012-10-11 13:43:50.046876, event: throttled, request: osd pg remove(epoch 7; pg1.6d; ) v1 -6433> 2012-10-11 13:43:50.768657 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1567, time: 2012-10-11 13:43:50.046881, event: all_read, request: osd pg remove(epoch 7; pg1.6d; ) v1 -6432> 2012-10-11 13:43:50.768668 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1567, time: 2012-10-11 13:43:50.768634, event: dispatched, request: osd pg remove(epoch 7; pg1.6d; ) v1 -6431> 2012-10-11 13:43:50.768678 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1567, time: 2012-10-11 13:43:50.768678, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.6d; ) v1 -6430> 2012-10-11 13:43:50.768690 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1567, time: 2012-10-11 13:43:50.768690, event: started, request: osd pg remove(epoch 7; pg1.6d; ) v1 -6429> 2012-10-11 13:43:50.768700 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.6d -6428> 2012-10-11 13:43:50.768721 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.6d 0x2adb730)/0x2adb730 -6427> 2012-10-11 13:43:50.768731 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6426> 2012-10-11 13:43:50.768738 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6425> 2012-10-11 13:43:50.768746 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4156 0x2d2df30 -6424> 2012-10-11 13:43:50.768755 7f440532f700 5 journal submit_entry seq 4156 len 205 (0x2b5de40) -6423> 2012-10-11 13:43:50.768763 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6422> 2012-10-11 13:43:50.768770 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6421> 2012-10-11 13:43:50.768795 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1567, time: 2012-10-11 13:43:50.768795, event: done, request: osd pg remove(epoch 7; pg1.6d; ) v1 -6420> 2012-10-11 13:43:50.768813 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 82441) -6419> 2012-10-11 13:43:50.768822 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 945 ==== pg_info(1 pgs e6:2.ad) v3 ==== 471+0+0 (3703917950 0 0) 0x255a8c0 con 0x2fe2140 -6418> 2012-10-11 13:43:50.768838 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1568, time: 2012-10-11 13:43:49.253587, event: header_read, request: pg_info(1 pgs e6:2.ad) v3 -6417> 2012-10-11 13:43:50.768849 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1568, time: 2012-10-11 13:43:49.253589, event: throttled, request: pg_info(1 pgs e6:2.ad) v3 -6416> 2012-10-11 13:43:50.768863 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1568, time: 2012-10-11 13:43:49.253597, event: all_read, request: pg_info(1 pgs e6:2.ad) v3 -6415> 2012-10-11 13:43:50.768873 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1568, time: 2012-10-11 13:43:50.768836, event: dispatched, request: pg_info(1 pgs e6:2.ad) v3 -6414> 2012-10-11 13:43:50.768884 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1568, time: 2012-10-11 13:43:50.768884, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.ad) v3 -6413> 2012-10-11 13:43:50.768895 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1568, time: 2012-10-11 13:43:50.768895, event: started, request: pg_info(1 pgs e6:2.ad) v3 -6412> 2012-10-11 13:43:50.768914 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1568, time: 2012-10-11 13:43:50.768914, event: done, request: pg_info(1 pgs e6:2.ad) v3 -6411> 2012-10-11 13:43:50.768927 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 81970) -6410> 2012-10-11 13:43:50.768936 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 601 ==== osd pg remove(epoch 7; pg1.6e; ) v1 ==== 25+0+0 (1001044213 0 0) 0x236a8c0 con 0x2fe2280 -6409> 2012-10-11 13:43:50.768951 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1569, time: 2012-10-11 13:43:50.046919, event: header_read, request: osd pg remove(epoch 7; pg1.6e; ) v1 -6408> 2012-10-11 13:43:50.768962 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1569, time: 2012-10-11 13:43:50.046926, event: throttled, request: osd pg remove(epoch 7; pg1.6e; ) v1 -6407> 2012-10-11 13:43:50.768973 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1569, time: 2012-10-11 13:43:50.046931, event: all_read, request: osd pg remove(epoch 7; pg1.6e; ) v1 -6406> 2012-10-11 13:43:50.768983 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1569, time: 2012-10-11 13:43:50.768949, event: dispatched, request: osd pg remove(epoch 7; pg1.6e; ) v1 -6405> 2012-10-11 13:43:50.768994 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1569, time: 2012-10-11 13:43:50.768994, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.6e; ) v1 -6404> 2012-10-11 13:43:50.769005 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1569, time: 2012-10-11 13:43:50.769005, event: started, request: osd pg remove(epoch 7; pg1.6e; ) v1 -6403> 2012-10-11 13:43:50.769016 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.6e -6402> 2012-10-11 13:43:50.769035 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.6e 0x2adb700)/0x2adb700 -6401> 2012-10-11 13:43:50.769044 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6400> 2012-10-11 13:43:50.769051 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6399> 2012-10-11 13:43:50.769058 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4157 0x2d2dea0 -6398> 2012-10-11 13:43:50.769067 7f440532f700 5 journal submit_entry seq 4157 len 205 (0x2c1f9f0) -6397> 2012-10-11 13:43:50.769075 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6396> 2012-10-11 13:43:50.769083 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6395> 2012-10-11 13:43:50.769104 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1569, time: 2012-10-11 13:43:50.769103, event: done, request: osd pg remove(epoch 7; pg1.6e; ) v1 -6394> 2012-10-11 13:43:50.769120 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 81945) -6393> 2012-10-11 13:43:50.769130 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 946 ==== pg_info(1 pgs e6:1.ae) v3 ==== 471+0+0 (2415035224 0 0) 0x255a700 con 0x2fe2140 -6392> 2012-10-11 13:43:50.769146 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1570, time: 2012-10-11 13:43:49.253600, event: header_read, request: pg_info(1 pgs e6:1.ae) v3 -6391> 2012-10-11 13:43:50.769157 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1570, time: 2012-10-11 13:43:49.253602, event: throttled, request: pg_info(1 pgs e6:1.ae) v3 -6390> 2012-10-11 13:43:50.769167 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1570, time: 2012-10-11 13:43:49.253609, event: all_read, request: pg_info(1 pgs e6:1.ae) v3 -6389> 2012-10-11 13:43:50.769177 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1570, time: 2012-10-11 13:43:50.769144, event: dispatched, request: pg_info(1 pgs e6:1.ae) v3 -6388> 2012-10-11 13:43:50.769188 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1570, time: 2012-10-11 13:43:50.769188, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.ae) v3 -6387> 2012-10-11 13:43:50.769200 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1570, time: 2012-10-11 13:43:50.769200, event: started, request: pg_info(1 pgs e6:1.ae) v3 -6386> 2012-10-11 13:43:50.769220 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1570, time: 2012-10-11 13:43:50.769220, event: done, request: pg_info(1 pgs e6:1.ae) v3 -6385> 2012-10-11 13:43:50.769233 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 81474) -6384> 2012-10-11 13:43:50.769242 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 602 ==== osd pg remove(epoch 7; pg1.72; ) v1 ==== 25+0+0 (3707385846 0 0) 0x236a700 con 0x2fe2280 -6383> 2012-10-11 13:43:50.769266 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1571, time: 2012-10-11 13:43:50.046968, event: header_read, request: osd pg remove(epoch 7; pg1.72; ) v1 -6382> 2012-10-11 13:43:50.769278 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1571, time: 2012-10-11 13:43:50.046975, event: throttled, request: osd pg remove(epoch 7; pg1.72; ) v1 -6381> 2012-10-11 13:43:50.769290 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1571, time: 2012-10-11 13:43:50.046980, event: all_read, request: osd pg remove(epoch 7; pg1.72; ) v1 -6380> 2012-10-11 13:43:50.769300 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1571, time: 2012-10-11 13:43:50.769264, event: dispatched, request: osd pg remove(epoch 7; pg1.72; ) v1 -6379> 2012-10-11 13:43:50.769311 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1571, time: 2012-10-11 13:43:50.769311, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.72; ) v1 -6378> 2012-10-11 13:43:50.769322 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1571, time: 2012-10-11 13:43:50.769322, event: started, request: osd pg remove(epoch 7; pg1.72; ) v1 -6377> 2012-10-11 13:43:50.769333 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.72 -6376> 2012-10-11 13:43:50.769353 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.72 0x2adb640)/0x2adb640 -6375> 2012-10-11 13:43:50.769362 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6374> 2012-10-11 13:43:50.769369 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6373> 2012-10-11 13:43:50.769376 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4158 0x2d2de10 -6372> 2012-10-11 13:43:50.769385 7f440532f700 5 journal submit_entry seq 4158 len 205 (0x2c1f810) -6371> 2012-10-11 13:43:50.769393 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6370> 2012-10-11 13:43:50.769400 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6369> 2012-10-11 13:43:50.769423 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1571, time: 2012-10-11 13:43:50.769423, event: done, request: osd pg remove(epoch 7; pg1.72; ) v1 -6368> 2012-10-11 13:43:50.769439 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 81449) -6367> 2012-10-11 13:43:50.769447 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 947 ==== pg_info(1 pgs e6:0.af) v3 ==== 471+0+0 (4153881826 0 0) 0x255a540 con 0x2fe2140 -6366> 2012-10-11 13:43:50.769463 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1572, time: 2012-10-11 13:43:49.253612, event: header_read, request: pg_info(1 pgs e6:0.af) v3 -6365> 2012-10-11 13:43:50.769474 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1572, time: 2012-10-11 13:43:49.253614, event: throttled, request: pg_info(1 pgs e6:0.af) v3 -6364> 2012-10-11 13:43:50.769484 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1572, time: 2012-10-11 13:43:49.253622, event: all_read, request: pg_info(1 pgs e6:0.af) v3 -6363> 2012-10-11 13:43:50.769494 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1572, time: 2012-10-11 13:43:50.769462, event: dispatched, request: pg_info(1 pgs e6:0.af) v3 -6362> 2012-10-11 13:43:50.769505 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1572, time: 2012-10-11 13:43:50.769505, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.af) v3 -6361> 2012-10-11 13:43:50.769517 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1572, time: 2012-10-11 13:43:50.769517, event: started, request: pg_info(1 pgs e6:0.af) v3 -6360> 2012-10-11 13:43:50.769536 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1572, time: 2012-10-11 13:43:50.769536, event: done, request: pg_info(1 pgs e6:0.af) v3 -6359> 2012-10-11 13:43:50.769549 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 80978) -6358> 2012-10-11 13:43:50.769558 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 603 ==== osd pg remove(epoch 7; pg1.79; ) v1 ==== 25+0+0 (1166390341 0 0) 0x236a540 con 0x2fe2280 -6357> 2012-10-11 13:43:50.769572 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1573, time: 2012-10-11 13:43:50.047017, event: header_read, request: osd pg remove(epoch 7; pg1.79; ) v1 -6356> 2012-10-11 13:43:50.769583 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1573, time: 2012-10-11 13:43:50.047024, event: throttled, request: osd pg remove(epoch 7; pg1.79; ) v1 -6355> 2012-10-11 13:43:50.769594 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1573, time: 2012-10-11 13:43:50.047029, event: all_read, request: osd pg remove(epoch 7; pg1.79; ) v1 -6354> 2012-10-11 13:43:50.769604 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1573, time: 2012-10-11 13:43:50.769571, event: dispatched, request: osd pg remove(epoch 7; pg1.79; ) v1 -6353> 2012-10-11 13:43:50.769614 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1573, time: 2012-10-11 13:43:50.769614, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.79; ) v1 -6352> 2012-10-11 13:43:50.769626 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1573, time: 2012-10-11 13:43:50.769626, event: started, request: osd pg remove(epoch 7; pg1.79; ) v1 -6351> 2012-10-11 13:43:50.769636 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.79 -6350> 2012-10-11 13:43:50.769656 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.79 0x2adb8f0)/0x2adb8f0 -6349> 2012-10-11 13:43:50.769665 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6348> 2012-10-11 13:43:50.769673 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6347> 2012-10-11 13:43:50.769679 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4159 0x2d2dd80 -6346> 2012-10-11 13:43:50.769688 7f440532f700 5 journal submit_entry seq 4159 len 205 (0x2c78480) -6345> 2012-10-11 13:43:50.769696 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6344> 2012-10-11 13:43:50.769703 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6343> 2012-10-11 13:43:50.769726 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1573, time: 2012-10-11 13:43:50.769726, event: done, request: osd pg remove(epoch 7; pg1.79; ) v1 -6342> 2012-10-11 13:43:50.769743 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 80953) -6341> 2012-10-11 13:43:50.769751 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 948 ==== pg_info(1 pgs e6:0.ac) v3 ==== 471+0+0 (746822777 0 0) 0x255a380 con 0x2fe2140 -6340> 2012-10-11 13:43:50.769767 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1574, time: 2012-10-11 13:43:49.253625, event: header_read, request: pg_info(1 pgs e6:0.ac) v3 -6339> 2012-10-11 13:43:50.769778 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1574, time: 2012-10-11 13:43:49.253627, event: throttled, request: pg_info(1 pgs e6:0.ac) v3 -6338> 2012-10-11 13:43:50.769788 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1574, time: 2012-10-11 13:43:49.253635, event: all_read, request: pg_info(1 pgs e6:0.ac) v3 -6337> 2012-10-11 13:43:50.769798 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1574, time: 2012-10-11 13:43:50.769765, event: dispatched, request: pg_info(1 pgs e6:0.ac) v3 -6336> 2012-10-11 13:43:50.769810 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1574, time: 2012-10-11 13:43:50.769810, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.ac) v3 -6335> 2012-10-11 13:43:50.769821 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1574, time: 2012-10-11 13:43:50.769821, event: started, request: pg_info(1 pgs e6:0.ac) v3 -6334> 2012-10-11 13:43:50.769840 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1574, time: 2012-10-11 13:43:50.769840, event: done, request: pg_info(1 pgs e6:0.ac) v3 -6333> 2012-10-11 13:43:50.769853 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 80482) -6332> 2012-10-11 13:43:50.769862 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 604 ==== osd pg remove(epoch 7; pg1.7a; ) v1 ==== 25+0+0 (2663461676 0 0) 0x236a380 con 0x2fe2280 -6331> 2012-10-11 13:43:50.769877 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1575, time: 2012-10-11 13:43:50.047072, event: header_read, request: osd pg remove(epoch 7; pg1.7a; ) v1 -6330> 2012-10-11 13:43:50.769888 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1575, time: 2012-10-11 13:43:50.047079, event: throttled, request: osd pg remove(epoch 7; pg1.7a; ) v1 -6329> 2012-10-11 13:43:50.769899 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1575, time: 2012-10-11 13:43:50.047084, event: all_read, request: osd pg remove(epoch 7; pg1.7a; ) v1 -6328> 2012-10-11 13:43:50.769909 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1575, time: 2012-10-11 13:43:50.769875, event: dispatched, request: osd pg remove(epoch 7; pg1.7a; ) v1 -6327> 2012-10-11 13:43:50.769920 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1575, time: 2012-10-11 13:43:50.769919, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.7a; ) v1 -6326> 2012-10-11 13:43:50.769931 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1575, time: 2012-10-11 13:43:50.769931, event: started, request: osd pg remove(epoch 7; pg1.7a; ) v1 -6325> 2012-10-11 13:43:50.769941 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.7a -6324> 2012-10-11 13:43:50.769961 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.7a 0x2adb8c0)/0x2adb8c0 -6323> 2012-10-11 13:43:50.769970 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6322> 2012-10-11 13:43:50.769977 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6321> 2012-10-11 13:43:50.769985 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4160 0x2d2dcf0 -6320> 2012-10-11 13:43:50.769994 7f440532f700 5 journal submit_entry seq 4160 len 205 (0x2c78d50) -6319> 2012-10-11 13:43:50.770002 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6318> 2012-10-11 13:43:50.770010 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6317> 2012-10-11 13:43:50.770031 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1575, time: 2012-10-11 13:43:50.770031, event: done, request: osd pg remove(epoch 7; pg1.7a; ) v1 -6316> 2012-10-11 13:43:50.770047 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 80457) -6315> 2012-10-11 13:43:50.770055 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 949 ==== pg_info(1 pgs e6:1.ab) v3 ==== 471+0+0 (954909081 0 0) 0x255a1c0 con 0x2fe2140 -6314> 2012-10-11 13:43:50.770071 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1576, time: 2012-10-11 13:43:49.253638, event: header_read, request: pg_info(1 pgs e6:1.ab) v3 -6313> 2012-10-11 13:43:50.770082 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1576, time: 2012-10-11 13:43:49.253640, event: throttled, request: pg_info(1 pgs e6:1.ab) v3 -6312> 2012-10-11 13:43:50.770092 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1576, time: 2012-10-11 13:43:49.253650, event: all_read, request: pg_info(1 pgs e6:1.ab) v3 -6311> 2012-10-11 13:43:50.770102 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1576, time: 2012-10-11 13:43:50.770070, event: dispatched, request: pg_info(1 pgs e6:1.ab) v3 -6310> 2012-10-11 13:43:50.770113 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1576, time: 2012-10-11 13:43:50.770113, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.ab) v3 -6309> 2012-10-11 13:43:50.770124 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1576, time: 2012-10-11 13:43:50.770124, event: started, request: pg_info(1 pgs e6:1.ab) v3 -6308> 2012-10-11 13:43:50.770143 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1576, time: 2012-10-11 13:43:50.770143, event: done, request: pg_info(1 pgs e6:1.ab) v3 -6307> 2012-10-11 13:43:50.770156 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 79986) -6306> 2012-10-11 13:43:50.770165 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 605 ==== osd_map(8..8 src has 1..8) v3 ==== 168+0+0 (3498318630 0 0) 0x3327400 con 0x2fe2280 -6305> 2012-10-11 13:43:50.770181 7f440532f700 3 osd.0 8 handle_osd_map epochs [8,8], i have 8, src has [1,8] -6304> 2012-10-11 13:43:50.770191 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 168 (0xb7c748 -> 79818) -6303> 2012-10-11 13:43:50.770200 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 950 ==== pg_info(1 pgs e6:2.aa) v3 ==== 471+0+0 (1362733616 0 0) 0x255a000 con 0x2fe2140 -6302> 2012-10-11 13:43:50.770214 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1577, time: 2012-10-11 13:43:49.253653, event: header_read, request: pg_info(1 pgs e6:2.aa) v3 -6301> 2012-10-11 13:43:50.770224 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1577, time: 2012-10-11 13:43:49.253655, event: throttled, request: pg_info(1 pgs e6:2.aa) v3 -6300> 2012-10-11 13:43:50.770235 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1577, time: 2012-10-11 13:43:49.253663, event: all_read, request: pg_info(1 pgs e6:2.aa) v3 -6299> 2012-10-11 13:43:50.770245 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1577, time: 2012-10-11 13:43:50.770212, event: dispatched, request: pg_info(1 pgs e6:2.aa) v3 -6298> 2012-10-11 13:43:50.770255 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1577, time: 2012-10-11 13:43:50.770255, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.aa) v3 -6297> 2012-10-11 13:43:50.770267 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1577, time: 2012-10-11 13:43:50.770267, event: started, request: pg_info(1 pgs e6:2.aa) v3 -6296> 2012-10-11 13:43:50.770285 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1577, time: 2012-10-11 13:43:50.770285, event: done, request: pg_info(1 pgs e6:2.aa) v3 -6295> 2012-10-11 13:43:50.770298 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 79347) -6294> 2012-10-11 13:43:50.770307 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 606 ==== pg_query(1.94 epoch 8) v2 ==== 109+0+0 (1317175359 0 0) 0x236a1c0 con 0x2fe2280 -6293> 2012-10-11 13:43:50.770322 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1578, time: 2012-10-11 13:43:50.305868, event: header_read, request: pg_query(1.94 epoch 8) v2 -6292> 2012-10-11 13:43:50.770332 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1578, time: 2012-10-11 13:43:50.305870, event: throttled, request: pg_query(1.94 epoch 8) v2 -6291> 2012-10-11 13:43:50.770342 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1578, time: 2012-10-11 13:43:50.305877, event: all_read, request: pg_query(1.94 epoch 8) v2 -6290> 2012-10-11 13:43:50.770353 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1578, time: 2012-10-11 13:43:50.770320, event: dispatched, request: pg_query(1.94 epoch 8) v2 -6289> 2012-10-11 13:43:50.770363 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1578, time: 2012-10-11 13:43:50.770363, event: waiting_for_osdmap, request: pg_query(1.94 epoch 8) v2 -6288> 2012-10-11 13:43:50.770375 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1578, time: 2012-10-11 13:43:50.770375, event: started, request: pg_query(1.94 epoch 8) v2 -6287> 2012-10-11 13:43:50.770392 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1578, time: 2012-10-11 13:43:50.770392, event: done, request: pg_query(1.94 epoch 8) v2 -6286> 2012-10-11 13:43:50.770405 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 79238) -6285> 2012-10-11 13:43:50.770413 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 951 ==== pg_info(1 pgs e6:2.a5) v3 ==== 471+0+0 (1893800887 0 0) 0x27cae00 con 0x2fe2140 -6284> 2012-10-11 13:43:50.770428 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1579, time: 2012-10-11 13:43:49.253666, event: header_read, request: pg_info(1 pgs e6:2.a5) v3 -6283> 2012-10-11 13:43:50.770438 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1579, time: 2012-10-11 13:43:49.253669, event: throttled, request: pg_info(1 pgs e6:2.a5) v3 -6282> 2012-10-11 13:43:50.770448 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1579, time: 2012-10-11 13:43:49.253676, event: all_read, request: pg_info(1 pgs e6:2.a5) v3 -6281> 2012-10-11 13:43:50.770458 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1579, time: 2012-10-11 13:43:50.770426, event: dispatched, request: pg_info(1 pgs e6:2.a5) v3 -6280> 2012-10-11 13:43:50.770469 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1579, time: 2012-10-11 13:43:50.770469, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.a5) v3 -6279> 2012-10-11 13:43:50.770480 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1579, time: 2012-10-11 13:43:50.770480, event: started, request: pg_info(1 pgs e6:2.a5) v3 -6278> 2012-10-11 13:43:50.770498 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1579, time: 2012-10-11 13:43:50.770498, event: done, request: pg_info(1 pgs e6:2.a5) v3 -6277> 2012-10-11 13:43:50.770511 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 78767) -6276> 2012-10-11 13:43:50.770519 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 607 ==== pg_query(0.95 epoch 8) v2 ==== 109+0+0 (2366112011 0 0) 0x236a000 con 0x2fe2280 -6275> 2012-10-11 13:43:50.770534 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1580, time: 2012-10-11 13:43:50.305880, event: header_read, request: pg_query(0.95 epoch 8) v2 -6274> 2012-10-11 13:43:50.770544 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1580, time: 2012-10-11 13:43:50.305882, event: throttled, request: pg_query(0.95 epoch 8) v2 -6273> 2012-10-11 13:43:50.770554 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1580, time: 2012-10-11 13:43:50.305887, event: all_read, request: pg_query(0.95 epoch 8) v2 -6272> 2012-10-11 13:43:50.770564 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1580, time: 2012-10-11 13:43:50.770532, event: dispatched, request: pg_query(0.95 epoch 8) v2 -6271> 2012-10-11 13:43:50.770575 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1580, time: 2012-10-11 13:43:50.770575, event: waiting_for_osdmap, request: pg_query(0.95 epoch 8) v2 -6270> 2012-10-11 13:43:50.770586 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1580, time: 2012-10-11 13:43:50.770586, event: started, request: pg_query(0.95 epoch 8) v2 -6269> 2012-10-11 13:43:50.770602 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1580, time: 2012-10-11 13:43:50.770602, event: done, request: pg_query(0.95 epoch 8) v2 -6268> 2012-10-11 13:43:50.770614 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 78658) -6267> 2012-10-11 13:43:50.770622 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 952 ==== pg_info(1 pgs e6:1.a6) v3 ==== 471+0+0 (2889513496 0 0) 0x27cac40 con 0x2fe2140 -6266> 2012-10-11 13:43:50.770637 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1581, time: 2012-10-11 13:43:49.253679, event: header_read, request: pg_info(1 pgs e6:1.a6) v3 -6265> 2012-10-11 13:43:50.770648 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1581, time: 2012-10-11 13:43:49.253682, event: throttled, request: pg_info(1 pgs e6:1.a6) v3 -6264> 2012-10-11 13:43:50.770658 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1581, time: 2012-10-11 13:43:49.253689, event: all_read, request: pg_info(1 pgs e6:1.a6) v3 -6263> 2012-10-11 13:43:50.770668 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1581, time: 2012-10-11 13:43:50.770635, event: dispatched, request: pg_info(1 pgs e6:1.a6) v3 -6262> 2012-10-11 13:43:50.770679 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1581, time: 2012-10-11 13:43:50.770678, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.a6) v3 -6261> 2012-10-11 13:43:50.770690 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1581, time: 2012-10-11 13:43:50.770690, event: started, request: pg_info(1 pgs e6:1.a6) v3 -6260> 2012-10-11 13:43:50.770708 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1581, time: 2012-10-11 13:43:50.770708, event: done, request: pg_info(1 pgs e6:1.a6) v3 -6259> 2012-10-11 13:43:50.770721 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 78187) -6258> 2012-10-11 13:43:50.770729 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 608 ==== pg_query(1.94 epoch 8) v2 ==== 109+0+0 (3788036480 0 0) 0x302ee00 con 0x2fe2280 -6257> 2012-10-11 13:43:50.770744 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1582, time: 2012-10-11 13:43:50.305889, event: header_read, request: pg_query(1.94 epoch 8) v2 -6256> 2012-10-11 13:43:50.770755 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1582, time: 2012-10-11 13:43:50.305891, event: throttled, request: pg_query(1.94 epoch 8) v2 -6255> 2012-10-11 13:43:50.770765 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1582, time: 2012-10-11 13:43:50.305897, event: all_read, request: pg_query(1.94 epoch 8) v2 -6254> 2012-10-11 13:43:50.770775 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1582, time: 2012-10-11 13:43:50.770742, event: dispatched, request: pg_query(1.94 epoch 8) v2 -6253> 2012-10-11 13:43:50.770785 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1582, time: 2012-10-11 13:43:50.770785, event: waiting_for_osdmap, request: pg_query(1.94 epoch 8) v2 -6252> 2012-10-11 13:43:50.770797 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1582, time: 2012-10-11 13:43:50.770797, event: started, request: pg_query(1.94 epoch 8) v2 -6251> 2012-10-11 13:43:50.770813 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1582, time: 2012-10-11 13:43:50.770813, event: done, request: pg_query(1.94 epoch 8) v2 -6250> 2012-10-11 13:43:50.770826 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 78078) -6249> 2012-10-11 13:43:50.770834 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 953 ==== pg_info(1 pgs e6:0.a7) v3 ==== 471+0+0 (188890596 0 0) 0x27caa80 con 0x2fe2140 -6248> 2012-10-11 13:43:50.770849 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1583, time: 2012-10-11 13:43:49.253692, event: header_read, request: pg_info(1 pgs e6:0.a7) v3 -6247> 2012-10-11 13:43:50.770859 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1583, time: 2012-10-11 13:43:49.253694, event: throttled, request: pg_info(1 pgs e6:0.a7) v3 -6246> 2012-10-11 13:43:50.770869 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1583, time: 2012-10-11 13:43:49.253701, event: all_read, request: pg_info(1 pgs e6:0.a7) v3 -6245> 2012-10-11 13:43:50.770880 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1583, time: 2012-10-11 13:43:50.770847, event: dispatched, request: pg_info(1 pgs e6:0.a7) v3 -6244> 2012-10-11 13:43:50.770890 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1583, time: 2012-10-11 13:43:50.770890, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.a7) v3 -6243> 2012-10-11 13:43:50.770901 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1583, time: 2012-10-11 13:43:50.770901, event: started, request: pg_info(1 pgs e6:0.a7) v3 -6242> 2012-10-11 13:43:50.770918 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1583, time: 2012-10-11 13:43:50.770918, event: done, request: pg_info(1 pgs e6:0.a7) v3 -6241> 2012-10-11 13:43:50.770932 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 77607) -6240> 2012-10-11 13:43:50.770941 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 609 ==== pg_query(1.92 epoch 8) v2 ==== 109+0+0 (1560159701 0 0) 0x302ec40 con 0x2fe2280 -6239> 2012-10-11 13:43:50.770956 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1584, time: 2012-10-11 13:43:50.305900, event: header_read, request: pg_query(1.92 epoch 8) v2 -6238> 2012-10-11 13:43:50.770966 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1584, time: 2012-10-11 13:43:50.305902, event: throttled, request: pg_query(1.92 epoch 8) v2 -6237> 2012-10-11 13:43:50.770977 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1584, time: 2012-10-11 13:43:50.305906, event: all_read, request: pg_query(1.92 epoch 8) v2 -6236> 2012-10-11 13:43:50.770987 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1584, time: 2012-10-11 13:43:50.770954, event: dispatched, request: pg_query(1.92 epoch 8) v2 -6235> 2012-10-11 13:43:50.770997 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1584, time: 2012-10-11 13:43:50.770997, event: waiting_for_osdmap, request: pg_query(1.92 epoch 8) v2 -6234> 2012-10-11 13:43:50.771008 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1584, time: 2012-10-11 13:43:50.771008, event: started, request: pg_query(1.92 epoch 8) v2 -6233> 2012-10-11 13:43:50.771024 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1584, time: 2012-10-11 13:43:50.771024, event: done, request: pg_query(1.92 epoch 8) v2 -6232> 2012-10-11 13:43:50.771037 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 77498) -6231> 2012-10-11 13:43:50.771045 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 954 ==== pg_info(1 pgs e6:2.a0) v3 ==== 471+0+0 (2252534284 0 0) 0x27ca8c0 con 0x2fe2140 -6230> 2012-10-11 13:43:50.771060 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1585, time: 2012-10-11 13:43:49.253704, event: header_read, request: pg_info(1 pgs e6:2.a0) v3 -6229> 2012-10-11 13:43:50.771070 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1585, time: 2012-10-11 13:43:49.253706, event: throttled, request: pg_info(1 pgs e6:2.a0) v3 -6228> 2012-10-11 13:43:50.771081 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1585, time: 2012-10-11 13:43:49.253713, event: all_read, request: pg_info(1 pgs e6:2.a0) v3 -6227> 2012-10-11 13:43:50.771091 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1585, time: 2012-10-11 13:43:50.771058, event: dispatched, request: pg_info(1 pgs e6:2.a0) v3 -6226> 2012-10-11 13:43:50.771101 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1585, time: 2012-10-11 13:43:50.771101, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.a0) v3 -6225> 2012-10-11 13:43:50.771112 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1585, time: 2012-10-11 13:43:50.771112, event: started, request: pg_info(1 pgs e6:2.a0) v3 -6224> 2012-10-11 13:43:50.771130 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1585, time: 2012-10-11 13:43:50.771130, event: done, request: pg_info(1 pgs e6:2.a0) v3 -6223> 2012-10-11 13:43:50.771144 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 77027) -6222> 2012-10-11 13:43:50.771152 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 610 ==== pg_query(2.93 epoch 8) v2 ==== 109+0+0 (329665758 0 0) 0x302ea80 con 0x2fe2280 -6221> 2012-10-11 13:43:50.771167 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1586, time: 2012-10-11 13:43:50.305964, event: header_read, request: pg_query(2.93 epoch 8) v2 -6220> 2012-10-11 13:43:50.771178 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1586, time: 2012-10-11 13:43:50.305974, event: throttled, request: pg_query(2.93 epoch 8) v2 -6219> 2012-10-11 13:43:50.771188 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1586, time: 2012-10-11 13:43:50.305998, event: all_read, request: pg_query(2.93 epoch 8) v2 -6218> 2012-10-11 13:43:50.771198 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1586, time: 2012-10-11 13:43:50.771166, event: dispatched, request: pg_query(2.93 epoch 8) v2 -6217> 2012-10-11 13:43:50.771208 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1586, time: 2012-10-11 13:43:50.771208, event: waiting_for_osdmap, request: pg_query(2.93 epoch 8) v2 -6216> 2012-10-11 13:43:50.771219 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1586, time: 2012-10-11 13:43:50.771219, event: started, request: pg_query(2.93 epoch 8) v2 -6215> 2012-10-11 13:43:50.771235 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1586, time: 2012-10-11 13:43:50.771235, event: done, request: pg_query(2.93 epoch 8) v2 -6214> 2012-10-11 13:43:50.771248 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 76918) -6213> 2012-10-11 13:43:50.771256 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 955 ==== pg_info(1 pgs e6:0.a2) v3 ==== 471+0+0 (1306779813 0 0) 0x27ca700 con 0x2fe2140 -6212> 2012-10-11 13:43:50.771271 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1587, time: 2012-10-11 13:43:49.253715, event: header_read, request: pg_info(1 pgs e6:0.a2) v3 -6211> 2012-10-11 13:43:50.771281 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1587, time: 2012-10-11 13:43:49.253718, event: throttled, request: pg_info(1 pgs e6:0.a2) v3 -6210> 2012-10-11 13:43:50.771292 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1587, time: 2012-10-11 13:43:49.253725, event: all_read, request: pg_info(1 pgs e6:0.a2) v3 -6209> 2012-10-11 13:43:50.771302 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1587, time: 2012-10-11 13:43:50.771269, event: dispatched, request: pg_info(1 pgs e6:0.a2) v3 -6208> 2012-10-11 13:43:50.771312 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1587, time: 2012-10-11 13:43:50.771312, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.a2) v3 -6207> 2012-10-11 13:43:50.771323 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1587, time: 2012-10-11 13:43:50.771323, event: started, request: pg_info(1 pgs e6:0.a2) v3 -6206> 2012-10-11 13:43:50.771340 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1587, time: 2012-10-11 13:43:50.771340, event: done, request: pg_info(1 pgs e6:0.a2) v3 -6205> 2012-10-11 13:43:50.771353 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 76447) -6204> 2012-10-11 13:43:50.771361 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 611 ==== pg_query(1.90 epoch 8) v2 ==== 109+0+0 (1389738355 0 0) 0x302e8c0 con 0x2fe2280 -6203> 2012-10-11 13:43:50.771375 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1588, time: 2012-10-11 13:43:50.306099, event: header_read, request: pg_query(1.90 epoch 8) v2 -6202> 2012-10-11 13:43:50.771386 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1588, time: 2012-10-11 13:43:50.306107, event: throttled, request: pg_query(1.90 epoch 8) v2 -6201> 2012-10-11 13:43:50.771397 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1588, time: 2012-10-11 13:43:50.306115, event: all_read, request: pg_query(1.90 epoch 8) v2 -6200> 2012-10-11 13:43:50.771407 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1588, time: 2012-10-11 13:43:50.771374, event: dispatched, request: pg_query(1.90 epoch 8) v2 -6199> 2012-10-11 13:43:50.771417 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1588, time: 2012-10-11 13:43:50.771417, event: waiting_for_osdmap, request: pg_query(1.90 epoch 8) v2 -6198> 2012-10-11 13:43:50.771428 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1588, time: 2012-10-11 13:43:50.771428, event: started, request: pg_query(1.90 epoch 8) v2 -6197> 2012-10-11 13:43:50.771444 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1588, time: 2012-10-11 13:43:50.771444, event: done, request: pg_query(1.90 epoch 8) v2 -6196> 2012-10-11 13:43:50.771457 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 76338) -6195> 2012-10-11 13:43:50.771465 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 956 ==== pg_info(1 pgs e6:1.a1) v3 ==== 471+0+0 (2236716247 0 0) 0x27ca540 con 0x2fe2140 -6194> 2012-10-11 13:43:50.771479 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1589, time: 2012-10-11 13:43:49.253727, event: header_read, request: pg_info(1 pgs e6:1.a1) v3 -6193> 2012-10-11 13:43:50.771490 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1589, time: 2012-10-11 13:43:49.253730, event: throttled, request: pg_info(1 pgs e6:1.a1) v3 -6192> 2012-10-11 13:43:50.771500 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1589, time: 2012-10-11 13:43:49.253737, event: all_read, request: pg_info(1 pgs e6:1.a1) v3 -6191> 2012-10-11 13:43:50.771510 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1589, time: 2012-10-11 13:43:50.771478, event: dispatched, request: pg_info(1 pgs e6:1.a1) v3 -6190> 2012-10-11 13:43:50.771521 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1589, time: 2012-10-11 13:43:50.771521, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.a1) v3 -6189> 2012-10-11 13:43:50.771532 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1589, time: 2012-10-11 13:43:50.771532, event: started, request: pg_info(1 pgs e6:1.a1) v3 -6188> 2012-10-11 13:43:50.771549 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1589, time: 2012-10-11 13:43:50.771549, event: done, request: pg_info(1 pgs e6:1.a1) v3 -6187> 2012-10-11 13:43:50.771562 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 75867) -6186> 2012-10-11 13:43:50.771570 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 612 ==== pg_query(1.91 epoch 8) v2 ==== 109+0+0 (1438676768 0 0) 0x302e700 con 0x2fe2280 -6185> 2012-10-11 13:43:50.771585 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1590, time: 2012-10-11 13:43:50.306260, event: header_read, request: pg_query(1.91 epoch 8) v2 -6184> 2012-10-11 13:43:50.771595 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1590, time: 2012-10-11 13:43:50.306269, event: throttled, request: pg_query(1.91 epoch 8) v2 -6183> 2012-10-11 13:43:50.771605 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1590, time: 2012-10-11 13:43:50.306286, event: all_read, request: pg_query(1.91 epoch 8) v2 -6182> 2012-10-11 13:43:50.771616 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1590, time: 2012-10-11 13:43:50.771583, event: dispatched, request: pg_query(1.91 epoch 8) v2 -6181> 2012-10-11 13:43:50.771626 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1590, time: 2012-10-11 13:43:50.771626, event: waiting_for_osdmap, request: pg_query(1.91 epoch 8) v2 -6180> 2012-10-11 13:43:50.771637 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1590, time: 2012-10-11 13:43:50.771637, event: started, request: pg_query(1.91 epoch 8) v2 -6179> 2012-10-11 13:43:50.771654 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1590, time: 2012-10-11 13:43:50.771654, event: done, request: pg_query(1.91 epoch 8) v2 -6178> 2012-10-11 13:43:50.771667 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 75758) -6177> 2012-10-11 13:43:50.771675 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 957 ==== pg_info(1 pgs e6:2.99) v3 ==== 471+0+0 (1440664100 0 0) 0x27ca380 con 0x2fe2140 -6176> 2012-10-11 13:43:50.771689 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1591, time: 2012-10-11 13:43:49.253740, event: header_read, request: pg_info(1 pgs e6:2.99) v3 -6175> 2012-10-11 13:43:50.771700 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1591, time: 2012-10-11 13:43:49.253742, event: throttled, request: pg_info(1 pgs e6:2.99) v3 -6174> 2012-10-11 13:43:50.771710 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1591, time: 2012-10-11 13:43:49.253749, event: all_read, request: pg_info(1 pgs e6:2.99) v3 -6173> 2012-10-11 13:43:50.771720 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1591, time: 2012-10-11 13:43:50.771688, event: dispatched, request: pg_info(1 pgs e6:2.99) v3 -6172> 2012-10-11 13:43:50.771731 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1591, time: 2012-10-11 13:43:50.771730, event: waiting_for_osdmap, request: pg_info(1 pgs e6:2.99) v3 -6171> 2012-10-11 13:43:50.771742 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1591, time: 2012-10-11 13:43:50.771742, event: started, request: pg_info(1 pgs e6:2.99) v3 -6170> 2012-10-11 13:43:50.771759 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1591, time: 2012-10-11 13:43:50.771759, event: done, request: pg_info(1 pgs e6:2.99) v3 -6169> 2012-10-11 13:43:50.771772 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 75287) -6168> 2012-10-11 13:43:50.771781 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 613 ==== pg_query(2.8c epoch 8) v2 ==== 109+0+0 (1329443023 0 0) 0x302e540 con 0x2fe2280 -6167> 2012-10-11 13:43:50.771795 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1592, time: 2012-10-11 13:43:50.306400, event: header_read, request: pg_query(2.8c epoch 8) v2 -6166> 2012-10-11 13:43:50.771806 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1592, time: 2012-10-11 13:43:50.306409, event: throttled, request: pg_query(2.8c epoch 8) v2 -6165> 2012-10-11 13:43:50.771816 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1592, time: 2012-10-11 13:43:50.306416, event: all_read, request: pg_query(2.8c epoch 8) v2 -6164> 2012-10-11 13:43:50.771826 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1592, time: 2012-10-11 13:43:50.771794, event: dispatched, request: pg_query(2.8c epoch 8) v2 -6163> 2012-10-11 13:43:50.771836 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1592, time: 2012-10-11 13:43:50.771836, event: waiting_for_osdmap, request: pg_query(2.8c epoch 8) v2 -6162> 2012-10-11 13:43:50.771848 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1592, time: 2012-10-11 13:43:50.771847, event: started, request: pg_query(2.8c epoch 8) v2 -6161> 2012-10-11 13:43:50.771864 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1592, time: 2012-10-11 13:43:50.771864, event: done, request: pg_query(2.8c epoch 8) v2 -6160> 2012-10-11 13:43:50.771877 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 75178) -6159> 2012-10-11 13:43:50.771885 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 958 ==== pg_info(1 pgs e6:1.9a) v3 ==== 471+0+0 (3239791369 0 0) 0x27ca1c0 con 0x2fe2140 -6158> 2012-10-11 13:43:50.771899 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1593, time: 2012-10-11 13:43:49.253752, event: header_read, request: pg_info(1 pgs e6:1.9a) v3 -6157> 2012-10-11 13:43:50.771910 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1593, time: 2012-10-11 13:43:49.253754, event: throttled, request: pg_info(1 pgs e6:1.9a) v3 -6156> 2012-10-11 13:43:50.771920 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1593, time: 2012-10-11 13:43:49.253762, event: all_read, request: pg_info(1 pgs e6:1.9a) v3 -6155> 2012-10-11 13:43:50.771930 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1593, time: 2012-10-11 13:43:50.771898, event: dispatched, request: pg_info(1 pgs e6:1.9a) v3 -6154> 2012-10-11 13:43:50.771941 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1593, time: 2012-10-11 13:43:50.771941, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.9a) v3 -6153> 2012-10-11 13:43:50.771952 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1593, time: 2012-10-11 13:43:50.771952, event: started, request: pg_info(1 pgs e6:1.9a) v3 -6152> 2012-10-11 13:43:50.771970 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1593, time: 2012-10-11 13:43:50.771969, event: done, request: pg_info(1 pgs e6:1.9a) v3 -6151> 2012-10-11 13:43:50.771983 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 74707) -6150> 2012-10-11 13:43:50.771991 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 614 ==== pg_query(1.8f epoch 8) v2 ==== 109+0+0 (240010594 0 0) 0x302e380 con 0x2fe2280 -6149> 2012-10-11 13:43:50.772005 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1594, time: 2012-10-11 13:43:50.308062, event: header_read, request: pg_query(1.8f epoch 8) v2 -6148> 2012-10-11 13:43:50.772015 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1594, time: 2012-10-11 13:43:50.308071, event: throttled, request: pg_query(1.8f epoch 8) v2 -6147> 2012-10-11 13:43:50.772026 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1594, time: 2012-10-11 13:43:50.308087, event: all_read, request: pg_query(1.8f epoch 8) v2 -6146> 2012-10-11 13:43:50.772036 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1594, time: 2012-10-11 13:43:50.772003, event: dispatched, request: pg_query(1.8f epoch 8) v2 -6145> 2012-10-11 13:43:50.772046 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1594, time: 2012-10-11 13:43:50.772046, event: waiting_for_osdmap, request: pg_query(1.8f epoch 8) v2 -6144> 2012-10-11 13:43:50.772059 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1594, time: 2012-10-11 13:43:50.772059, event: started, request: pg_query(1.8f epoch 8) v2 -6143> 2012-10-11 13:43:50.772077 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1594, time: 2012-10-11 13:43:50.772077, event: done, request: pg_query(1.8f epoch 8) v2 -6142> 2012-10-11 13:43:50.772090 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 74598) -6141> 2012-10-11 13:43:50.772098 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 959 ==== pg_info(1 pgs e6:0.9b) v3 ==== 471+0+0 (4201520388 0 0) 0x27ca000 con 0x2fe2140 -6140> 2012-10-11 13:43:50.772113 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1595, time: 2012-10-11 13:43:49.253765, event: header_read, request: pg_info(1 pgs e6:0.9b) v3 -6139> 2012-10-11 13:43:50.772124 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1595, time: 2012-10-11 13:43:49.253767, event: throttled, request: pg_info(1 pgs e6:0.9b) v3 -6138> 2012-10-11 13:43:50.772134 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1595, time: 2012-10-11 13:43:49.253775, event: all_read, request: pg_info(1 pgs e6:0.9b) v3 -6137> 2012-10-11 13:43:50.772145 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1595, time: 2012-10-11 13:43:50.772111, event: dispatched, request: pg_info(1 pgs e6:0.9b) v3 -6136> 2012-10-11 13:43:50.772155 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1595, time: 2012-10-11 13:43:50.772155, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.9b) v3 -6135> 2012-10-11 13:43:50.772166 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1595, time: 2012-10-11 13:43:50.772166, event: started, request: pg_info(1 pgs e6:0.9b) v3 -6134> 2012-10-11 13:43:50.772184 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1595, time: 2012-10-11 13:43:50.772184, event: done, request: pg_info(1 pgs e6:0.9b) v3 -6133> 2012-10-11 13:43:50.772197 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 74127) -6132> 2012-10-11 13:43:50.772205 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 615 ==== pg_query(0.8e epoch 8) v2 ==== 109+0+0 (3452224598 0 0) 0x302e1c0 con 0x2fe2280 -6131> 2012-10-11 13:43:50.772220 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1596, time: 2012-10-11 13:43:50.309742, event: header_read, request: pg_query(0.8e epoch 8) v2 -6130> 2012-10-11 13:43:50.772231 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1596, time: 2012-10-11 13:43:50.309752, event: throttled, request: pg_query(0.8e epoch 8) v2 -6129> 2012-10-11 13:43:50.772241 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1596, time: 2012-10-11 13:43:50.309759, event: all_read, request: pg_query(0.8e epoch 8) v2 -6128> 2012-10-11 13:43:50.772251 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1596, time: 2012-10-11 13:43:50.772218, event: dispatched, request: pg_query(0.8e epoch 8) v2 -6127> 2012-10-11 13:43:50.772261 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1596, time: 2012-10-11 13:43:50.772261, event: waiting_for_osdmap, request: pg_query(0.8e epoch 8) v2 -6126> 2012-10-11 13:43:50.772273 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1596, time: 2012-10-11 13:43:50.772273, event: started, request: pg_query(0.8e epoch 8) v2 -6125> 2012-10-11 13:43:50.772289 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1596, time: 2012-10-11 13:43:50.772289, event: done, request: pg_query(0.8e epoch 8) v2 -6124> 2012-10-11 13:43:50.772302 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 74018) -6123> 2012-10-11 13:43:50.772310 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 960 ==== pg_info(1 pgs e6:1.98) v3 ==== 471+0+0 (990509630 0 0) 0x2a77e00 con 0x2fe2140 -6122> 2012-10-11 13:43:50.772324 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1597, time: 2012-10-11 13:43:49.253778, event: header_read, request: pg_info(1 pgs e6:1.98) v3 -6121> 2012-10-11 13:43:50.772335 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1597, time: 2012-10-11 13:43:49.253780, event: throttled, request: pg_info(1 pgs e6:1.98) v3 -6120> 2012-10-11 13:43:50.772345 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1597, time: 2012-10-11 13:43:49.253787, event: all_read, request: pg_info(1 pgs e6:1.98) v3 -6119> 2012-10-11 13:43:50.772356 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1597, time: 2012-10-11 13:43:50.772323, event: dispatched, request: pg_info(1 pgs e6:1.98) v3 -6118> 2012-10-11 13:43:50.772366 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1597, time: 2012-10-11 13:43:50.772366, event: waiting_for_osdmap, request: pg_info(1 pgs e6:1.98) v3 -6117> 2012-10-11 13:43:50.772377 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1597, time: 2012-10-11 13:43:50.772377, event: started, request: pg_info(1 pgs e6:1.98) v3 -6116> 2012-10-11 13:43:50.772395 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1597, time: 2012-10-11 13:43:50.772395, event: done, request: pg_info(1 pgs e6:1.98) v3 -6115> 2012-10-11 13:43:50.772408 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 73547) -6114> 2012-10-11 13:43:50.772416 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 616 ==== pg_query(2.51 epoch 8) v2 ==== 109+0+0 (1505853658 0 0) 0x302e000 con 0x2fe2280 -6113> 2012-10-11 13:43:50.772430 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1598, time: 2012-10-11 13:43:50.309793, event: header_read, request: pg_query(2.51 epoch 8) v2 -6112> 2012-10-11 13:43:50.772441 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1598, time: 2012-10-11 13:43:50.309801, event: throttled, request: pg_query(2.51 epoch 8) v2 -6111> 2012-10-11 13:43:50.772452 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1598, time: 2012-10-11 13:43:50.309814, event: all_read, request: pg_query(2.51 epoch 8) v2 -6110> 2012-10-11 13:43:50.772462 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1598, time: 2012-10-11 13:43:50.772429, event: dispatched, request: pg_query(2.51 epoch 8) v2 -6109> 2012-10-11 13:43:50.772472 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1598, time: 2012-10-11 13:43:50.772472, event: waiting_for_osdmap, request: pg_query(2.51 epoch 8) v2 -6108> 2012-10-11 13:43:50.772484 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1598, time: 2012-10-11 13:43:50.772484, event: started, request: pg_query(2.51 epoch 8) v2 -6107> 2012-10-11 13:43:50.772503 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1598, time: 2012-10-11 13:43:50.772503, event: done, request: pg_query(2.51 epoch 8) v2 -6106> 2012-10-11 13:43:50.772516 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 73438) -6105> 2012-10-11 13:43:50.772525 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 961 ==== pg_info(1 pgs e6:0.99) v3 ==== 471+0+0 (297449194 0 0) 0x2a77c40 con 0x2fe2140 -6104> 2012-10-11 13:43:50.772539 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1599, time: 2012-10-11 13:43:49.253790, event: header_read, request: pg_info(1 pgs e6:0.99) v3 -6103> 2012-10-11 13:43:50.772550 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1599, time: 2012-10-11 13:43:49.253793, event: throttled, request: pg_info(1 pgs e6:0.99) v3 -6102> 2012-10-11 13:43:50.772561 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1599, time: 2012-10-11 13:43:49.253800, event: all_read, request: pg_info(1 pgs e6:0.99) v3 -6101> 2012-10-11 13:43:50.772571 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1599, time: 2012-10-11 13:43:50.772538, event: dispatched, request: pg_info(1 pgs e6:0.99) v3 -6100> 2012-10-11 13:43:50.772581 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1599, time: 2012-10-11 13:43:50.772581, event: waiting_for_osdmap, request: pg_info(1 pgs e6:0.99) v3 -6099> 2012-10-11 13:43:50.772592 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1599, time: 2012-10-11 13:43:50.772592, event: started, request: pg_info(1 pgs e6:0.99) v3 -6098> 2012-10-11 13:43:50.772610 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1599, time: 2012-10-11 13:43:50.772610, event: done, request: pg_info(1 pgs e6:0.99) v3 -6097> 2012-10-11 13:43:50.772624 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 72967) -6096> 2012-10-11 13:43:50.772633 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 617 ==== pg_query(0.53 epoch 8) v2 ==== 109+0+0 (3677942851 0 0) 0x2cc5e00 con 0x2fe2280 -6095> 2012-10-11 13:43:50.772647 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1600, time: 2012-10-11 13:43:50.309864, event: header_read, request: pg_query(0.53 epoch 8) v2 -6094> 2012-10-11 13:43:50.772658 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1600, time: 2012-10-11 13:43:50.309872, event: throttled, request: pg_query(0.53 epoch 8) v2 -6093> 2012-10-11 13:43:50.772669 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1600, time: 2012-10-11 13:43:50.309885, event: all_read, request: pg_query(0.53 epoch 8) v2 -6092> 2012-10-11 13:43:50.772679 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1600, time: 2012-10-11 13:43:50.772646, event: dispatched, request: pg_query(0.53 epoch 8) v2 -6091> 2012-10-11 13:43:50.772689 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1600, time: 2012-10-11 13:43:50.772689, event: waiting_for_osdmap, request: pg_query(0.53 epoch 8) v2 -6090> 2012-10-11 13:43:50.772701 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1600, time: 2012-10-11 13:43:50.772700, event: started, request: pg_query(0.53 epoch 8) v2 -6089> 2012-10-11 13:43:50.772717 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1600, time: 2012-10-11 13:43:50.772716, event: done, request: pg_query(0.53 epoch 8) v2 -6088> 2012-10-11 13:43:50.772730 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 72858) -6087> 2012-10-11 13:43:50.772739 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 962 ==== osd pg remove(epoch 7; pg0.58; ) v1 ==== 25+0+0 (4088766725 0 0) 0x2a77a80 con 0x2fe2140 -6086> 2012-10-11 13:43:50.772753 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1601, time: 2012-10-11 13:43:49.386778, event: header_read, request: osd pg remove(epoch 7; pg0.58; ) v1 -6085> 2012-10-11 13:43:50.772764 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1601, time: 2012-10-11 13:43:49.386796, event: throttled, request: osd pg remove(epoch 7; pg0.58; ) v1 -6084> 2012-10-11 13:43:50.772774 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1601, time: 2012-10-11 13:43:49.386804, event: all_read, request: osd pg remove(epoch 7; pg0.58; ) v1 -6083> 2012-10-11 13:43:50.772785 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1601, time: 2012-10-11 13:43:50.772751, event: dispatched, request: osd pg remove(epoch 7; pg0.58; ) v1 -6082> 2012-10-11 13:43:50.772795 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1601, time: 2012-10-11 13:43:50.772795, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.58; ) v1 -6081> 2012-10-11 13:43:50.772807 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1601, time: 2012-10-11 13:43:50.772807, event: started, request: osd pg remove(epoch 7; pg0.58; ) v1 -6080> 2012-10-11 13:43:50.772817 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.58 -6079> 2012-10-11 13:43:50.772837 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.58 0x2130440)/0x2130440 -6078> 2012-10-11 13:43:50.772847 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6077> 2012-10-11 13:43:50.772854 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6076> 2012-10-11 13:43:50.772861 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4161 0x22ff630 -6075> 2012-10-11 13:43:50.772870 7f440532f700 5 journal submit_entry seq 4161 len 205 (0x2cc4570) -6074> 2012-10-11 13:43:50.772878 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6073> 2012-10-11 13:43:50.772886 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6072> 2012-10-11 13:43:50.772910 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1601, time: 2012-10-11 13:43:50.772910, event: done, request: osd pg remove(epoch 7; pg0.58; ) v1 -6071> 2012-10-11 13:43:50.772927 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 72833) -6070> 2012-10-11 13:43:50.772935 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 618 ==== pg_query(1.52 epoch 8) v2 ==== 109+0+0 (414348663 0 0) 0x2cc5c40 con 0x2fe2280 -6069> 2012-10-11 13:43:50.772951 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1602, time: 2012-10-11 13:43:50.309919, event: header_read, request: pg_query(1.52 epoch 8) v2 -6068> 2012-10-11 13:43:50.772963 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1602, time: 2012-10-11 13:43:50.309930, event: throttled, request: pg_query(1.52 epoch 8) v2 -6067> 2012-10-11 13:43:50.772974 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1602, time: 2012-10-11 13:43:50.309943, event: all_read, request: pg_query(1.52 epoch 8) v2 -6066> 2012-10-11 13:43:50.772984 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1602, time: 2012-10-11 13:43:50.772950, event: dispatched, request: pg_query(1.52 epoch 8) v2 -6065> 2012-10-11 13:43:50.772994 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1602, time: 2012-10-11 13:43:50.772994, event: waiting_for_osdmap, request: pg_query(1.52 epoch 8) v2 -6064> 2012-10-11 13:43:50.773006 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1602, time: 2012-10-11 13:43:50.773006, event: started, request: pg_query(1.52 epoch 8) v2 -6063> 2012-10-11 13:43:50.773023 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1602, time: 2012-10-11 13:43:50.773023, event: done, request: pg_query(1.52 epoch 8) v2 -6062> 2012-10-11 13:43:50.773036 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 72724) -6061> 2012-10-11 13:43:50.773045 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 963 ==== osd pg remove(epoch 7; pg0.5c; ) v1 ==== 25+0+0 (3534234472 0 0) 0x2a778c0 con 0x2fe2140 -6060> 2012-10-11 13:43:50.773060 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1603, time: 2012-10-11 13:43:49.386811, event: header_read, request: osd pg remove(epoch 7; pg0.5c; ) v1 -6059> 2012-10-11 13:43:50.773070 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1603, time: 2012-10-11 13:43:49.386814, event: throttled, request: osd pg remove(epoch 7; pg0.5c; ) v1 -6058> 2012-10-11 13:43:50.773081 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1603, time: 2012-10-11 13:43:49.386818, event: all_read, request: osd pg remove(epoch 7; pg0.5c; ) v1 -6057> 2012-10-11 13:43:50.773091 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1603, time: 2012-10-11 13:43:50.773058, event: dispatched, request: osd pg remove(epoch 7; pg0.5c; ) v1 -6056> 2012-10-11 13:43:50.773102 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1603, time: 2012-10-11 13:43:50.773102, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.5c; ) v1 -6055> 2012-10-11 13:43:50.773113 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1603, time: 2012-10-11 13:43:50.773113, event: started, request: osd pg remove(epoch 7; pg0.5c; ) v1 -6054> 2012-10-11 13:43:50.773123 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.5c -6053> 2012-10-11 13:43:50.773143 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.5c 0x2130380)/0x2130380 -6052> 2012-10-11 13:43:50.773153 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6051> 2012-10-11 13:43:50.773160 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6050> 2012-10-11 13:43:50.773167 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4162 0x22ff870 -6049> 2012-10-11 13:43:50.773175 7f440532f700 5 journal submit_entry seq 4162 len 205 (0x2165e40) -6048> 2012-10-11 13:43:50.773184 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6047> 2012-10-11 13:43:50.773190 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6046> 2012-10-11 13:43:50.773213 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1603, time: 2012-10-11 13:43:50.773213, event: done, request: osd pg remove(epoch 7; pg0.5c; ) v1 -6045> 2012-10-11 13:43:50.773229 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 72699) -6044> 2012-10-11 13:43:50.773238 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 619 ==== pg_notify(0.50,0.51,0.54,0.55,0.8d,0.98,1.50,1.53,1.54,1.55,1.8c,1.97,1.99,2.52,2.53,2.96 epoch 8) v4 ==== 7164+0+0 (2269642813 0 0) 0x2cc5a80 con 0x2fe2280 -6043> 2012-10-11 13:43:50.773266 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1604, time: 2012-10-11 13:43:50.310055, event: header_read, request: pg_notify(0.50,0.51,0.54,0.55,0.8d,0.98,1.50,1.53,1.54,1.55,1.8c,1.97,1.99,2.52,2.53,2.96 epoch 8) v4 -6042> 2012-10-11 13:43:50.773281 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1604, time: 2012-10-11 13:43:50.310064, event: throttled, request: pg_notify(0.50,0.51,0.54,0.55,0.8d,0.98,1.50,1.53,1.54,1.55,1.8c,1.97,1.99,2.52,2.53,2.96 epoch 8) v4 -6041> 2012-10-11 13:43:50.773296 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1604, time: 2012-10-11 13:43:50.310131, event: all_read, request: pg_notify(0.50,0.51,0.54,0.55,0.8d,0.98,1.50,1.53,1.54,1.55,1.8c,1.97,1.99,2.52,2.53,2.96 epoch 8) v4 -6040> 2012-10-11 13:43:50.773310 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1604, time: 2012-10-11 13:43:50.773264, event: dispatched, request: pg_notify(0.50,0.51,0.54,0.55,0.8d,0.98,1.50,1.53,1.54,1.55,1.8c,1.97,1.99,2.52,2.53,2.96 epoch 8) v4 -6039> 2012-10-11 13:43:50.773324 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1604, time: 2012-10-11 13:43:50.773323, event: waiting_for_osdmap, request: pg_notify(0.50,0.51,0.54,0.55,0.8d,0.98,1.50,1.53,1.54,1.55,1.8c,1.97,1.99,2.52,2.53,2.96 epoch 8) v4 -6038> 2012-10-11 13:43:50.773339 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1604, time: 2012-10-11 13:43:50.773339, event: started, request: pg_notify(0.50,0.51,0.54,0.55,0.8d,0.98,1.50,1.53,1.54,1.55,1.8c,1.97,1.99,2.52,2.53,2.96 epoch 8) v4 -6037> 2012-10-11 13:43:50.773440 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1604, time: 2012-10-11 13:43:50.773439, event: done, request: pg_notify(0.50,0.51,0.54,0.55,0.8d,0.98,1.50,1.53,1.54,1.55,1.8c,1.97,1.99,2.52,2.53,2.96 epoch 8) v4 -6036> 2012-10-11 13:43:50.773459 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 7164 (0xb7c748 -> 65535) -6035> 2012-10-11 13:43:50.773468 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 964 ==== osd pg remove(epoch 7; pg0.65; ) v1 ==== 25+0+0 (1356412600 0 0) 0x2a77700 con 0x2fe2140 -6034> 2012-10-11 13:43:50.773484 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1605, time: 2012-10-11 13:43:49.386820, event: header_read, request: osd pg remove(epoch 7; pg0.65; ) v1 -6033> 2012-10-11 13:43:50.773495 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1605, time: 2012-10-11 13:43:49.386823, event: throttled, request: osd pg remove(epoch 7; pg0.65; ) v1 -6032> 2012-10-11 13:43:50.773505 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1605, time: 2012-10-11 13:43:49.386829, event: all_read, request: osd pg remove(epoch 7; pg0.65; ) v1 -6031> 2012-10-11 13:43:50.773515 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1605, time: 2012-10-11 13:43:50.773482, event: dispatched, request: osd pg remove(epoch 7; pg0.65; ) v1 -6030> 2012-10-11 13:43:50.773526 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1605, time: 2012-10-11 13:43:50.773526, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.65; ) v1 -6029> 2012-10-11 13:43:50.773538 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1605, time: 2012-10-11 13:43:50.773538, event: started, request: osd pg remove(epoch 7; pg0.65; ) v1 -6028> 2012-10-11 13:43:50.773548 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.65 -6027> 2012-10-11 13:43:50.773569 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.65 0x21304e0)/0x21304e0 -6026> 2012-10-11 13:43:50.773579 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -6025> 2012-10-11 13:43:50.773586 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -6024> 2012-10-11 13:43:50.773593 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4163 0x2aa3870 -6023> 2012-10-11 13:43:50.773602 7f440532f700 5 journal submit_entry seq 4163 len 205 (0x21c7180) -6022> 2012-10-11 13:43:50.773610 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -6021> 2012-10-11 13:43:50.773617 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -6020> 2012-10-11 13:43:50.773642 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1605, time: 2012-10-11 13:43:50.773642, event: done, request: osd pg remove(epoch 7; pg0.65; ) v1 -6019> 2012-10-11 13:43:50.773659 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 65510) -6018> 2012-10-11 13:43:50.773668 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 620 ==== pg_query(2.44 epoch 8) v2 ==== 109+0+0 (870290165 0 0) 0x2cc58c0 con 0x2fe2280 -6017> 2012-10-11 13:43:50.773684 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1606, time: 2012-10-11 13:43:50.310172, event: header_read, request: pg_query(2.44 epoch 8) v2 -6016> 2012-10-11 13:43:50.773695 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1606, time: 2012-10-11 13:43:50.310181, event: throttled, request: pg_query(2.44 epoch 8) v2 -6015> 2012-10-11 13:43:50.773705 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1606, time: 2012-10-11 13:43:50.310188, event: all_read, request: pg_query(2.44 epoch 8) v2 -6014> 2012-10-11 13:43:50.773715 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1606, time: 2012-10-11 13:43:50.773682, event: dispatched, request: pg_query(2.44 epoch 8) v2 -6013> 2012-10-11 13:43:50.773726 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1606, time: 2012-10-11 13:43:50.773726, event: waiting_for_osdmap, request: pg_query(2.44 epoch 8) v2 -6012> 2012-10-11 13:43:50.773737 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1606, time: 2012-10-11 13:43:50.773737, event: started, request: pg_query(2.44 epoch 8) v2 -6011> 2012-10-11 13:43:50.773754 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1606, time: 2012-10-11 13:43:50.773754, event: done, request: pg_query(2.44 epoch 8) v2 -6010> 2012-10-11 13:43:50.773767 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 65401) -6009> 2012-10-11 13:43:50.773776 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 965 ==== osd pg remove(epoch 7; pg0.64; ) v1 ==== 25+0+0 (434457503 0 0) 0x2a77540 con 0x2fe2140 -6008> 2012-10-11 13:43:50.773791 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1607, time: 2012-10-11 13:43:49.386831, event: header_read, request: osd pg remove(epoch 7; pg0.64; ) v1 -6007> 2012-10-11 13:43:50.773802 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1607, time: 2012-10-11 13:43:49.386833, event: throttled, request: osd pg remove(epoch 7; pg0.64; ) v1 -6006> 2012-10-11 13:43:50.773812 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1607, time: 2012-10-11 13:43:49.386837, event: all_read, request: osd pg remove(epoch 7; pg0.64; ) v1 -6005> 2012-10-11 13:43:50.773823 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1607, time: 2012-10-11 13:43:50.773790, event: dispatched, request: osd pg remove(epoch 7; pg0.64; ) v1 -6004> 2012-10-11 13:43:50.773833 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1607, time: 2012-10-11 13:43:50.773833, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.64; ) v1 -6003> 2012-10-11 13:43:50.773845 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1607, time: 2012-10-11 13:43:50.773845, event: started, request: osd pg remove(epoch 7; pg0.64; ) v1 -6002> 2012-10-11 13:43:50.773855 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.64 -6001> 2012-10-11 13:43:50.773875 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.64 0x2130510)/0x2130510 -6000> 2012-10-11 13:43:50.773885 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5999> 2012-10-11 13:43:50.773892 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5998> 2012-10-11 13:43:50.773899 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4164 0x29311b0 -5997> 2012-10-11 13:43:50.773908 7f440532f700 5 journal submit_entry seq 4164 len 205 (0x2219240) -5996> 2012-10-11 13:43:50.773916 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5995> 2012-10-11 13:43:50.773923 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5994> 2012-10-11 13:43:50.773949 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1607, time: 2012-10-11 13:43:50.773949, event: done, request: osd pg remove(epoch 7; pg0.64; ) v1 -5993> 2012-10-11 13:43:50.773966 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 65376) -5992> 2012-10-11 13:43:50.773974 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 621 ==== pg_query(0.46 epoch 8) v2 ==== 109+0+0 (2972116588 0 0) 0x2cc5700 con 0x2fe2280 -5991> 2012-10-11 13:43:50.773990 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1608, time: 2012-10-11 13:43:50.310227, event: header_read, request: pg_query(0.46 epoch 8) v2 -5990> 2012-10-11 13:43:50.774001 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1608, time: 2012-10-11 13:43:50.310238, event: throttled, request: pg_query(0.46 epoch 8) v2 -5989> 2012-10-11 13:43:50.774011 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1608, time: 2012-10-11 13:43:50.310246, event: all_read, request: pg_query(0.46 epoch 8) v2 -5988> 2012-10-11 13:43:50.774021 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1608, time: 2012-10-11 13:43:50.773988, event: dispatched, request: pg_query(0.46 epoch 8) v2 -5987> 2012-10-11 13:43:50.774032 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1608, time: 2012-10-11 13:43:50.774032, event: waiting_for_osdmap, request: pg_query(0.46 epoch 8) v2 -5986> 2012-10-11 13:43:50.774043 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1608, time: 2012-10-11 13:43:50.774043, event: started, request: pg_query(0.46 epoch 8) v2 -5985> 2012-10-11 13:43:50.774064 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1608, time: 2012-10-11 13:43:50.774064, event: done, request: pg_query(0.46 epoch 8) v2 -5984> 2012-10-11 13:43:50.774077 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 65267) -5983> 2012-10-11 13:43:50.774085 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 966 ==== osd pg remove(epoch 7; pg0.6b; ) v1 ==== 25+0+0 (2709998145 0 0) 0x2a77380 con 0x2fe2140 -5982> 2012-10-11 13:43:50.774100 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1609, time: 2012-10-11 13:43:49.386840, event: header_read, request: osd pg remove(epoch 7; pg0.6b; ) v1 -5981> 2012-10-11 13:43:50.774111 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1609, time: 2012-10-11 13:43:49.386842, event: throttled, request: osd pg remove(epoch 7; pg0.6b; ) v1 -5980> 2012-10-11 13:43:50.774121 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1609, time: 2012-10-11 13:43:49.386845, event: all_read, request: osd pg remove(epoch 7; pg0.6b; ) v1 -5979> 2012-10-11 13:43:50.774132 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1609, time: 2012-10-11 13:43:50.774098, event: dispatched, request: osd pg remove(epoch 7; pg0.6b; ) v1 -5978> 2012-10-11 13:43:50.774142 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1609, time: 2012-10-11 13:43:50.774142, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.6b; ) v1 -5977> 2012-10-11 13:43:50.774154 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1609, time: 2012-10-11 13:43:50.774154, event: started, request: osd pg remove(epoch 7; pg0.6b; ) v1 -5976> 2012-10-11 13:43:50.774164 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.6b -5975> 2012-10-11 13:43:50.774184 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.6b 0x21306f0)/0x21306f0 -5974> 2012-10-11 13:43:50.774194 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5973> 2012-10-11 13:43:50.774201 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5972> 2012-10-11 13:43:50.774208 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4165 0x2931480 -5971> 2012-10-11 13:43:50.774217 7f440532f700 5 journal submit_entry seq 4165 len 205 (0x22193f0) -5970> 2012-10-11 13:43:50.774225 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5969> 2012-10-11 13:43:50.774232 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5968> 2012-10-11 13:43:50.774256 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1609, time: 2012-10-11 13:43:50.774256, event: done, request: osd pg remove(epoch 7; pg0.6b; ) v1 -5967> 2012-10-11 13:43:50.774273 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 65242) -5966> 2012-10-11 13:43:50.774281 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 622 ==== pg_query(1.45 epoch 8) v2 ==== 109+0+0 (2089286654 0 0) 0x2cc5540 con 0x2fe2280 -5965> 2012-10-11 13:43:50.774298 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1610, time: 2012-10-11 13:43:50.310251, event: header_read, request: pg_query(1.45 epoch 8) v2 -5964> 2012-10-11 13:43:50.774309 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1610, time: 2012-10-11 13:43:50.310255, event: throttled, request: pg_query(1.45 epoch 8) v2 -5963> 2012-10-11 13:43:50.774319 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1610, time: 2012-10-11 13:43:50.310261, event: all_read, request: pg_query(1.45 epoch 8) v2 -5962> 2012-10-11 13:43:50.774329 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1610, time: 2012-10-11 13:43:50.774296, event: dispatched, request: pg_query(1.45 epoch 8) v2 -5961> 2012-10-11 13:43:50.774340 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1610, time: 2012-10-11 13:43:50.774340, event: waiting_for_osdmap, request: pg_query(1.45 epoch 8) v2 -5960> 2012-10-11 13:43:50.774351 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1610, time: 2012-10-11 13:43:50.774351, event: started, request: pg_query(1.45 epoch 8) v2 -5959> 2012-10-11 13:43:50.774369 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1610, time: 2012-10-11 13:43:50.774369, event: done, request: pg_query(1.45 epoch 8) v2 -5958> 2012-10-11 13:43:50.774382 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 65133) -5957> 2012-10-11 13:43:50.774390 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 967 ==== osd pg remove(epoch 7; pg0.6d; ) v1 ==== 25+0+0 (316813922 0 0) 0x2a771c0 con 0x2fe2140 -5956> 2012-10-11 13:43:50.774405 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1611, time: 2012-10-11 13:43:49.386848, event: header_read, request: osd pg remove(epoch 7; pg0.6d; ) v1 -5955> 2012-10-11 13:43:50.774416 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1611, time: 2012-10-11 13:43:49.386850, event: throttled, request: osd pg remove(epoch 7; pg0.6d; ) v1 -5954> 2012-10-11 13:43:50.774427 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1611, time: 2012-10-11 13:43:49.386853, event: all_read, request: osd pg remove(epoch 7; pg0.6d; ) v1 -5953> 2012-10-11 13:43:50.774437 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1611, time: 2012-10-11 13:43:50.774403, event: dispatched, request: osd pg remove(epoch 7; pg0.6d; ) v1 -5952> 2012-10-11 13:43:50.774448 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1611, time: 2012-10-11 13:43:50.774448, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.6d; ) v1 -5951> 2012-10-11 13:43:50.774459 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1611, time: 2012-10-11 13:43:50.774459, event: started, request: osd pg remove(epoch 7; pg0.6d; ) v1 -5950> 2012-10-11 13:43:50.774469 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.6d -5949> 2012-10-11 13:43:50.774489 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.6d 0x2130690)/0x2130690 -5948> 2012-10-11 13:43:50.774499 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5947> 2012-10-11 13:43:50.774506 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5946> 2012-10-11 13:43:50.774514 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4166 0x2931360 -5945> 2012-10-11 13:43:50.774523 7f440532f700 5 journal submit_entry seq 4166 len 205 (0x2219e10) -5944> 2012-10-11 13:43:50.774532 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5943> 2012-10-11 13:43:50.774539 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5942> 2012-10-11 13:43:50.774567 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1611, time: 2012-10-11 13:43:50.774567, event: done, request: osd pg remove(epoch 7; pg0.6d; ) v1 -5941> 2012-10-11 13:43:50.774584 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 65108) -5940> 2012-10-11 13:43:50.774593 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 623 ==== pg_query(1.87 epoch 8) v2 ==== 109+0+0 (920664058 0 0) 0x2cc5380 con 0x2fe2280 -5939> 2012-10-11 13:43:50.774609 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1612, time: 2012-10-11 13:43:50.310271, event: header_read, request: pg_query(1.87 epoch 8) v2 -5938> 2012-10-11 13:43:50.774621 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1612, time: 2012-10-11 13:43:50.310276, event: throttled, request: pg_query(1.87 epoch 8) v2 -5937> 2012-10-11 13:43:50.774631 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1612, time: 2012-10-11 13:43:50.310281, event: all_read, request: pg_query(1.87 epoch 8) v2 -5936> 2012-10-11 13:43:50.774641 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1612, time: 2012-10-11 13:43:50.774608, event: dispatched, request: pg_query(1.87 epoch 8) v2 -5935> 2012-10-11 13:43:50.774652 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1612, time: 2012-10-11 13:43:50.774652, event: waiting_for_osdmap, request: pg_query(1.87 epoch 8) v2 -5934> 2012-10-11 13:43:50.774664 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1612, time: 2012-10-11 13:43:50.774663, event: started, request: pg_query(1.87 epoch 8) v2 -5933> 2012-10-11 13:43:50.774681 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1612, time: 2012-10-11 13:43:50.774681, event: done, request: pg_query(1.87 epoch 8) v2 -5932> 2012-10-11 13:43:50.774694 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 64999) -5931> 2012-10-11 13:43:50.774702 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 968 ==== osd pg remove(epoch 7; pg0.71; ) v1 ==== 25+0+0 (4122131809 0 0) 0x2a77000 con 0x2fe2140 -5930> 2012-10-11 13:43:50.774717 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1613, time: 2012-10-11 13:43:49.386856, event: header_read, request: osd pg remove(epoch 7; pg0.71; ) v1 -5929> 2012-10-11 13:43:50.774728 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1613, time: 2012-10-11 13:43:49.386858, event: throttled, request: osd pg remove(epoch 7; pg0.71; ) v1 -5928> 2012-10-11 13:43:50.774739 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1613, time: 2012-10-11 13:43:49.386862, event: all_read, request: osd pg remove(epoch 7; pg0.71; ) v1 -5927> 2012-10-11 13:43:50.774749 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1613, time: 2012-10-11 13:43:50.774715, event: dispatched, request: osd pg remove(epoch 7; pg0.71; ) v1 -5926> 2012-10-11 13:43:50.774760 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1613, time: 2012-10-11 13:43:50.774760, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.71; ) v1 -5925> 2012-10-11 13:43:50.774771 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1613, time: 2012-10-11 13:43:50.774771, event: started, request: osd pg remove(epoch 7; pg0.71; ) v1 -5924> 2012-10-11 13:43:50.774782 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.71 -5923> 2012-10-11 13:43:50.774801 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.71 0x2130920)/0x2130920 -5922> 2012-10-11 13:43:50.774811 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5921> 2012-10-11 13:43:50.774818 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5920> 2012-10-11 13:43:50.774825 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4167 0x2931bd0 -5919> 2012-10-11 13:43:50.774833 7f440532f700 5 journal submit_entry seq 4167 len 205 (0x22744b0) -5918> 2012-10-11 13:43:50.774841 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5917> 2012-10-11 13:43:50.774848 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5916> 2012-10-11 13:43:50.774871 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1613, time: 2012-10-11 13:43:50.774871, event: done, request: osd pg remove(epoch 7; pg0.71; ) v1 -5915> 2012-10-11 13:43:50.774888 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 64974) -5914> 2012-10-11 13:43:50.774896 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 624 ==== pg_query(0.41 epoch 8) v2 ==== 109+0+0 (2756677077 0 0) 0x2cc51c0 con 0x2fe2280 -5913> 2012-10-11 13:43:50.774913 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1614, time: 2012-10-11 13:43:50.310285, event: header_read, request: pg_query(0.41 epoch 8) v2 -5912> 2012-10-11 13:43:50.774924 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1614, time: 2012-10-11 13:43:50.310289, event: throttled, request: pg_query(0.41 epoch 8) v2 -5911> 2012-10-11 13:43:50.774934 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1614, time: 2012-10-11 13:43:50.310294, event: all_read, request: pg_query(0.41 epoch 8) v2 -5910> 2012-10-11 13:43:50.774944 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1614, time: 2012-10-11 13:43:50.774911, event: dispatched, request: pg_query(0.41 epoch 8) v2 -5909> 2012-10-11 13:43:50.774955 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1614, time: 2012-10-11 13:43:50.774955, event: waiting_for_osdmap, request: pg_query(0.41 epoch 8) v2 -5908> 2012-10-11 13:43:50.774967 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1614, time: 2012-10-11 13:43:50.774967, event: started, request: pg_query(0.41 epoch 8) v2 -5907> 2012-10-11 13:43:50.774984 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1614, time: 2012-10-11 13:43:50.774984, event: done, request: pg_query(0.41 epoch 8) v2 -5906> 2012-10-11 13:43:50.774997 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 64865) -5905> 2012-10-11 13:43:50.775006 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 969 ==== osd pg remove(epoch 7; pg0.6c; ) v1 ==== 25+0+0 (1541295941 0 0) 0x2498e00 con 0x2fe2140 -5904> 2012-10-11 13:43:50.775020 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1615, time: 2012-10-11 13:43:49.386864, event: header_read, request: osd pg remove(epoch 7; pg0.6c; ) v1 -5903> 2012-10-11 13:43:50.775031 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1615, time: 2012-10-11 13:43:49.386866, event: throttled, request: osd pg remove(epoch 7; pg0.6c; ) v1 -5902> 2012-10-11 13:43:50.775042 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1615, time: 2012-10-11 13:43:49.386871, event: all_read, request: osd pg remove(epoch 7; pg0.6c; ) v1 -5901> 2012-10-11 13:43:50.775053 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1615, time: 2012-10-11 13:43:50.775019, event: dispatched, request: osd pg remove(epoch 7; pg0.6c; ) v1 -5900> 2012-10-11 13:43:50.775063 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1615, time: 2012-10-11 13:43:50.775063, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.6c; ) v1 -5899> 2012-10-11 13:43:50.775075 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1615, time: 2012-10-11 13:43:50.775075, event: started, request: osd pg remove(epoch 7; pg0.6c; ) v1 -5898> 2012-10-11 13:43:50.775085 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.6c -5897> 2012-10-11 13:43:50.775104 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.6c 0x21306c0)/0x21306c0 -5896> 2012-10-11 13:43:50.775114 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5895> 2012-10-11 13:43:50.775121 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5894> 2012-10-11 13:43:50.775128 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4168 0x2931f30 -5893> 2012-10-11 13:43:50.775137 7f440532f700 5 journal submit_entry seq 4168 len 205 (0x22749f0) -5892> 2012-10-11 13:43:50.775148 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5891> 2012-10-11 13:43:50.775155 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5890> 2012-10-11 13:43:50.775179 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1615, time: 2012-10-11 13:43:50.775179, event: done, request: osd pg remove(epoch 7; pg0.6c; ) v1 -5889> 2012-10-11 13:43:50.775195 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 64840) -5888> 2012-10-11 13:43:50.775204 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 625 ==== pg_query(2.3d epoch 8) v2 ==== 109+0+0 (1595859807 0 0) 0x2cc5000 con 0x2fe2280 -5887> 2012-10-11 13:43:50.775220 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1616, time: 2012-10-11 13:43:50.310298, event: header_read, request: pg_query(2.3d epoch 8) v2 -5886> 2012-10-11 13:43:50.775231 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1616, time: 2012-10-11 13:43:50.310301, event: throttled, request: pg_query(2.3d epoch 8) v2 -5885> 2012-10-11 13:43:50.775241 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1616, time: 2012-10-11 13:43:50.310324, event: all_read, request: pg_query(2.3d epoch 8) v2 -5884> 2012-10-11 13:43:50.775251 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1616, time: 2012-10-11 13:43:50.775218, event: dispatched, request: pg_query(2.3d epoch 8) v2 -5883> 2012-10-11 13:43:50.775262 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1616, time: 2012-10-11 13:43:50.775262, event: waiting_for_osdmap, request: pg_query(2.3d epoch 8) v2 -5882> 2012-10-11 13:43:50.775274 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1616, time: 2012-10-11 13:43:50.775273, event: started, request: pg_query(2.3d epoch 8) v2 -5881> 2012-10-11 13:43:50.775292 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1616, time: 2012-10-11 13:43:50.775291, event: done, request: pg_query(2.3d epoch 8) v2 -5880> 2012-10-11 13:43:50.775305 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 64731) -5879> 2012-10-11 13:43:50.775313 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 970 ==== osd pg remove(epoch 7; pg0.75; ) v1 ==== 25+0+0 (3568254732 0 0) 0x2498c40 con 0x2fe2140 -5878> 2012-10-11 13:43:50.775328 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1617, time: 2012-10-11 13:43:49.386873, event: header_read, request: osd pg remove(epoch 7; pg0.75; ) v1 -5877> 2012-10-11 13:43:50.775339 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1617, time: 2012-10-11 13:43:49.386875, event: throttled, request: osd pg remove(epoch 7; pg0.75; ) v1 -5876> 2012-10-11 13:43:50.775350 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1617, time: 2012-10-11 13:43:49.386879, event: all_read, request: osd pg remove(epoch 7; pg0.75; ) v1 -5875> 2012-10-11 13:43:50.775360 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1617, time: 2012-10-11 13:43:50.775326, event: dispatched, request: osd pg remove(epoch 7; pg0.75; ) v1 -5874> 2012-10-11 13:43:50.775371 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1617, time: 2012-10-11 13:43:50.775371, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.75; ) v1 -5873> 2012-10-11 13:43:50.775382 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1617, time: 2012-10-11 13:43:50.775382, event: started, request: osd pg remove(epoch 7; pg0.75; ) v1 -5872> 2012-10-11 13:43:50.775393 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.75 -5871> 2012-10-11 13:43:50.775413 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.75 0x2130860)/0x2130860 -5870> 2012-10-11 13:43:50.775423 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5869> 2012-10-11 13:43:50.775430 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5868> 2012-10-11 13:43:50.775437 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4169 0x29316c0 -5867> 2012-10-11 13:43:50.775446 7f440532f700 5 journal submit_entry seq 4169 len 205 (0x2219c60) -5866> 2012-10-11 13:43:50.775455 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5865> 2012-10-11 13:43:50.775461 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5864> 2012-10-11 13:43:50.775486 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1617, time: 2012-10-11 13:43:50.775486, event: done, request: osd pg remove(epoch 7; pg0.75; ) v1 -5863> 2012-10-11 13:43:50.775503 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 64706) -5862> 2012-10-11 13:43:50.775512 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 626 ==== pg_query(0.3f epoch 8) v2 ==== 109+0+0 (3722942406 0 0) 0x27a2e00 con 0x2fe2280 -5861> 2012-10-11 13:43:50.775528 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1618, time: 2012-10-11 13:43:50.310329, event: header_read, request: pg_query(0.3f epoch 8) v2 -5860> 2012-10-11 13:43:50.775539 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1618, time: 2012-10-11 13:43:50.310333, event: throttled, request: pg_query(0.3f epoch 8) v2 -5859> 2012-10-11 13:43:50.775549 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1618, time: 2012-10-11 13:43:50.310339, event: all_read, request: pg_query(0.3f epoch 8) v2 -5858> 2012-10-11 13:43:50.775559 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1618, time: 2012-10-11 13:43:50.775526, event: dispatched, request: pg_query(0.3f epoch 8) v2 -5857> 2012-10-11 13:43:50.775570 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1618, time: 2012-10-11 13:43:50.775570, event: waiting_for_osdmap, request: pg_query(0.3f epoch 8) v2 -5856> 2012-10-11 13:43:50.775582 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1618, time: 2012-10-11 13:43:50.775582, event: started, request: pg_query(0.3f epoch 8) v2 -5855> 2012-10-11 13:43:50.775598 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1618, time: 2012-10-11 13:43:50.775598, event: done, request: pg_query(0.3f epoch 8) v2 -5854> 2012-10-11 13:43:50.775611 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 64597) -5853> 2012-10-11 13:43:50.775620 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 971 ==== osd pg remove(epoch 7; pg0.77; ) v1 ==== 25+0+0 (1188545858 0 0) 0x2498a80 con 0x2fe2140 -5852> 2012-10-11 13:43:50.775634 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1619, time: 2012-10-11 13:43:49.386881, event: header_read, request: osd pg remove(epoch 7; pg0.77; ) v1 -5851> 2012-10-11 13:43:50.775646 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1619, time: 2012-10-11 13:43:49.386883, event: throttled, request: osd pg remove(epoch 7; pg0.77; ) v1 -5850> 2012-10-11 13:43:50.775656 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1619, time: 2012-10-11 13:43:49.386886, event: all_read, request: osd pg remove(epoch 7; pg0.77; ) v1 -5849> 2012-10-11 13:43:50.775667 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1619, time: 2012-10-11 13:43:50.775633, event: dispatched, request: osd pg remove(epoch 7; pg0.77; ) v1 -5848> 2012-10-11 13:43:50.775678 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1619, time: 2012-10-11 13:43:50.775678, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.77; ) v1 -5847> 2012-10-11 13:43:50.775689 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1619, time: 2012-10-11 13:43:50.775689, event: started, request: osd pg remove(epoch 7; pg0.77; ) v1 -5846> 2012-10-11 13:43:50.775700 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.77 -5845> 2012-10-11 13:43:50.775720 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.77 0x2130800)/0x2130800 -5844> 2012-10-11 13:43:50.775729 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5843> 2012-10-11 13:43:50.775736 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5842> 2012-10-11 13:43:50.775743 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4170 0x1d86ea0 -5841> 2012-10-11 13:43:50.775752 7f440532f700 5 journal submit_entry seq 4170 len 205 (0x2274d20) -5840> 2012-10-11 13:43:50.775760 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5839> 2012-10-11 13:43:50.775767 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5838> 2012-10-11 13:43:50.775791 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1619, time: 2012-10-11 13:43:50.775791, event: done, request: osd pg remove(epoch 7; pg0.77; ) v1 -5837> 2012-10-11 13:43:50.775807 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 64572) -5836> 2012-10-11 13:43:50.775816 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 627 ==== pg_query(1.3e epoch 8) v2 ==== 109+0+0 (510465778 0 0) 0x27a2c40 con 0x2fe2280 -5835> 2012-10-11 13:43:50.775831 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1620, time: 2012-10-11 13:43:50.310343, event: header_read, request: pg_query(1.3e epoch 8) v2 -5834> 2012-10-11 13:43:50.775842 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1620, time: 2012-10-11 13:43:50.310347, event: throttled, request: pg_query(1.3e epoch 8) v2 -5833> 2012-10-11 13:43:50.775852 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1620, time: 2012-10-11 13:43:50.310360, event: all_read, request: pg_query(1.3e epoch 8) v2 -5832> 2012-10-11 13:43:50.775863 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1620, time: 2012-10-11 13:43:50.775830, event: dispatched, request: pg_query(1.3e epoch 8) v2 -5831> 2012-10-11 13:43:50.775873 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1620, time: 2012-10-11 13:43:50.775873, event: waiting_for_osdmap, request: pg_query(1.3e epoch 8) v2 -5830> 2012-10-11 13:43:50.775885 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1620, time: 2012-10-11 13:43:50.775885, event: started, request: pg_query(1.3e epoch 8) v2 -5829> 2012-10-11 13:43:50.775902 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1620, time: 2012-10-11 13:43:50.775902, event: done, request: pg_query(1.3e epoch 8) v2 -5828> 2012-10-11 13:43:50.775916 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 64463) -5827> 2012-10-11 13:43:50.775924 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 972 ==== osd pg remove(epoch 7; pg0.74; ) v1 ==== 25+0+0 (2643673643 0 0) 0x24988c0 con 0x2fe2140 -5826> 2012-10-11 13:43:50.775939 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1621, time: 2012-10-11 13:43:49.386889, event: header_read, request: osd pg remove(epoch 7; pg0.74; ) v1 -5825> 2012-10-11 13:43:50.775950 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1621, time: 2012-10-11 13:43:49.386891, event: throttled, request: osd pg remove(epoch 7; pg0.74; ) v1 -5824> 2012-10-11 13:43:50.775961 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1621, time: 2012-10-11 13:43:49.386894, event: all_read, request: osd pg remove(epoch 7; pg0.74; ) v1 -5823> 2012-10-11 13:43:50.775971 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1621, time: 2012-10-11 13:43:50.775937, event: dispatched, request: osd pg remove(epoch 7; pg0.74; ) v1 -5822> 2012-10-11 13:43:50.775982 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1621, time: 2012-10-11 13:43:50.775982, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.74; ) v1 -5821> 2012-10-11 13:43:50.775994 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1621, time: 2012-10-11 13:43:50.775994, event: started, request: osd pg remove(epoch 7; pg0.74; ) v1 -5820> 2012-10-11 13:43:50.776004 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.74 -5819> 2012-10-11 13:43:50.776024 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.74 0x2130890)/0x2130890 -5818> 2012-10-11 13:43:50.776034 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5817> 2012-10-11 13:43:50.776041 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5816> 2012-10-11 13:43:50.776048 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4171 0x1d86d80 -5815> 2012-10-11 13:43:50.776057 7f440532f700 5 journal submit_entry seq 4171 len 205 (0x22d43c0) -5814> 2012-10-11 13:43:50.776066 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5813> 2012-10-11 13:43:50.776073 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5812> 2012-10-11 13:43:50.776097 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1621, time: 2012-10-11 13:43:50.776097, event: done, request: osd pg remove(epoch 7; pg0.74; ) v1 -5811> 2012-10-11 13:43:50.776114 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 64438) -5810> 2012-10-11 13:43:50.776122 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 628 ==== pg_query(0.35 epoch 8) v2 ==== 109+0+0 (3949099512 0 0) 0x27a2a80 con 0x2fe2280 -5809> 2012-10-11 13:43:50.776138 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1622, time: 2012-10-11 13:43:50.310364, event: header_read, request: pg_query(0.35 epoch 8) v2 -5808> 2012-10-11 13:43:50.776149 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1622, time: 2012-10-11 13:43:50.310369, event: throttled, request: pg_query(0.35 epoch 8) v2 -5807> 2012-10-11 13:43:50.776159 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1622, time: 2012-10-11 13:43:50.310375, event: all_read, request: pg_query(0.35 epoch 8) v2 -5806> 2012-10-11 13:43:50.776170 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1622, time: 2012-10-11 13:43:50.776136, event: dispatched, request: pg_query(0.35 epoch 8) v2 -5805> 2012-10-11 13:43:50.776180 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1622, time: 2012-10-11 13:43:50.776180, event: waiting_for_osdmap, request: pg_query(0.35 epoch 8) v2 -5804> 2012-10-11 13:43:50.776192 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1622, time: 2012-10-11 13:43:50.776192, event: started, request: pg_query(0.35 epoch 8) v2 -5803> 2012-10-11 13:43:50.776209 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1622, time: 2012-10-11 13:43:50.776209, event: done, request: pg_query(0.35 epoch 8) v2 -5802> 2012-10-11 13:43:50.776222 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 64329) -5801> 2012-10-11 13:43:50.776230 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 973 ==== osd pg remove(epoch 7; pg0.7e; ) v1 ==== 25+0+0 (1305525439 0 0) 0x2498700 con 0x2fe2140 -5800> 2012-10-11 13:43:50.776245 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1623, time: 2012-10-11 13:43:49.386896, event: header_read, request: osd pg remove(epoch 7; pg0.7e; ) v1 -5799> 2012-10-11 13:43:50.776256 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1623, time: 2012-10-11 13:43:49.386898, event: throttled, request: osd pg remove(epoch 7; pg0.7e; ) v1 -5798> 2012-10-11 13:43:50.776266 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1623, time: 2012-10-11 13:43:49.386902, event: all_read, request: osd pg remove(epoch 7; pg0.7e; ) v1 -5797> 2012-10-11 13:43:50.776277 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1623, time: 2012-10-11 13:43:50.776243, event: dispatched, request: osd pg remove(epoch 7; pg0.7e; ) v1 -5796> 2012-10-11 13:43:50.776287 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1623, time: 2012-10-11 13:43:50.776287, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.7e; ) v1 -5795> 2012-10-11 13:43:50.776299 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1623, time: 2012-10-11 13:43:50.776299, event: started, request: osd pg remove(epoch 7; pg0.7e; ) v1 -5794> 2012-10-11 13:43:50.776309 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.7e -5793> 2012-10-11 13:43:50.776329 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.7e 0x2130a20)/0x2130a20 -5792> 2012-10-11 13:43:50.776338 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5791> 2012-10-11 13:43:50.776345 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5790> 2012-10-11 13:43:50.776352 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4172 0x1d86e10 -5789> 2012-10-11 13:43:50.776361 7f440532f700 5 journal submit_entry seq 4172 len 205 (0x2274ed0) -5788> 2012-10-11 13:43:50.776369 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5787> 2012-10-11 13:43:50.776376 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5786> 2012-10-11 13:43:50.776402 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1623, time: 2012-10-11 13:43:50.776402, event: done, request: osd pg remove(epoch 7; pg0.7e; ) v1 -5785> 2012-10-11 13:43:50.776422 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 64304) -5784> 2012-10-11 13:43:50.776431 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 629 ==== pg_query(0.79 epoch 8) v2 ==== 109+0+0 (251973661 0 0) 0x27a28c0 con 0x2fe2280 -5783> 2012-10-11 13:43:50.776447 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1624, time: 2012-10-11 13:43:50.310386, event: header_read, request: pg_query(0.79 epoch 8) v2 -5782> 2012-10-11 13:43:50.776458 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1624, time: 2012-10-11 13:43:50.310391, event: throttled, request: pg_query(0.79 epoch 8) v2 -5781> 2012-10-11 13:43:50.776468 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1624, time: 2012-10-11 13:43:50.310397, event: all_read, request: pg_query(0.79 epoch 8) v2 -5780> 2012-10-11 13:43:50.776478 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1624, time: 2012-10-11 13:43:50.776445, event: dispatched, request: pg_query(0.79 epoch 8) v2 -5779> 2012-10-11 13:43:50.776489 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1624, time: 2012-10-11 13:43:50.776489, event: waiting_for_osdmap, request: pg_query(0.79 epoch 8) v2 -5778> 2012-10-11 13:43:50.776501 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1624, time: 2012-10-11 13:43:50.776501, event: started, request: pg_query(0.79 epoch 8) v2 -5777> 2012-10-11 13:43:50.776518 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1624, time: 2012-10-11 13:43:50.776518, event: done, request: pg_query(0.79 epoch 8) v2 -5776> 2012-10-11 13:43:50.776531 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 64195) -5775> 2012-10-11 13:43:50.776540 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 974 ==== osd pg remove(epoch 7; pg0.80; ) v1 ==== 25+0+0 (469365053 0 0) 0x2498540 con 0x2fe2140 -5774> 2012-10-11 13:43:50.776555 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1625, time: 2012-10-11 13:43:49.386905, event: header_read, request: osd pg remove(epoch 7; pg0.80; ) v1 -5773> 2012-10-11 13:43:50.776566 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1625, time: 2012-10-11 13:43:49.386907, event: throttled, request: osd pg remove(epoch 7; pg0.80; ) v1 -5772> 2012-10-11 13:43:50.776577 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1625, time: 2012-10-11 13:43:49.386910, event: all_read, request: osd pg remove(epoch 7; pg0.80; ) v1 -5771> 2012-10-11 13:43:50.776587 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1625, time: 2012-10-11 13:43:50.776553, event: dispatched, request: osd pg remove(epoch 7; pg0.80; ) v1 -5770> 2012-10-11 13:43:50.776598 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1625, time: 2012-10-11 13:43:50.776598, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.80; ) v1 -5769> 2012-10-11 13:43:50.776610 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1625, time: 2012-10-11 13:43:50.776609, event: started, request: osd pg remove(epoch 7; pg0.80; ) v1 -5768> 2012-10-11 13:43:50.776620 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.80 -5767> 2012-10-11 13:43:50.776640 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.80 0x21309c0)/0x21309c0 -5766> 2012-10-11 13:43:50.776650 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5765> 2012-10-11 13:43:50.776657 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5764> 2012-10-11 13:43:50.776664 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4173 0x1d86f30 -5763> 2012-10-11 13:43:50.776673 7f440532f700 5 journal submit_entry seq 4173 len 205 (0x22d4de0) -5762> 2012-10-11 13:43:50.776681 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5761> 2012-10-11 13:43:50.776688 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5760> 2012-10-11 13:43:50.776711 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1625, time: 2012-10-11 13:43:50.776711, event: done, request: osd pg remove(epoch 7; pg0.80; ) v1 -5759> 2012-10-11 13:43:50.776728 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 64170) -5758> 2012-10-11 13:43:50.776737 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 630 ==== pg_query(1.78 epoch 8) v2 ==== 109+0+0 (3431878953 0 0) 0x27a2700 con 0x2fe2280 -5757> 2012-10-11 13:43:50.776753 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1626, time: 2012-10-11 13:43:50.310401, event: header_read, request: pg_query(1.78 epoch 8) v2 -5756> 2012-10-11 13:43:50.776764 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1626, time: 2012-10-11 13:43:50.310404, event: throttled, request: pg_query(1.78 epoch 8) v2 -5755> 2012-10-11 13:43:50.776774 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1626, time: 2012-10-11 13:43:50.310415, event: all_read, request: pg_query(1.78 epoch 8) v2 -5754> 2012-10-11 13:43:50.776784 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1626, time: 2012-10-11 13:43:50.776751, event: dispatched, request: pg_query(1.78 epoch 8) v2 -5753> 2012-10-11 13:43:50.776796 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1626, time: 2012-10-11 13:43:50.776796, event: waiting_for_osdmap, request: pg_query(1.78 epoch 8) v2 -5752> 2012-10-11 13:43:50.776808 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1626, time: 2012-10-11 13:43:50.776807, event: started, request: pg_query(1.78 epoch 8) v2 -5751> 2012-10-11 13:43:50.776825 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1626, time: 2012-10-11 13:43:50.776825, event: done, request: pg_query(1.78 epoch 8) v2 -5750> 2012-10-11 13:43:50.776839 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 64061) -5749> 2012-10-11 13:43:50.776847 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 975 ==== osd pg remove(epoch 7; pg0.83; ) v1 ==== 25+0+0 (3233642068 0 0) 0x2498380 con 0x2fe2140 -5748> 2012-10-11 13:43:50.776862 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1627, time: 2012-10-11 13:43:49.386913, event: header_read, request: osd pg remove(epoch 7; pg0.83; ) v1 -5747> 2012-10-11 13:43:50.776874 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1627, time: 2012-10-11 13:43:49.386915, event: throttled, request: osd pg remove(epoch 7; pg0.83; ) v1 -5746> 2012-10-11 13:43:50.776884 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1627, time: 2012-10-11 13:43:49.386920, event: all_read, request: osd pg remove(epoch 7; pg0.83; ) v1 -5745> 2012-10-11 13:43:50.776895 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1627, time: 2012-10-11 13:43:50.776861, event: dispatched, request: osd pg remove(epoch 7; pg0.83; ) v1 -5744> 2012-10-11 13:43:50.776906 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1627, time: 2012-10-11 13:43:50.776906, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.83; ) v1 -5743> 2012-10-11 13:43:50.776917 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1627, time: 2012-10-11 13:43:50.776917, event: started, request: osd pg remove(epoch 7; pg0.83; ) v1 -5742> 2012-10-11 13:43:50.776928 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.83 -5741> 2012-10-11 13:43:50.776948 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.83 0x2130930)/0x2130930 -5740> 2012-10-11 13:43:50.776957 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5739> 2012-10-11 13:43:50.776964 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5738> 2012-10-11 13:43:50.776971 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4174 0x3039240 -5737> 2012-10-11 13:43:50.776980 7f440532f700 5 journal submit_entry seq 4174 len 205 (0x2328480) -5736> 2012-10-11 13:43:50.776988 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5735> 2012-10-11 13:43:50.776995 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5734> 2012-10-11 13:43:50.777019 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1627, time: 2012-10-11 13:43:50.777019, event: done, request: osd pg remove(epoch 7; pg0.83; ) v1 -5733> 2012-10-11 13:43:50.777035 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 64036) -5732> 2012-10-11 13:43:50.777044 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 631 ==== pg_query(1.34 epoch 8) v2 ==== 109+0+0 (686356684 0 0) 0x27a2540 con 0x2fe2280 -5731> 2012-10-11 13:43:50.777059 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1628, time: 2012-10-11 13:43:50.310427, event: header_read, request: pg_query(1.34 epoch 8) v2 -5730> 2012-10-11 13:43:50.777070 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1628, time: 2012-10-11 13:43:50.310433, event: throttled, request: pg_query(1.34 epoch 8) v2 -5729> 2012-10-11 13:43:50.777080 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1628, time: 2012-10-11 13:43:50.310438, event: all_read, request: pg_query(1.34 epoch 8) v2 -5728> 2012-10-11 13:43:50.777091 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1628, time: 2012-10-11 13:43:50.777058, event: dispatched, request: pg_query(1.34 epoch 8) v2 -5727> 2012-10-11 13:43:50.777101 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1628, time: 2012-10-11 13:43:50.777101, event: waiting_for_osdmap, request: pg_query(1.34 epoch 8) v2 -5726> 2012-10-11 13:43:50.777113 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1628, time: 2012-10-11 13:43:50.777113, event: started, request: pg_query(1.34 epoch 8) v2 -5725> 2012-10-11 13:43:50.777130 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1628, time: 2012-10-11 13:43:50.777130, event: done, request: pg_query(1.34 epoch 8) v2 -5724> 2012-10-11 13:43:50.777143 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 63927) -5723> 2012-10-11 13:43:50.777151 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 976 ==== osd pg remove(epoch 7; pg0.85; ) v1 ==== 25+0+0 (1943539319 0 0) 0x24981c0 con 0x2fe2140 -5722> 2012-10-11 13:43:50.777165 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1629, time: 2012-10-11 13:43:49.386922, event: header_read, request: osd pg remove(epoch 7; pg0.85; ) v1 -5721> 2012-10-11 13:43:50.777177 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1629, time: 2012-10-11 13:43:49.386924, event: throttled, request: osd pg remove(epoch 7; pg0.85; ) v1 -5720> 2012-10-11 13:43:50.777188 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1629, time: 2012-10-11 13:43:49.386928, event: all_read, request: osd pg remove(epoch 7; pg0.85; ) v1 -5719> 2012-10-11 13:43:50.777198 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1629, time: 2012-10-11 13:43:50.777164, event: dispatched, request: osd pg remove(epoch 7; pg0.85; ) v1 -5718> 2012-10-11 13:43:50.777209 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1629, time: 2012-10-11 13:43:50.777209, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.85; ) v1 -5717> 2012-10-11 13:43:50.777221 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1629, time: 2012-10-11 13:43:50.777221, event: started, request: osd pg remove(epoch 7; pg0.85; ) v1 -5716> 2012-10-11 13:43:50.777231 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.85 -5715> 2012-10-11 13:43:50.777258 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.85 0x2130c60)/0x2130c60 -5714> 2012-10-11 13:43:50.777269 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5713> 2012-10-11 13:43:50.777276 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5712> 2012-10-11 13:43:50.777283 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4175 0x3039d80 -5711> 2012-10-11 13:43:50.777294 7f440532f700 5 journal submit_entry seq 4175 len 205 (0x2328b70) -5710> 2012-10-11 13:43:50.777303 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5709> 2012-10-11 13:43:50.777310 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5708> 2012-10-11 13:43:50.777337 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1629, time: 2012-10-11 13:43:50.777337, event: done, request: osd pg remove(epoch 7; pg0.85; ) v1 -5707> 2012-10-11 13:43:50.777356 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 63902) -5706> 2012-10-11 13:43:50.777365 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 632 ==== pg_query(0.34 epoch 8) v2 ==== 109+0+0 (3967268779 0 0) 0x27a2380 con 0x2fe2280 -5705> 2012-10-11 13:43:50.777381 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1630, time: 2012-10-11 13:43:50.310459, event: header_read, request: pg_query(0.34 epoch 8) v2 -5704> 2012-10-11 13:43:50.777392 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1630, time: 2012-10-11 13:43:50.310465, event: throttled, request: pg_query(0.34 epoch 8) v2 -5703> 2012-10-11 13:43:50.777403 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1630, time: 2012-10-11 13:43:50.310471, event: all_read, request: pg_query(0.34 epoch 8) v2 -5702> 2012-10-11 13:43:50.777413 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1630, time: 2012-10-11 13:43:50.777379, event: dispatched, request: pg_query(0.34 epoch 8) v2 -5701> 2012-10-11 13:43:50.777423 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1630, time: 2012-10-11 13:43:50.777423, event: waiting_for_osdmap, request: pg_query(0.34 epoch 8) v2 -5700> 2012-10-11 13:43:50.777435 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1630, time: 2012-10-11 13:43:50.777435, event: started, request: pg_query(0.34 epoch 8) v2 -5699> 2012-10-11 13:43:50.777452 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1630, time: 2012-10-11 13:43:50.777452, event: done, request: pg_query(0.34 epoch 8) v2 -5698> 2012-10-11 13:43:50.777465 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 63793) -5697> 2012-10-11 13:43:50.777474 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 977 ==== osd pg remove(epoch 7; pg0.84; ) v1 ==== 25+0+0 (988050256 0 0) 0x2498000 con 0x2fe2140 -5696> 2012-10-11 13:43:50.777488 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1631, time: 2012-10-11 13:43:49.386930, event: header_read, request: osd pg remove(epoch 7; pg0.84; ) v1 -5695> 2012-10-11 13:43:50.777499 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1631, time: 2012-10-11 13:43:49.386932, event: throttled, request: osd pg remove(epoch 7; pg0.84; ) v1 -5694> 2012-10-11 13:43:50.777510 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1631, time: 2012-10-11 13:43:49.386935, event: all_read, request: osd pg remove(epoch 7; pg0.84; ) v1 -5693> 2012-10-11 13:43:50.777520 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1631, time: 2012-10-11 13:43:50.777487, event: dispatched, request: osd pg remove(epoch 7; pg0.84; ) v1 -5692> 2012-10-11 13:43:50.777531 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1631, time: 2012-10-11 13:43:50.777531, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.84; ) v1 -5691> 2012-10-11 13:43:50.777542 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1631, time: 2012-10-11 13:43:50.777542, event: started, request: osd pg remove(epoch 7; pg0.84; ) v1 -5690> 2012-10-11 13:43:50.777553 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.84 -5689> 2012-10-11 13:43:50.777573 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.84 0x2130c90)/0x2130c90 -5688> 2012-10-11 13:43:50.777583 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5687> 2012-10-11 13:43:50.777590 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5686> 2012-10-11 13:43:50.777597 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4176 0x3039e10 -5685> 2012-10-11 13:43:50.777606 7f440532f700 5 journal submit_entry seq 4176 len 205 (0x2328810) -5684> 2012-10-11 13:43:50.777614 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5683> 2012-10-11 13:43:50.777621 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5682> 2012-10-11 13:43:50.777644 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1631, time: 2012-10-11 13:43:50.777644, event: done, request: osd pg remove(epoch 7; pg0.84; ) v1 -5681> 2012-10-11 13:43:50.777661 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 63768) -5680> 2012-10-11 13:43:50.777670 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 633 ==== pg_query(2.77 epoch 8) v2 ==== 109+0+0 (2835672912 0 0) 0x27a21c0 con 0x2fe2280 -5679> 2012-10-11 13:43:50.777686 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1632, time: 2012-10-11 13:43:50.310475, event: header_read, request: pg_query(2.77 epoch 8) v2 -5678> 2012-10-11 13:43:50.777697 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1632, time: 2012-10-11 13:43:50.310478, event: throttled, request: pg_query(2.77 epoch 8) v2 -5677> 2012-10-11 13:43:50.777708 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1632, time: 2012-10-11 13:43:50.310491, event: all_read, request: pg_query(2.77 epoch 8) v2 -5676> 2012-10-11 13:43:50.777718 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1632, time: 2012-10-11 13:43:50.777684, event: dispatched, request: pg_query(2.77 epoch 8) v2 -5675> 2012-10-11 13:43:50.777729 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1632, time: 2012-10-11 13:43:50.777729, event: waiting_for_osdmap, request: pg_query(2.77 epoch 8) v2 -5674> 2012-10-11 13:43:50.777741 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1632, time: 2012-10-11 13:43:50.777741, event: started, request: pg_query(2.77 epoch 8) v2 -5673> 2012-10-11 13:43:50.777758 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1632, time: 2012-10-11 13:43:50.777758, event: done, request: pg_query(2.77 epoch 8) v2 -5672> 2012-10-11 13:43:50.777771 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 63659) -5671> 2012-10-11 13:43:50.777780 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 978 ==== osd pg remove(epoch 7; pg0.86; ) v1 ==== 25+0+0 (2828831006 0 0) 0x2925e00 con 0x2fe2140 -5670> 2012-10-11 13:43:50.777794 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1633, time: 2012-10-11 13:43:49.386938, event: header_read, request: osd pg remove(epoch 7; pg0.86; ) v1 -5669> 2012-10-11 13:43:50.777805 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1633, time: 2012-10-11 13:43:49.386940, event: throttled, request: osd pg remove(epoch 7; pg0.86; ) v1 -5668> 2012-10-11 13:43:50.777816 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1633, time: 2012-10-11 13:43:49.386944, event: all_read, request: osd pg remove(epoch 7; pg0.86; ) v1 -5667> 2012-10-11 13:43:50.777826 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1633, time: 2012-10-11 13:43:50.777792, event: dispatched, request: osd pg remove(epoch 7; pg0.86; ) v1 -5666> 2012-10-11 13:43:50.777837 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1633, time: 2012-10-11 13:43:50.777837, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.86; ) v1 -5665> 2012-10-11 13:43:50.777848 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1633, time: 2012-10-11 13:43:50.777848, event: started, request: osd pg remove(epoch 7; pg0.86; ) v1 -5664> 2012-10-11 13:43:50.777858 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.86 -5663> 2012-10-11 13:43:50.777878 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.86 0x2130c30)/0x2130c30 -5662> 2012-10-11 13:43:50.777888 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5661> 2012-10-11 13:43:50.777895 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5660> 2012-10-11 13:43:50.777902 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4177 0x3039cf0 -5659> 2012-10-11 13:43:50.777911 7f440532f700 5 journal submit_entry seq 4177 len 205 (0x23289c0) -5658> 2012-10-11 13:43:50.777919 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5657> 2012-10-11 13:43:50.777927 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5656> 2012-10-11 13:43:50.777949 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1633, time: 2012-10-11 13:43:50.777949, event: done, request: osd pg remove(epoch 7; pg0.86; ) v1 -5655> 2012-10-11 13:43:50.777966 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 63634) -5654> 2012-10-11 13:43:50.777975 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 634 ==== pg_query(2.33 epoch 8) v2 ==== 109+0+0 (1976316973 0 0) 0x27a2000 con 0x2fe2280 -5653> 2012-10-11 13:43:50.777991 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1634, time: 2012-10-11 13:43:50.310495, event: header_read, request: pg_query(2.33 epoch 8) v2 -5652> 2012-10-11 13:43:50.778002 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1634, time: 2012-10-11 13:43:50.310499, event: throttled, request: pg_query(2.33 epoch 8) v2 -5651> 2012-10-11 13:43:50.778012 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1634, time: 2012-10-11 13:43:50.310505, event: all_read, request: pg_query(2.33 epoch 8) v2 -5650> 2012-10-11 13:43:50.778022 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1634, time: 2012-10-11 13:43:50.777989, event: dispatched, request: pg_query(2.33 epoch 8) v2 -5649> 2012-10-11 13:43:50.778033 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1634, time: 2012-10-11 13:43:50.778033, event: waiting_for_osdmap, request: pg_query(2.33 epoch 8) v2 -5648> 2012-10-11 13:43:50.778044 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1634, time: 2012-10-11 13:43:50.778044, event: started, request: pg_query(2.33 epoch 8) v2 -5647> 2012-10-11 13:43:50.778062 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1634, time: 2012-10-11 13:43:50.778062, event: done, request: pg_query(2.33 epoch 8) v2 -5646> 2012-10-11 13:43:50.778075 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 63525) -5645> 2012-10-11 13:43:50.778084 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 979 ==== osd pg remove(epoch 7; pg0.89; ) v1 ==== 25+0+0 (285116608 0 0) 0x2925c40 con 0x2fe2140 -5644> 2012-10-11 13:43:50.778098 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1635, time: 2012-10-11 13:43:49.386946, event: header_read, request: osd pg remove(epoch 7; pg0.89; ) v1 -5643> 2012-10-11 13:43:50.778110 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1635, time: 2012-10-11 13:43:49.386948, event: throttled, request: osd pg remove(epoch 7; pg0.89; ) v1 -5642> 2012-10-11 13:43:50.778120 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1635, time: 2012-10-11 13:43:49.386951, event: all_read, request: osd pg remove(epoch 7; pg0.89; ) v1 -5641> 2012-10-11 13:43:50.778131 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1635, time: 2012-10-11 13:43:50.778097, event: dispatched, request: osd pg remove(epoch 7; pg0.89; ) v1 -5640> 2012-10-11 13:43:50.778141 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1635, time: 2012-10-11 13:43:50.778141, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg0.89; ) v1 -5639> 2012-10-11 13:43:50.778156 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1635, time: 2012-10-11 13:43:50.778156, event: started, request: osd pg remove(epoch 7; pg0.89; ) v1 -5638> 2012-10-11 13:43:50.778166 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.89 -5637> 2012-10-11 13:43:50.778186 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.89 0x2130ba0)/0x2130ba0 -5636> 2012-10-11 13:43:50.778196 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5635> 2012-10-11 13:43:50.778203 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5634> 2012-10-11 13:43:50.778210 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4178 0x3039c60 -5633> 2012-10-11 13:43:50.778218 7f440532f700 5 journal submit_entry seq 4178 len 205 (0x2328660) -5632> 2012-10-11 13:43:50.778227 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5631> 2012-10-11 13:43:50.778234 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5630> 2012-10-11 13:43:50.778260 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1635, time: 2012-10-11 13:43:50.778259, event: done, request: osd pg remove(epoch 7; pg0.89; ) v1 -5629> 2012-10-11 13:43:50.778277 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 63500) -5628> 2012-10-11 13:43:50.778285 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 635 ==== pg_query(2.2c epoch 8) v2 ==== 109+0+0 (693618748 0 0) 0x2141e00 con 0x2fe2280 -5627> 2012-10-11 13:43:50.778301 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1636, time: 2012-10-11 13:43:50.310526, event: header_read, request: pg_query(2.2c epoch 8) v2 -5626> 2012-10-11 13:43:50.778312 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1636, time: 2012-10-11 13:43:50.310532, event: throttled, request: pg_query(2.2c epoch 8) v2 -5625> 2012-10-11 13:43:50.778324 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1636, time: 2012-10-11 13:43:50.310538, event: all_read, request: pg_query(2.2c epoch 8) v2 -5624> 2012-10-11 13:43:50.778334 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1636, time: 2012-10-11 13:43:50.778300, event: dispatched, request: pg_query(2.2c epoch 8) v2 -5623> 2012-10-11 13:43:50.778345 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1636, time: 2012-10-11 13:43:50.778345, event: waiting_for_osdmap, request: pg_query(2.2c epoch 8) v2 -5622> 2012-10-11 13:43:50.778356 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1636, time: 2012-10-11 13:43:50.778356, event: started, request: pg_query(2.2c epoch 8) v2 -5621> 2012-10-11 13:43:50.778374 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1636, time: 2012-10-11 13:43:50.778374, event: done, request: pg_query(2.2c epoch 8) v2 -5620> 2012-10-11 13:43:50.778387 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 63391) -5619> 2012-10-11 13:43:50.778395 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 980 ==== osd pg remove(epoch 7; pg1.23; ) v1 ==== 25+0+0 (196118615 0 0) 0x2925a80 con 0x2fe2140 -5618> 2012-10-11 13:43:50.778410 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1637, time: 2012-10-11 13:43:49.386954, event: header_read, request: osd pg remove(epoch 7; pg1.23; ) v1 -5617> 2012-10-11 13:43:50.778421 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1637, time: 2012-10-11 13:43:49.386956, event: throttled, request: osd pg remove(epoch 7; pg1.23; ) v1 -5616> 2012-10-11 13:43:50.778432 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1637, time: 2012-10-11 13:43:49.386984, event: all_read, request: osd pg remove(epoch 7; pg1.23; ) v1 -5615> 2012-10-11 13:43:50.778442 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1637, time: 2012-10-11 13:43:50.778409, event: dispatched, request: osd pg remove(epoch 7; pg1.23; ) v1 -5614> 2012-10-11 13:43:50.778453 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1637, time: 2012-10-11 13:43:50.778453, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.23; ) v1 -5613> 2012-10-11 13:43:50.778465 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1637, time: 2012-10-11 13:43:50.778465, event: started, request: osd pg remove(epoch 7; pg1.23; ) v1 -5612> 2012-10-11 13:43:50.778475 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.23 -5611> 2012-10-11 13:43:50.778495 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.23 0x27a1910)/0x27a1910 -5610> 2012-10-11 13:43:50.778505 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5609> 2012-10-11 13:43:50.778512 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5608> 2012-10-11 13:43:50.778519 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4179 0x3039bd0 -5607> 2012-10-11 13:43:50.778527 7f440532f700 5 journal submit_entry seq 4179 len 205 (0x2388540) -5606> 2012-10-11 13:43:50.778536 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5605> 2012-10-11 13:43:50.778543 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5604> 2012-10-11 13:43:50.778567 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1637, time: 2012-10-11 13:43:50.778567, event: done, request: osd pg remove(epoch 7; pg1.23; ) v1 -5603> 2012-10-11 13:43:50.778587 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 63366) -5602> 2012-10-11 13:43:50.778596 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 636 ==== pg_query(0.2e epoch 8) v2 ==== 109+0+0 (2880355493 0 0) 0x2141c40 con 0x2fe2280 -5601> 2012-10-11 13:43:50.778612 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1638, time: 2012-10-11 13:43:50.310543, event: header_read, request: pg_query(0.2e epoch 8) v2 -5600> 2012-10-11 13:43:50.778623 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1638, time: 2012-10-11 13:43:50.310546, event: throttled, request: pg_query(0.2e epoch 8) v2 -5599> 2012-10-11 13:43:50.778633 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1638, time: 2012-10-11 13:43:50.310561, event: all_read, request: pg_query(0.2e epoch 8) v2 -5598> 2012-10-11 13:43:50.778643 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1638, time: 2012-10-11 13:43:50.778610, event: dispatched, request: pg_query(0.2e epoch 8) v2 -5597> 2012-10-11 13:43:50.778654 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1638, time: 2012-10-11 13:43:50.778654, event: waiting_for_osdmap, request: pg_query(0.2e epoch 8) v2 -5596> 2012-10-11 13:43:50.778666 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1638, time: 2012-10-11 13:43:50.778666, event: started, request: pg_query(0.2e epoch 8) v2 -5595> 2012-10-11 13:43:50.778683 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1638, time: 2012-10-11 13:43:50.778683, event: done, request: pg_query(0.2e epoch 8) v2 -5594> 2012-10-11 13:43:50.778696 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 63257) -5593> 2012-10-11 13:43:50.778706 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 981 ==== osd pg remove(epoch 7; pg1.2b; ) v1 ==== 25+0+0 (1233882253 0 0) 0x29258c0 con 0x2fe2140 -5592> 2012-10-11 13:43:50.778721 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1639, time: 2012-10-11 13:43:49.386988, event: header_read, request: osd pg remove(epoch 7; pg1.2b; ) v1 -5591> 2012-10-11 13:43:50.778732 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1639, time: 2012-10-11 13:43:49.386991, event: throttled, request: osd pg remove(epoch 7; pg1.2b; ) v1 -5590> 2012-10-11 13:43:50.778742 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1639, time: 2012-10-11 13:43:49.386995, event: all_read, request: osd pg remove(epoch 7; pg1.2b; ) v1 -5589> 2012-10-11 13:43:50.778753 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1639, time: 2012-10-11 13:43:50.778719, event: dispatched, request: osd pg remove(epoch 7; pg1.2b; ) v1 -5588> 2012-10-11 13:43:50.778764 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1639, time: 2012-10-11 13:43:50.778764, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.2b; ) v1 -5587> 2012-10-11 13:43:50.778775 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1639, time: 2012-10-11 13:43:50.778775, event: started, request: osd pg remove(epoch 7; pg1.2b; ) v1 -5586> 2012-10-11 13:43:50.778786 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.2b -5585> 2012-10-11 13:43:50.778805 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.2b 0x27a1b90)/0x27a1b90 -5584> 2012-10-11 13:43:50.778815 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5583> 2012-10-11 13:43:50.778822 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5582> 2012-10-11 13:43:50.778830 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4180 0x24bc120 -5581> 2012-10-11 13:43:50.778838 7f440532f700 5 journal submit_entry seq 4180 len 205 (0x2922f30) -5580> 2012-10-11 13:43:50.778847 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5579> 2012-10-11 13:43:50.778854 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5578> 2012-10-11 13:43:50.778877 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1639, time: 2012-10-11 13:43:50.778877, event: done, request: osd pg remove(epoch 7; pg1.2b; ) v1 -5577> 2012-10-11 13:43:50.778894 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 63232) -5576> 2012-10-11 13:43:50.778903 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 637 ==== pg_query(0.2d epoch 8) v2 ==== 109+0+0 (2727407184 0 0) 0x2141a80 con 0x2fe2280 -5575> 2012-10-11 13:43:50.778918 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1640, time: 2012-10-11 13:43:50.310744, event: header_read, request: pg_query(0.2d epoch 8) v2 -5574> 2012-10-11 13:43:50.778929 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1640, time: 2012-10-11 13:43:50.310751, event: throttled, request: pg_query(0.2d epoch 8) v2 -5573> 2012-10-11 13:43:50.778939 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1640, time: 2012-10-11 13:43:50.310757, event: all_read, request: pg_query(0.2d epoch 8) v2 -5572> 2012-10-11 13:43:50.778950 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1640, time: 2012-10-11 13:43:50.778916, event: dispatched, request: pg_query(0.2d epoch 8) v2 -5571> 2012-10-11 13:43:50.778960 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1640, time: 2012-10-11 13:43:50.778960, event: waiting_for_osdmap, request: pg_query(0.2d epoch 8) v2 -5570> 2012-10-11 13:43:50.778972 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1640, time: 2012-10-11 13:43:50.778972, event: started, request: pg_query(0.2d epoch 8) v2 -5569> 2012-10-11 13:43:50.778990 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1640, time: 2012-10-11 13:43:50.778989, event: done, request: pg_query(0.2d epoch 8) v2 -5568> 2012-10-11 13:43:50.779002 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 63123) -5567> 2012-10-11 13:43:50.779012 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 982 ==== osd pg remove(epoch 7; pg1.31; ) v1 ==== 25+0+0 (499022765 0 0) 0x2925700 con 0x2fe2140 -5566> 2012-10-11 13:43:50.779026 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1641, time: 2012-10-11 13:43:49.387000, event: header_read, request: osd pg remove(epoch 7; pg1.31; ) v1 -5565> 2012-10-11 13:43:50.779037 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1641, time: 2012-10-11 13:43:49.387002, event: throttled, request: osd pg remove(epoch 7; pg1.31; ) v1 -5564> 2012-10-11 13:43:50.779048 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1641, time: 2012-10-11 13:43:49.387005, event: all_read, request: osd pg remove(epoch 7; pg1.31; ) v1 -5563> 2012-10-11 13:43:50.779058 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1641, time: 2012-10-11 13:43:50.779025, event: dispatched, request: osd pg remove(epoch 7; pg1.31; ) v1 -5562> 2012-10-11 13:43:50.779069 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1641, time: 2012-10-11 13:43:50.779069, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.31; ) v1 -5561> 2012-10-11 13:43:50.779081 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1641, time: 2012-10-11 13:43:50.779081, event: started, request: osd pg remove(epoch 7; pg1.31; ) v1 -5560> 2012-10-11 13:43:50.779091 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.31 -5559> 2012-10-11 13:43:50.779111 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.31 0x27a1a70)/0x27a1a70 -5558> 2012-10-11 13:43:50.779121 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5557> 2012-10-11 13:43:50.779128 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5556> 2012-10-11 13:43:50.779135 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4181 0x24bc000 -5555> 2012-10-11 13:43:50.779144 7f440532f700 5 journal submit_entry seq 4181 len 205 (0x296f630) -5554> 2012-10-11 13:43:50.779152 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5553> 2012-10-11 13:43:50.779159 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5552> 2012-10-11 13:43:50.785866 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1641, time: 2012-10-11 13:43:50.785866, event: done, request: osd pg remove(epoch 7; pg1.31; ) v1 -5551> 2012-10-11 13:43:50.785895 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 63098) -5550> 2012-10-11 13:43:50.785905 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 638 ==== pg_query(1.2c epoch 8) v2 ==== 109+0+0 (1629122404 0 0) 0x21418c0 con 0x2fe2280 -5549> 2012-10-11 13:43:50.785924 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1642, time: 2012-10-11 13:43:50.311317, event: header_read, request: pg_query(1.2c epoch 8) v2 -5548> 2012-10-11 13:43:50.785935 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1642, time: 2012-10-11 13:43:50.311326, event: throttled, request: pg_query(1.2c epoch 8) v2 -5547> 2012-10-11 13:43:50.785945 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1642, time: 2012-10-11 13:43:50.311348, event: all_read, request: pg_query(1.2c epoch 8) v2 -5546> 2012-10-11 13:43:50.785955 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1642, time: 2012-10-11 13:43:50.785922, event: dispatched, request: pg_query(1.2c epoch 8) v2 -5545> 2012-10-11 13:43:50.785966 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1642, time: 2012-10-11 13:43:50.785966, event: waiting_for_osdmap, request: pg_query(1.2c epoch 8) v2 -5544> 2012-10-11 13:43:50.785978 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1642, time: 2012-10-11 13:43:50.785978, event: started, request: pg_query(1.2c epoch 8) v2 -5543> 2012-10-11 13:43:50.785996 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1642, time: 2012-10-11 13:43:50.785996, event: done, request: pg_query(1.2c epoch 8) v2 -5542> 2012-10-11 13:43:50.786009 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 62989) -5541> 2012-10-11 13:43:50.786017 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 983 ==== osd pg remove(epoch 7; pg1.32; ) v1 ==== 25+0+0 (3338337476 0 0) 0x2925540 con 0x2fe2140 -5540> 2012-10-11 13:43:50.786032 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1643, time: 2012-10-11 13:43:49.387008, event: header_read, request: osd pg remove(epoch 7; pg1.32; ) v1 -5539> 2012-10-11 13:43:50.786043 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1643, time: 2012-10-11 13:43:49.387010, event: throttled, request: osd pg remove(epoch 7; pg1.32; ) v1 -5538> 2012-10-11 13:43:50.786053 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1643, time: 2012-10-11 13:43:49.387013, event: all_read, request: osd pg remove(epoch 7; pg1.32; ) v1 -5537> 2012-10-11 13:43:50.786063 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1643, time: 2012-10-11 13:43:50.786030, event: dispatched, request: osd pg remove(epoch 7; pg1.32; ) v1 -5536> 2012-10-11 13:43:50.786074 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1643, time: 2012-10-11 13:43:50.786074, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.32; ) v1 -5535> 2012-10-11 13:43:50.786085 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1643, time: 2012-10-11 13:43:50.786085, event: started, request: osd pg remove(epoch 7; pg1.32; ) v1 -5534> 2012-10-11 13:43:50.786095 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.32 -5533> 2012-10-11 13:43:50.786118 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.32 0x27a1a40)/0x27a1a40 -5532> 2012-10-11 13:43:50.786129 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5531> 2012-10-11 13:43:50.786138 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5530> 2012-10-11 13:43:50.786146 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4182 0x24bc1b0 -5529> 2012-10-11 13:43:50.786156 7f440532f700 5 journal submit_entry seq 4182 len 205 (0x29c6ae0) -5528> 2012-10-11 13:43:50.786164 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5527> 2012-10-11 13:43:50.786171 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5526> 2012-10-11 13:43:50.786198 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1643, time: 2012-10-11 13:43:50.786198, event: done, request: osd pg remove(epoch 7; pg1.32; ) v1 -5525> 2012-10-11 13:43:50.786216 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 62964) -5524> 2012-10-11 13:43:50.786224 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 639 ==== pg_query(0.70 epoch 8) v2 ==== 109+0+0 (817851606 0 0) 0x2141700 con 0x2fe2280 -5523> 2012-10-11 13:43:50.786240 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1644, time: 2012-10-11 13:43:50.311523, event: header_read, request: pg_query(0.70 epoch 8) v2 -5522> 2012-10-11 13:43:50.786251 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1644, time: 2012-10-11 13:43:50.311531, event: throttled, request: pg_query(0.70 epoch 8) v2 -5521> 2012-10-11 13:43:50.786261 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1644, time: 2012-10-11 13:43:50.311538, event: all_read, request: pg_query(0.70 epoch 8) v2 -5520> 2012-10-11 13:43:50.786271 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1644, time: 2012-10-11 13:43:50.786238, event: dispatched, request: pg_query(0.70 epoch 8) v2 -5519> 2012-10-11 13:43:50.786282 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1644, time: 2012-10-11 13:43:50.786282, event: waiting_for_osdmap, request: pg_query(0.70 epoch 8) v2 -5518> 2012-10-11 13:43:50.786294 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1644, time: 2012-10-11 13:43:50.786294, event: started, request: pg_query(0.70 epoch 8) v2 -5517> 2012-10-11 13:43:50.786311 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1644, time: 2012-10-11 13:43:50.786311, event: done, request: pg_query(0.70 epoch 8) v2 -5516> 2012-10-11 13:43:50.786324 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 62855) -5515> 2012-10-11 13:43:50.786332 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 984 ==== osd pg remove(epoch 7; pg1.37; ) v1 ==== 25+0+0 (2933588878 0 0) 0x2925380 con 0x2fe2140 -5514> 2012-10-11 13:43:50.786346 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1645, time: 2012-10-11 13:43:49.387015, event: header_read, request: osd pg remove(epoch 7; pg1.37; ) v1 -5513> 2012-10-11 13:43:50.786357 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1645, time: 2012-10-11 13:43:49.387017, event: throttled, request: osd pg remove(epoch 7; pg1.37; ) v1 -5512> 2012-10-11 13:43:50.786367 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1645, time: 2012-10-11 13:43:49.387021, event: all_read, request: osd pg remove(epoch 7; pg1.37; ) v1 -5511> 2012-10-11 13:43:50.786378 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1645, time: 2012-10-11 13:43:50.786345, event: dispatched, request: osd pg remove(epoch 7; pg1.37; ) v1 -5510> 2012-10-11 13:43:50.786388 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1645, time: 2012-10-11 13:43:50.786388, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.37; ) v1 -5509> 2012-10-11 13:43:50.786399 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1645, time: 2012-10-11 13:43:50.786399, event: started, request: osd pg remove(epoch 7; pg1.37; ) v1 -5508> 2012-10-11 13:43:50.786410 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.37 -5507> 2012-10-11 13:43:50.786430 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.37 0x27a1d50)/0x27a1d50 -5506> 2012-10-11 13:43:50.786440 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5505> 2012-10-11 13:43:50.786446 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5504> 2012-10-11 13:43:50.786454 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4183 0x3157d80 -5503> 2012-10-11 13:43:50.786462 7f440532f700 5 journal submit_entry seq 4183 len 205 (0x29c6900) -5502> 2012-10-11 13:43:50.786470 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5501> 2012-10-11 13:43:50.786477 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5500> 2012-10-11 13:43:50.786500 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1645, time: 2012-10-11 13:43:50.786500, event: done, request: osd pg remove(epoch 7; pg1.37; ) v1 -5499> 2012-10-11 13:43:50.786517 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 62830) -5498> 2012-10-11 13:43:50.786525 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 640 ==== pg_query(1.2d epoch 8) v2 ==== 109+0+0 (1712300343 0 0) 0x2141540 con 0x2fe2280 -5497> 2012-10-11 13:43:50.786542 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1646, time: 2012-10-11 13:43:50.311724, event: header_read, request: pg_query(1.2d epoch 8) v2 -5496> 2012-10-11 13:43:50.786552 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1646, time: 2012-10-11 13:43:50.311733, event: throttled, request: pg_query(1.2d epoch 8) v2 -5495> 2012-10-11 13:43:50.786563 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1646, time: 2012-10-11 13:43:50.311751, event: all_read, request: pg_query(1.2d epoch 8) v2 -5494> 2012-10-11 13:43:50.786573 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1646, time: 2012-10-11 13:43:50.786540, event: dispatched, request: pg_query(1.2d epoch 8) v2 -5493> 2012-10-11 13:43:50.786585 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1646, time: 2012-10-11 13:43:50.786585, event: waiting_for_osdmap, request: pg_query(1.2d epoch 8) v2 -5492> 2012-10-11 13:43:50.786597 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1646, time: 2012-10-11 13:43:50.786597, event: started, request: pg_query(1.2d epoch 8) v2 -5491> 2012-10-11 13:43:50.786615 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1646, time: 2012-10-11 13:43:50.786614, event: done, request: pg_query(1.2d epoch 8) v2 -5490> 2012-10-11 13:43:50.786628 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 62721) -5489> 2012-10-11 13:43:50.786636 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 985 ==== osd pg remove(epoch 7; pg1.3b; ) v1 ==== 25+0+0 (3455943993 0 0) 0x29251c0 con 0x2fe2140 -5488> 2012-10-11 13:43:50.786650 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1647, time: 2012-10-11 13:43:49.387023, event: header_read, request: osd pg remove(epoch 7; pg1.3b; ) v1 -5487> 2012-10-11 13:43:50.786662 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1647, time: 2012-10-11 13:43:49.387025, event: throttled, request: osd pg remove(epoch 7; pg1.3b; ) v1 -5486> 2012-10-11 13:43:50.786672 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1647, time: 2012-10-11 13:43:49.387028, event: all_read, request: osd pg remove(epoch 7; pg1.3b; ) v1 -5485> 2012-10-11 13:43:50.786683 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1647, time: 2012-10-11 13:43:50.786649, event: dispatched, request: osd pg remove(epoch 7; pg1.3b; ) v1 -5484> 2012-10-11 13:43:50.786693 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1647, time: 2012-10-11 13:43:50.786693, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.3b; ) v1 -5483> 2012-10-11 13:43:50.786705 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1647, time: 2012-10-11 13:43:50.786704, event: started, request: osd pg remove(epoch 7; pg1.3b; ) v1 -5482> 2012-10-11 13:43:50.786715 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.3b -5481> 2012-10-11 13:43:50.786735 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.3b 0x27a1c90)/0x27a1c90 -5480> 2012-10-11 13:43:50.786744 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5479> 2012-10-11 13:43:50.786751 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5478> 2012-10-11 13:43:50.786758 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4184 0x31571b0 -5477> 2012-10-11 13:43:50.786767 7f440532f700 5 journal submit_entry seq 4184 len 205 (0x2a16390) -5476> 2012-10-11 13:43:50.786775 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5475> 2012-10-11 13:43:50.786782 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5474> 2012-10-11 13:43:50.786806 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1647, time: 2012-10-11 13:43:50.786806, event: done, request: osd pg remove(epoch 7; pg1.3b; ) v1 -5473> 2012-10-11 13:43:50.786823 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 62696) -5472> 2012-10-11 13:43:50.786832 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 641 ==== pg_query(1.6f epoch 8) v2 ==== 109+0+0 (2830884768 0 0) 0x2141380 con 0x2fe2280 -5471> 2012-10-11 13:43:50.786848 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1648, time: 2012-10-11 13:43:50.311856, event: header_read, request: pg_query(1.6f epoch 8) v2 -5470> 2012-10-11 13:43:50.786859 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1648, time: 2012-10-11 13:43:50.311864, event: throttled, request: pg_query(1.6f epoch 8) v2 -5469> 2012-10-11 13:43:50.786869 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1648, time: 2012-10-11 13:43:50.311871, event: all_read, request: pg_query(1.6f epoch 8) v2 -5468> 2012-10-11 13:43:50.786879 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1648, time: 2012-10-11 13:43:50.786846, event: dispatched, request: pg_query(1.6f epoch 8) v2 -5467> 2012-10-11 13:43:50.786890 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1648, time: 2012-10-11 13:43:50.786890, event: waiting_for_osdmap, request: pg_query(1.6f epoch 8) v2 -5466> 2012-10-11 13:43:50.786901 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1648, time: 2012-10-11 13:43:50.786901, event: started, request: pg_query(1.6f epoch 8) v2 -5465> 2012-10-11 13:43:50.786919 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1648, time: 2012-10-11 13:43:50.786919, event: done, request: pg_query(1.6f epoch 8) v2 -5464> 2012-10-11 13:43:50.786932 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 62587) -5463> 2012-10-11 13:43:50.786941 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 986 ==== osd pg remove(epoch 7; pg1.3f; ) v1 ==== 25+0+0 (3974104916 0 0) 0x2925000 con 0x2fe2140 -5462> 2012-10-11 13:43:50.786955 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1649, time: 2012-10-11 13:43:49.387031, event: header_read, request: osd pg remove(epoch 7; pg1.3f; ) v1 -5461> 2012-10-11 13:43:50.786966 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1649, time: 2012-10-11 13:43:49.387033, event: throttled, request: osd pg remove(epoch 7; pg1.3f; ) v1 -5460> 2012-10-11 13:43:50.786977 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1649, time: 2012-10-11 13:43:49.387036, event: all_read, request: osd pg remove(epoch 7; pg1.3f; ) v1 -5459> 2012-10-11 13:43:50.786989 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1649, time: 2012-10-11 13:43:50.786954, event: dispatched, request: osd pg remove(epoch 7; pg1.3f; ) v1 -5458> 2012-10-11 13:43:50.787000 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1649, time: 2012-10-11 13:43:50.787000, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.3f; ) v1 -5457> 2012-10-11 13:43:50.787011 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1649, time: 2012-10-11 13:43:50.787011, event: started, request: osd pg remove(epoch 7; pg1.3f; ) v1 -5456> 2012-10-11 13:43:50.787022 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.3f -5455> 2012-10-11 13:43:50.787041 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.3f 0x27a1fd0)/0x27a1fd0 -5454> 2012-10-11 13:43:50.787051 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5453> 2012-10-11 13:43:50.787058 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5452> 2012-10-11 13:43:50.787065 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4185 0x3157f30 -5451> 2012-10-11 13:43:50.787074 7f440532f700 5 journal submit_entry seq 4185 len 205 (0x2a16810) -5450> 2012-10-11 13:43:50.787082 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5449> 2012-10-11 13:43:50.787089 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5448> 2012-10-11 13:43:50.787116 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1649, time: 2012-10-11 13:43:50.787116, event: done, request: osd pg remove(epoch 7; pg1.3f; ) v1 -5447> 2012-10-11 13:43:50.787134 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 62562) -5446> 2012-10-11 13:43:50.787142 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 642 ==== pg_query(2.28 epoch 8) v2 ==== 109+0+0 (889254256 0 0) 0x21411c0 con 0x2fe2280 -5445> 2012-10-11 13:43:50.787158 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1650, time: 2012-10-11 13:43:50.312046, event: header_read, request: pg_query(2.28 epoch 8) v2 -5444> 2012-10-11 13:43:50.787169 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1650, time: 2012-10-11 13:43:50.312054, event: throttled, request: pg_query(2.28 epoch 8) v2 -5443> 2012-10-11 13:43:50.787179 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1650, time: 2012-10-11 13:43:50.312075, event: all_read, request: pg_query(2.28 epoch 8) v2 -5442> 2012-10-11 13:43:50.787189 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1650, time: 2012-10-11 13:43:50.787156, event: dispatched, request: pg_query(2.28 epoch 8) v2 -5441> 2012-10-11 13:43:50.787199 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1650, time: 2012-10-11 13:43:50.787199, event: waiting_for_osdmap, request: pg_query(2.28 epoch 8) v2 -5440> 2012-10-11 13:43:50.787211 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1650, time: 2012-10-11 13:43:50.787211, event: started, request: pg_query(2.28 epoch 8) v2 -5439> 2012-10-11 13:43:50.787228 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1650, time: 2012-10-11 13:43:50.787228, event: done, request: pg_query(2.28 epoch 8) v2 -5438> 2012-10-11 13:43:50.787241 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 62453) -5437> 2012-10-11 13:43:50.787250 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 987 ==== osd pg remove(epoch 7; pg1.2e; ) v1 ==== 25+0+0 (564818887 0 0) 0x2a8ce00 con 0x2fe2140 -5436> 2012-10-11 13:43:50.787264 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1651, time: 2012-10-11 13:43:49.387038, event: header_read, request: osd pg remove(epoch 7; pg1.2e; ) v1 -5435> 2012-10-11 13:43:50.787275 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1651, time: 2012-10-11 13:43:49.387041, event: throttled, request: osd pg remove(epoch 7; pg1.2e; ) v1 -5434> 2012-10-11 13:43:50.787285 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1651, time: 2012-10-11 13:43:49.387045, event: all_read, request: osd pg remove(epoch 7; pg1.2e; ) v1 -5433> 2012-10-11 13:43:50.787296 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1651, time: 2012-10-11 13:43:50.787263, event: dispatched, request: osd pg remove(epoch 7; pg1.2e; ) v1 -5432> 2012-10-11 13:43:50.787307 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1651, time: 2012-10-11 13:43:50.787307, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.2e; ) v1 -5431> 2012-10-11 13:43:50.787319 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1651, time: 2012-10-11 13:43:50.787319, event: started, request: osd pg remove(epoch 7; pg1.2e; ) v1 -5430> 2012-10-11 13:43:50.787329 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.2e -5429> 2012-10-11 13:43:50.787348 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.2e 0x27a1b00)/0x27a1b00 -5428> 2012-10-11 13:43:50.787358 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5427> 2012-10-11 13:43:50.787365 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5426> 2012-10-11 13:43:50.787372 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4186 0x31576c0 -5425> 2012-10-11 13:43:50.787381 7f440532f700 5 journal submit_entry seq 4186 len 205 (0x2a69480) -5424> 2012-10-11 13:43:50.787389 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5423> 2012-10-11 13:43:50.787397 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5422> 2012-10-11 13:43:50.787421 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1651, time: 2012-10-11 13:43:50.787421, event: done, request: osd pg remove(epoch 7; pg1.2e; ) v1 -5421> 2012-10-11 13:43:50.787437 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 62428) -5420> 2012-10-11 13:43:50.787446 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 643 ==== pg_query(0.2a epoch 8) v2 ==== 109+0+0 (3086583273 0 0) 0x2141000 con 0x2fe2280 -5419> 2012-10-11 13:43:50.787462 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1652, time: 2012-10-11 13:43:50.312274, event: header_read, request: pg_query(0.2a epoch 8) v2 -5418> 2012-10-11 13:43:50.787472 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1652, time: 2012-10-11 13:43:50.312284, event: throttled, request: pg_query(0.2a epoch 8) v2 -5417> 2012-10-11 13:43:50.787483 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1652, time: 2012-10-11 13:43:50.312294, event: all_read, request: pg_query(0.2a epoch 8) v2 -5416> 2012-10-11 13:43:50.787493 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1652, time: 2012-10-11 13:43:50.787460, event: dispatched, request: pg_query(0.2a epoch 8) v2 -5415> 2012-10-11 13:43:50.787503 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1652, time: 2012-10-11 13:43:50.787503, event: waiting_for_osdmap, request: pg_query(0.2a epoch 8) v2 -5414> 2012-10-11 13:43:50.787515 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1652, time: 2012-10-11 13:43:50.787515, event: started, request: pg_query(0.2a epoch 8) v2 -5413> 2012-10-11 13:43:50.787532 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1652, time: 2012-10-11 13:43:50.787532, event: done, request: pg_query(0.2a epoch 8) v2 -5412> 2012-10-11 13:43:50.787545 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 62319) -5411> 2012-10-11 13:43:50.787553 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 988 ==== osd pg remove(epoch 7; pg1.5b; ) v1 ==== 25+0+0 (3674024850 0 0) 0x2a8cc40 con 0x2fe2140 -5410> 2012-10-11 13:43:50.787568 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1653, time: 2012-10-11 13:43:49.387048, event: header_read, request: osd pg remove(epoch 7; pg1.5b; ) v1 -5409> 2012-10-11 13:43:50.787578 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1653, time: 2012-10-11 13:43:49.387050, event: throttled, request: osd pg remove(epoch 7; pg1.5b; ) v1 -5408> 2012-10-11 13:43:50.787589 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1653, time: 2012-10-11 13:43:49.387053, event: all_read, request: osd pg remove(epoch 7; pg1.5b; ) v1 -5407> 2012-10-11 13:43:50.787599 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1653, time: 2012-10-11 13:43:50.787566, event: dispatched, request: osd pg remove(epoch 7; pg1.5b; ) v1 -5406> 2012-10-11 13:43:50.787610 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1653, time: 2012-10-11 13:43:50.787610, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.5b; ) v1 -5405> 2012-10-11 13:43:50.787621 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1653, time: 2012-10-11 13:43:50.787621, event: started, request: osd pg remove(epoch 7; pg1.5b; ) v1 -5404> 2012-10-11 13:43:50.787631 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.5b -5403> 2012-10-11 13:43:50.787651 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.5b 0x2adb290)/0x2adb290 -5402> 2012-10-11 13:43:50.787660 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5401> 2012-10-11 13:43:50.787668 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5400> 2012-10-11 13:43:50.787675 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4187 0x3157a20 -5399> 2012-10-11 13:43:50.787684 7f440532f700 5 journal submit_entry seq 4187 len 205 (0x29c6480) -5398> 2012-10-11 13:43:50.787692 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5397> 2012-10-11 13:43:50.787699 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5396> 2012-10-11 13:43:50.787723 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1653, time: 2012-10-11 13:43:50.787723, event: done, request: osd pg remove(epoch 7; pg1.5b; ) v1 -5395> 2012-10-11 13:43:50.787740 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 62294) -5394> 2012-10-11 13:43:50.787748 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 644 ==== pg_query(2.2b epoch 8) v2 ==== 109+0+0 (1010738053 0 0) 0x274be00 con 0x2fe2280 -5393> 2012-10-11 13:43:50.787764 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1654, time: 2012-10-11 13:43:50.312402, event: header_read, request: pg_query(2.2b epoch 8) v2 -5392> 2012-10-11 13:43:50.787775 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1654, time: 2012-10-11 13:43:50.312409, event: throttled, request: pg_query(2.2b epoch 8) v2 -5391> 2012-10-11 13:43:50.787785 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1654, time: 2012-10-11 13:43:50.312431, event: all_read, request: pg_query(2.2b epoch 8) v2 -5390> 2012-10-11 13:43:50.787796 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1654, time: 2012-10-11 13:43:50.787762, event: dispatched, request: pg_query(2.2b epoch 8) v2 -5389> 2012-10-11 13:43:50.787806 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1654, time: 2012-10-11 13:43:50.787806, event: waiting_for_osdmap, request: pg_query(2.2b epoch 8) v2 -5388> 2012-10-11 13:43:50.787818 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1654, time: 2012-10-11 13:43:50.787818, event: started, request: pg_query(2.2b epoch 8) v2 -5387> 2012-10-11 13:43:50.787835 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1654, time: 2012-10-11 13:43:50.787835, event: done, request: pg_query(2.2b epoch 8) v2 -5386> 2012-10-11 13:43:50.787848 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 62185) -5385> 2012-10-11 13:43:50.787857 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 989 ==== osd pg remove(epoch 7; pg1.63; ) v1 ==== 25+0+0 (296764261 0 0) 0x2a8ca80 con 0x2fe2140 -5384> 2012-10-11 13:43:50.787871 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1655, time: 2012-10-11 13:43:49.387056, event: header_read, request: osd pg remove(epoch 7; pg1.63; ) v1 -5383> 2012-10-11 13:43:50.787882 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1655, time: 2012-10-11 13:43:49.387058, event: throttled, request: osd pg remove(epoch 7; pg1.63; ) v1 -5382> 2012-10-11 13:43:50.787893 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1655, time: 2012-10-11 13:43:49.387061, event: all_read, request: osd pg remove(epoch 7; pg1.63; ) v1 -5381> 2012-10-11 13:43:50.787903 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1655, time: 2012-10-11 13:43:50.787870, event: dispatched, request: osd pg remove(epoch 7; pg1.63; ) v1 -5380> 2012-10-11 13:43:50.787914 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1655, time: 2012-10-11 13:43:50.787914, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.63; ) v1 -5379> 2012-10-11 13:43:50.787925 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1655, time: 2012-10-11 13:43:50.787925, event: started, request: osd pg remove(epoch 7; pg1.63; ) v1 -5378> 2012-10-11 13:43:50.787935 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.63 -5377> 2012-10-11 13:43:50.787955 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.63 0x2adb510)/0x2adb510 -5376> 2012-10-11 13:43:50.787964 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5375> 2012-10-11 13:43:50.787971 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5374> 2012-10-11 13:43:50.787978 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4188 0x2ac9f30 -5373> 2012-10-11 13:43:50.787987 7f440532f700 5 journal submit_entry seq 4188 len 205 (0x2b5dbd0) -5372> 2012-10-11 13:43:50.787995 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5371> 2012-10-11 13:43:50.788002 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5370> 2012-10-11 13:43:50.788029 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1655, time: 2012-10-11 13:43:50.788029, event: done, request: osd pg remove(epoch 7; pg1.63; ) v1 -5369> 2012-10-11 13:43:50.788047 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 62160) -5368> 2012-10-11 13:43:50.788056 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 645 ==== pg_notify(0.29,0.31,0.36,0.37,0.3b,0.3d,0.43,0.4b,0.4d,0.72,0.76,0.78,0.7c,0.81,0.87,0.8a,1.28,1.30,1.35,1.36,1.3a,1.3c,1.42,1.4a,1.4c,1.71,1.75,1.77,1.7b,1.80,1.86,1.89,2.2f,2.34,2.35,2.39,2.3b,2.41,2.49,2.4b,2.4e,2.70,2.74,2.76,2.7a,2.7f,2.85,2.8b epoch 8) v4 ==== 21468+0+0 (405463264 0 0) 0x274bc40 con 0x2fe2280 -5367> 2012-10-11 13:43:50.788086 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1656, time: 2012-10-11 13:43:50.313231, event: header_read, request: pg_notify(0.29,0.31,0.36,0.37,0.3b,0.3d,0.43,0.4b,0.4d,0.72,0.76,0.78,0.7c,0.81,0.87,0.8a,1.28,1.30,1.35,1.36,1.3a,1.3c,1.42,1.4a,1.4c,1.71,1.75,1.77,1.7b,1.80,1.86,1.89,2.2f,2.34,2.35,2.39,2.3b,2.41,2.49,2.4b,2.4e,2.70,2.74,2.76,2.7a,2.7f,2.85,2.8b epoch 8) v4 -5366> 2012-10-11 13:43:50.788109 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1656, time: 2012-10-11 13:43:50.313242, event: throttled, request: pg_notify(0.29,0.31,0.36,0.37,0.3b,0.3d,0.43,0.4b,0.4d,0.72,0.76,0.78,0.7c,0.81,0.87,0.8a,1.28,1.30,1.35,1.36,1.3a,1.3c,1.42,1.4a,1.4c,1.71,1.75,1.77,1.7b,1.80,1.86,1.89,2.2f,2.34,2.35,2.39,2.3b,2.41,2.49,2.4b,2.4e,2.70,2.74,2.76,2.7a,2.7f,2.85,2.8b epoch 8) v4 -5365> 2012-10-11 13:43:50.788130 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1656, time: 2012-10-11 13:43:50.313464, event: all_read, request: pg_notify(0.29,0.31,0.36,0.37,0.3b,0.3d,0.43,0.4b,0.4d,0.72,0.76,0.78,0.7c,0.81,0.87,0.8a,1.28,1.30,1.35,1.36,1.3a,1.3c,1.42,1.4a,1.4c,1.71,1.75,1.77,1.7b,1.80,1.86,1.89,2.2f,2.34,2.35,2.39,2.3b,2.41,2.49,2.4b,2.4e,2.70,2.74,2.76,2.7a,2.7f,2.85,2.8b epoch 8) v4 -5364> 2012-10-11 13:43:50.788151 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1656, time: 2012-10-11 13:43:50.788084, event: dispatched, request: pg_notify(0.29,0.31,0.36,0.37,0.3b,0.3d,0.43,0.4b,0.4d,0.72,0.76,0.78,0.7c,0.81,0.87,0.8a,1.28,1.30,1.35,1.36,1.3a,1.3c,1.42,1.4a,1.4c,1.71,1.75,1.77,1.7b,1.80,1.86,1.89,2.2f,2.34,2.35,2.39,2.3b,2.41,2.49,2.4b,2.4e,2.70,2.74,2.76,2.7a,2.7f,2.85,2.8b epoch 8) v4 -5363> 2012-10-11 13:43:50.788172 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1656, time: 2012-10-11 13:43:50.788172, event: waiting_for_osdmap, request: pg_notify(0.29,0.31,0.36,0.37,0.3b,0.3d,0.43,0.4b,0.4d,0.72,0.76,0.78,0.7c,0.81,0.87,0.8a,1.28,1.30,1.35,1.36,1.3a,1.3c,1.42,1.4a,1.4c,1.71,1.75,1.77,1.7b,1.80,1.86,1.89,2.2f,2.34,2.35,2.39,2.3b,2.41,2.49,2.4b,2.4e,2.70,2.74,2.76,2.7a,2.7f,2.85,2.8b epoch 8) v4 -5362> 2012-10-11 13:43:50.788195 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1656, time: 2012-10-11 13:43:50.788195, event: started, request: pg_notify(0.29,0.31,0.36,0.37,0.3b,0.3d,0.43,0.4b,0.4d,0.72,0.76,0.78,0.7c,0.81,0.87,0.8a,1.28,1.30,1.35,1.36,1.3a,1.3c,1.42,1.4a,1.4c,1.71,1.75,1.77,1.7b,1.80,1.86,1.89,2.2f,2.34,2.35,2.39,2.3b,2.41,2.49,2.4b,2.4e,2.70,2.74,2.76,2.7a,2.7f,2.85,2.8b epoch 8) v4 -5361> 2012-10-11 13:43:50.788457 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1656, time: 2012-10-11 13:43:50.788457, event: done, request: pg_notify(0.29,0.31,0.36,0.37,0.3b,0.3d,0.43,0.4b,0.4d,0.72,0.76,0.78,0.7c,0.81,0.87,0.8a,1.28,1.30,1.35,1.36,1.3a,1.3c,1.42,1.4a,1.4c,1.71,1.75,1.77,1.7b,1.80,1.86,1.89,2.2f,2.34,2.35,2.39,2.3b,2.41,2.49,2.4b,2.4e,2.70,2.74,2.76,2.7a,2.7f,2.85,2.8b epoch 8) v4 -5360> 2012-10-11 13:43:50.788486 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 21468 (0xb7c748 -> 40692) -5359> 2012-10-11 13:43:50.788496 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 990 ==== osd pg remove(epoch 7; pg1.57; ) v1 ==== 25+0+0 (3118181669 0 0) 0x2a8c8c0 con 0x2fe2140 -5358> 2012-10-11 13:43:50.788512 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1657, time: 2012-10-11 13:43:49.387064, event: header_read, request: osd pg remove(epoch 7; pg1.57; ) v1 -5357> 2012-10-11 13:43:50.788524 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1657, time: 2012-10-11 13:43:49.387066, event: throttled, request: osd pg remove(epoch 7; pg1.57; ) v1 -5356> 2012-10-11 13:43:50.788534 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1657, time: 2012-10-11 13:43:49.387069, event: all_read, request: osd pg remove(epoch 7; pg1.57; ) v1 -5355> 2012-10-11 13:43:50.788544 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1657, time: 2012-10-11 13:43:50.788510, event: dispatched, request: osd pg remove(epoch 7; pg1.57; ) v1 -5354> 2012-10-11 13:43:50.788555 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1657, time: 2012-10-11 13:43:50.788555, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.57; ) v1 -5353> 2012-10-11 13:43:50.788567 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1657, time: 2012-10-11 13:43:50.788567, event: started, request: osd pg remove(epoch 7; pg1.57; ) v1 -5352> 2012-10-11 13:43:50.788577 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.57 -5351> 2012-10-11 13:43:50.788601 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.57 0x2adb350)/0x2adb350 -5350> 2012-10-11 13:43:50.788611 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5349> 2012-10-11 13:43:50.788618 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5348> 2012-10-11 13:43:50.788625 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4189 0x31572d0 -5347> 2012-10-11 13:43:50.788634 7f440532f700 5 journal submit_entry seq 4189 len 205 (0x2bd30c0) -5346> 2012-10-11 13:43:50.788642 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5345> 2012-10-11 13:43:50.788649 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5344> 2012-10-11 13:43:50.788676 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1657, time: 2012-10-11 13:43:50.788676, event: done, request: osd pg remove(epoch 7; pg1.57; ) v1 -5343> 2012-10-11 13:43:50.788694 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 40667) -5342> 2012-10-11 13:43:50.788702 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 646 ==== pg_query(0.28 epoch 8) v2 ==== 109+0+0 (1687663607 0 0) 0x274ba80 con 0x2fe2280 -5341> 2012-10-11 13:43:50.788718 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1658, time: 2012-10-11 13:43:50.315056, event: header_read, request: pg_query(0.28 epoch 8) v2 -5340> 2012-10-11 13:43:50.788729 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1658, time: 2012-10-11 13:43:50.315065, event: throttled, request: pg_query(0.28 epoch 8) v2 -5339> 2012-10-11 13:43:50.788739 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1658, time: 2012-10-11 13:43:50.315072, event: all_read, request: pg_query(0.28 epoch 8) v2 -5338> 2012-10-11 13:43:50.788749 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1658, time: 2012-10-11 13:43:50.788717, event: dispatched, request: pg_query(0.28 epoch 8) v2 -5337> 2012-10-11 13:43:50.788761 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1658, time: 2012-10-11 13:43:50.788761, event: waiting_for_osdmap, request: pg_query(0.28 epoch 8) v2 -5336> 2012-10-11 13:43:50.788772 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1658, time: 2012-10-11 13:43:50.788772, event: started, request: pg_query(0.28 epoch 8) v2 -5335> 2012-10-11 13:43:50.788790 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1658, time: 2012-10-11 13:43:50.788790, event: done, request: pg_query(0.28 epoch 8) v2 -5334> 2012-10-11 13:43:50.788803 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 40558) -5333> 2012-10-11 13:43:50.788812 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 991 ==== osd pg remove(epoch 7; pg1.6a; ) v1 ==== 25+0+0 (448215704 0 0) 0x2a8c700 con 0x2fe2140 -5332> 2012-10-11 13:43:50.788826 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1659, time: 2012-10-11 13:43:49.387071, event: header_read, request: osd pg remove(epoch 7; pg1.6a; ) v1 -5331> 2012-10-11 13:43:50.788837 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1659, time: 2012-10-11 13:43:49.387073, event: throttled, request: osd pg remove(epoch 7; pg1.6a; ) v1 -5330> 2012-10-11 13:43:50.788847 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1659, time: 2012-10-11 13:43:49.387077, event: all_read, request: osd pg remove(epoch 7; pg1.6a; ) v1 -5329> 2012-10-11 13:43:50.788858 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1659, time: 2012-10-11 13:43:50.788825, event: dispatched, request: osd pg remove(epoch 7; pg1.6a; ) v1 -5328> 2012-10-11 13:43:50.788869 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1659, time: 2012-10-11 13:43:50.788869, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.6a; ) v1 -5327> 2012-10-11 13:43:50.788880 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1659, time: 2012-10-11 13:43:50.788880, event: started, request: osd pg remove(epoch 7; pg1.6a; ) v1 -5326> 2012-10-11 13:43:50.788891 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.6a -5325> 2012-10-11 13:43:50.788910 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.6a 0x2adb7c0)/0x2adb7c0 -5324> 2012-10-11 13:43:50.788920 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5323> 2012-10-11 13:43:50.788927 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5322> 2012-10-11 13:43:50.788934 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4190 0x2ac96c0 -5321> 2012-10-11 13:43:50.788942 7f440532f700 5 journal submit_entry seq 4190 len 205 (0x2b10d50) -5320> 2012-10-11 13:43:50.788951 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5319> 2012-10-11 13:43:50.788958 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5318> 2012-10-11 13:43:50.788983 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1659, time: 2012-10-11 13:43:50.788983, event: done, request: osd pg remove(epoch 7; pg1.6a; ) v1 -5317> 2012-10-11 13:43:50.789000 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 40533) -5316> 2012-10-11 13:43:50.789009 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 647 ==== pg_query(1.29 epoch 8) v2 ==== 109+0+0 (2803708611 0 0) 0x274b8c0 con 0x2fe2280 -5315> 2012-10-11 13:43:50.789028 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1660, time: 2012-10-11 13:43:50.315077, event: header_read, request: pg_query(1.29 epoch 8) v2 -5314> 2012-10-11 13:43:50.789039 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1660, time: 2012-10-11 13:43:50.315080, event: throttled, request: pg_query(1.29 epoch 8) v2 -5313> 2012-10-11 13:43:50.789049 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1660, time: 2012-10-11 13:43:50.315092, event: all_read, request: pg_query(1.29 epoch 8) v2 -5312> 2012-10-11 13:43:50.789059 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1660, time: 2012-10-11 13:43:50.789026, event: dispatched, request: pg_query(1.29 epoch 8) v2 -5311> 2012-10-11 13:43:50.789070 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1660, time: 2012-10-11 13:43:50.789070, event: waiting_for_osdmap, request: pg_query(1.29 epoch 8) v2 -5310> 2012-10-11 13:43:50.789081 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1660, time: 2012-10-11 13:43:50.789081, event: started, request: pg_query(1.29 epoch 8) v2 -5309> 2012-10-11 13:43:50.789098 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1660, time: 2012-10-11 13:43:50.789098, event: done, request: pg_query(1.29 epoch 8) v2 -5308> 2012-10-11 13:43:50.789111 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 40424) -5307> 2012-10-11 13:43:50.789120 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 992 ==== osd pg remove(epoch 7; pg1.6b; ) v1 ==== 25+0+0 (1401636799 0 0) 0x2a8c540 con 0x2fe2140 -5306> 2012-10-11 13:43:50.789134 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1661, time: 2012-10-11 13:43:49.387079, event: header_read, request: osd pg remove(epoch 7; pg1.6b; ) v1 -5305> 2012-10-11 13:43:50.789146 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1661, time: 2012-10-11 13:43:49.387081, event: throttled, request: osd pg remove(epoch 7; pg1.6b; ) v1 -5304> 2012-10-11 13:43:50.789156 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1661, time: 2012-10-11 13:43:49.387084, event: all_read, request: osd pg remove(epoch 7; pg1.6b; ) v1 -5303> 2012-10-11 13:43:50.789167 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1661, time: 2012-10-11 13:43:50.789133, event: dispatched, request: osd pg remove(epoch 7; pg1.6b; ) v1 -5302> 2012-10-11 13:43:50.789177 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1661, time: 2012-10-11 13:43:50.789177, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.6b; ) v1 -5301> 2012-10-11 13:43:50.789189 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1661, time: 2012-10-11 13:43:50.789189, event: started, request: osd pg remove(epoch 7; pg1.6b; ) v1 -5300> 2012-10-11 13:43:50.789199 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.6b -5299> 2012-10-11 13:43:50.789219 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.6b 0x2adb790)/0x2adb790 -5298> 2012-10-11 13:43:50.789229 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5297> 2012-10-11 13:43:50.789236 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5296> 2012-10-11 13:43:50.789243 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4191 0x2ac9e10 -5295> 2012-10-11 13:43:50.789260 7f440532f700 5 journal submit_entry seq 4191 len 205 (0x2c1f390) -5294> 2012-10-11 13:43:50.789269 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5293> 2012-10-11 13:43:50.789276 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5292> 2012-10-11 13:43:50.789305 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1661, time: 2012-10-11 13:43:50.789305, event: done, request: osd pg remove(epoch 7; pg1.6b; ) v1 -5291> 2012-10-11 13:43:50.789323 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 40399) -5290> 2012-10-11 13:43:50.789332 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 648 ==== pg_query(2.6e epoch 8) v2 ==== 109+0+0 (983964691 0 0) 0x274b700 con 0x2fe2280 -5289> 2012-10-11 13:43:50.789348 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1662, time: 2012-10-11 13:43:50.315096, event: header_read, request: pg_query(2.6e epoch 8) v2 -5288> 2012-10-11 13:43:50.789359 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1662, time: 2012-10-11 13:43:50.315100, event: throttled, request: pg_query(2.6e epoch 8) v2 -5287> 2012-10-11 13:43:50.789369 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1662, time: 2012-10-11 13:43:50.315105, event: all_read, request: pg_query(2.6e epoch 8) v2 -5286> 2012-10-11 13:43:50.789380 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1662, time: 2012-10-11 13:43:50.789346, event: dispatched, request: pg_query(2.6e epoch 8) v2 -5285> 2012-10-11 13:43:50.789390 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1662, time: 2012-10-11 13:43:50.789390, event: waiting_for_osdmap, request: pg_query(2.6e epoch 8) v2 -5284> 2012-10-11 13:43:50.789402 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1662, time: 2012-10-11 13:43:50.789402, event: started, request: pg_query(2.6e epoch 8) v2 -5283> 2012-10-11 13:43:50.789419 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1662, time: 2012-10-11 13:43:50.789419, event: done, request: pg_query(2.6e epoch 8) v2 -5282> 2012-10-11 13:43:50.789432 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 40290) -5281> 2012-10-11 13:43:50.789440 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 993 ==== osd pg remove(epoch 7; pg1.64; ) v1 ==== 25+0+0 (3957933665 0 0) 0x2a8c380 con 0x2fe2140 -5280> 2012-10-11 13:43:50.789454 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1663, time: 2012-10-11 13:43:49.387086, event: header_read, request: osd pg remove(epoch 7; pg1.64; ) v1 -5279> 2012-10-11 13:43:50.789466 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1663, time: 2012-10-11 13:43:49.387088, event: throttled, request: osd pg remove(epoch 7; pg1.64; ) v1 -5278> 2012-10-11 13:43:50.789477 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1663, time: 2012-10-11 13:43:49.387091, event: all_read, request: osd pg remove(epoch 7; pg1.64; ) v1 -5277> 2012-10-11 13:43:50.789487 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1663, time: 2012-10-11 13:43:50.789453, event: dispatched, request: osd pg remove(epoch 7; pg1.64; ) v1 -5276> 2012-10-11 13:43:50.789498 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1663, time: 2012-10-11 13:43:50.789498, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.64; ) v1 -5275> 2012-10-11 13:43:50.789509 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1663, time: 2012-10-11 13:43:50.789509, event: started, request: osd pg remove(epoch 7; pg1.64; ) v1 -5274> 2012-10-11 13:43:50.789520 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.64 -5273> 2012-10-11 13:43:50.789541 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.64 0x2adb4e0)/0x2adb4e0 -5272> 2012-10-11 13:43:50.789551 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5271> 2012-10-11 13:43:50.789558 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5270> 2012-10-11 13:43:50.789565 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4192 0x24b67e0 -5269> 2012-10-11 13:43:50.789573 7f440532f700 5 journal submit_entry seq 4192 len 205 (0x2c1f1b0) -5268> 2012-10-11 13:43:50.789582 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5267> 2012-10-11 13:43:50.789589 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5266> 2012-10-11 13:43:50.789618 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1663, time: 2012-10-11 13:43:50.789617, event: done, request: osd pg remove(epoch 7; pg1.64; ) v1 -5265> 2012-10-11 13:43:50.789635 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 40265) -5264> 2012-10-11 13:43:50.789644 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 649 ==== pg_query(2.25 epoch 8) v2 ==== 109+0+0 (3416907343 0 0) 0x274b540 con 0x2fe2280 -5263> 2012-10-11 13:43:50.789660 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1664, time: 2012-10-11 13:43:50.315109, event: header_read, request: pg_query(2.25 epoch 8) v2 -5262> 2012-10-11 13:43:50.789671 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1664, time: 2012-10-11 13:43:50.315112, event: throttled, request: pg_query(2.25 epoch 8) v2 -5261> 2012-10-11 13:43:50.789681 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1664, time: 2012-10-11 13:43:50.315116, event: all_read, request: pg_query(2.25 epoch 8) v2 -5260> 2012-10-11 13:43:50.789691 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1664, time: 2012-10-11 13:43:50.789658, event: dispatched, request: pg_query(2.25 epoch 8) v2 -5259> 2012-10-11 13:43:50.789702 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1664, time: 2012-10-11 13:43:50.789702, event: waiting_for_osdmap, request: pg_query(2.25 epoch 8) v2 -5258> 2012-10-11 13:43:50.789714 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1664, time: 2012-10-11 13:43:50.789714, event: started, request: pg_query(2.25 epoch 8) v2 -5257> 2012-10-11 13:43:50.789731 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1664, time: 2012-10-11 13:43:50.789731, event: done, request: pg_query(2.25 epoch 8) v2 -5256> 2012-10-11 13:43:50.789744 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 40156) -5255> 2012-10-11 13:43:50.789753 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 994 ==== osd pg remove(epoch 7; pg1.70; ) v1 ==== 25+0+0 (1317195192 0 0) 0x2a8c1c0 con 0x2fe2140 -5254> 2012-10-11 13:43:50.789767 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1665, time: 2012-10-11 13:43:49.387094, event: header_read, request: osd pg remove(epoch 7; pg1.70; ) v1 -5253> 2012-10-11 13:43:50.789778 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1665, time: 2012-10-11 13:43:49.387096, event: throttled, request: osd pg remove(epoch 7; pg1.70; ) v1 -5252> 2012-10-11 13:43:50.789789 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1665, time: 2012-10-11 13:43:49.387099, event: all_read, request: osd pg remove(epoch 7; pg1.70; ) v1 -5251> 2012-10-11 13:43:50.789799 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1665, time: 2012-10-11 13:43:50.789766, event: dispatched, request: osd pg remove(epoch 7; pg1.70; ) v1 -5250> 2012-10-11 13:43:50.789810 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1665, time: 2012-10-11 13:43:50.789810, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.70; ) v1 -5249> 2012-10-11 13:43:50.789821 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1665, time: 2012-10-11 13:43:50.789821, event: started, request: osd pg remove(epoch 7; pg1.70; ) v1 -5248> 2012-10-11 13:43:50.789832 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.70 -5247> 2012-10-11 13:43:50.789851 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.70 0x2adb6a0)/0x2adb6a0 -5246> 2012-10-11 13:43:50.789861 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5245> 2012-10-11 13:43:50.789867 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5244> 2012-10-11 13:43:50.789875 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4193 0x24b6900 -5243> 2012-10-11 13:43:50.789884 7f440532f700 5 journal submit_entry seq 4193 len 205 (0x2bd3ae0) -5242> 2012-10-11 13:43:50.789893 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5241> 2012-10-11 13:43:50.789900 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5240> 2012-10-11 13:43:50.789926 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1665, time: 2012-10-11 13:43:50.789925, event: done, request: osd pg remove(epoch 7; pg1.70; ) v1 -5239> 2012-10-11 13:43:50.789942 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 40131) -5238> 2012-10-11 13:43:50.789951 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 650 ==== pg_query(0.27 epoch 8) v2 ==== 109+0+0 (1230023382 0 0) 0x274b380 con 0x2fe2280 -5237> 2012-10-11 13:43:50.789967 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1666, time: 2012-10-11 13:43:50.315120, event: header_read, request: pg_query(0.27 epoch 8) v2 -5236> 2012-10-11 13:43:50.789978 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1666, time: 2012-10-11 13:43:50.315124, event: throttled, request: pg_query(0.27 epoch 8) v2 -5235> 2012-10-11 13:43:50.789988 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1666, time: 2012-10-11 13:43:50.315128, event: all_read, request: pg_query(0.27 epoch 8) v2 -5234> 2012-10-11 13:43:50.789998 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1666, time: 2012-10-11 13:43:50.789965, event: dispatched, request: pg_query(0.27 epoch 8) v2 -5233> 2012-10-11 13:43:50.790009 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1666, time: 2012-10-11 13:43:50.790009, event: waiting_for_osdmap, request: pg_query(0.27 epoch 8) v2 -5232> 2012-10-11 13:43:50.790020 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1666, time: 2012-10-11 13:43:50.790020, event: started, request: pg_query(0.27 epoch 8) v2 -5231> 2012-10-11 13:43:50.790037 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1666, time: 2012-10-11 13:43:50.790037, event: done, request: pg_query(0.27 epoch 8) v2 -5230> 2012-10-11 13:43:50.790051 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 40022) -5229> 2012-10-11 13:43:50.790059 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 995 ==== osd pg remove(epoch 7; pg1.6c; ) v1 ==== 25+0+0 (2849129147 0 0) 0x2a8c000 con 0x2fe2140 -5228> 2012-10-11 13:43:50.790074 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1667, time: 2012-10-11 13:43:49.387101, event: header_read, request: osd pg remove(epoch 7; pg1.6c; ) v1 -5227> 2012-10-11 13:43:50.790084 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1667, time: 2012-10-11 13:43:49.387103, event: throttled, request: osd pg remove(epoch 7; pg1.6c; ) v1 -5226> 2012-10-11 13:43:50.790095 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1667, time: 2012-10-11 13:43:49.387106, event: all_read, request: osd pg remove(epoch 7; pg1.6c; ) v1 -5225> 2012-10-11 13:43:50.790105 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1667, time: 2012-10-11 13:43:50.790072, event: dispatched, request: osd pg remove(epoch 7; pg1.6c; ) v1 -5224> 2012-10-11 13:43:50.790116 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1667, time: 2012-10-11 13:43:50.790116, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.6c; ) v1 -5223> 2012-10-11 13:43:50.790127 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1667, time: 2012-10-11 13:43:50.790127, event: started, request: osd pg remove(epoch 7; pg1.6c; ) v1 -5222> 2012-10-11 13:43:50.790137 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.6c -5221> 2012-10-11 13:43:50.790157 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.6c 0x2adb760)/0x2adb760 -5220> 2012-10-11 13:43:50.790166 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5219> 2012-10-11 13:43:50.790173 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5218> 2012-10-11 13:43:50.790180 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4194 0x24b6a20 -5217> 2012-10-11 13:43:50.790189 7f440532f700 5 journal submit_entry seq 4194 len 205 (0x2c1fe40) -5216> 2012-10-11 13:43:50.790198 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5215> 2012-10-11 13:43:50.790204 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5214> 2012-10-11 13:43:50.790229 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1667, time: 2012-10-11 13:43:50.790228, event: done, request: osd pg remove(epoch 7; pg1.6c; ) v1 -5213> 2012-10-11 13:43:50.790245 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 39997) -5212> 2012-10-11 13:43:50.790254 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 651 ==== pg_query(1.26 epoch 8) v2 ==== 109+0+0 (2329553890 0 0) 0x274b1c0 con 0x2fe2280 -5211> 2012-10-11 13:43:50.790270 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1668, time: 2012-10-11 13:43:50.315132, event: header_read, request: pg_query(1.26 epoch 8) v2 -5210> 2012-10-11 13:43:50.790281 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1668, time: 2012-10-11 13:43:50.315135, event: throttled, request: pg_query(1.26 epoch 8) v2 -5209> 2012-10-11 13:43:50.790291 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1668, time: 2012-10-11 13:43:50.315143, event: all_read, request: pg_query(1.26 epoch 8) v2 -5208> 2012-10-11 13:43:50.790302 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1668, time: 2012-10-11 13:43:50.790268, event: dispatched, request: pg_query(1.26 epoch 8) v2 -5207> 2012-10-11 13:43:50.790315 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1668, time: 2012-10-11 13:43:50.790315, event: waiting_for_osdmap, request: pg_query(1.26 epoch 8) v2 -5206> 2012-10-11 13:43:50.790327 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1668, time: 2012-10-11 13:43:50.790327, event: started, request: pg_query(1.26 epoch 8) v2 -5205> 2012-10-11 13:43:50.790344 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1668, time: 2012-10-11 13:43:50.790344, event: done, request: pg_query(1.26 epoch 8) v2 -5204> 2012-10-11 13:43:50.790357 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 39888) -5203> 2012-10-11 13:43:50.790366 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 996 ==== osd pg remove(epoch 7; pg1.73; ) v1 ==== 25+0+0 (2512800465 0 0) 0x2a33e00 con 0x2fe2140 -5202> 2012-10-11 13:43:50.790380 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1669, time: 2012-10-11 13:43:49.387109, event: header_read, request: osd pg remove(epoch 7; pg1.73; ) v1 -5201> 2012-10-11 13:43:50.790392 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1669, time: 2012-10-11 13:43:49.387111, event: throttled, request: osd pg remove(epoch 7; pg1.73; ) v1 -5200> 2012-10-11 13:43:50.790402 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1669, time: 2012-10-11 13:43:49.387114, event: all_read, request: osd pg remove(epoch 7; pg1.73; ) v1 -5199> 2012-10-11 13:43:50.790412 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1669, time: 2012-10-11 13:43:50.790379, event: dispatched, request: osd pg remove(epoch 7; pg1.73; ) v1 -5198> 2012-10-11 13:43:50.790424 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1669, time: 2012-10-11 13:43:50.790423, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.73; ) v1 -5197> 2012-10-11 13:43:50.790435 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1669, time: 2012-10-11 13:43:50.790435, event: started, request: osd pg remove(epoch 7; pg1.73; ) v1 -5196> 2012-10-11 13:43:50.790445 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.73 -5195> 2012-10-11 13:43:50.790465 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.73 0x2adb610)/0x2adb610 -5194> 2012-10-11 13:43:50.790475 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5193> 2012-10-11 13:43:50.790482 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5192> 2012-10-11 13:43:50.790489 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4195 0x301d120 -5191> 2012-10-11 13:43:50.790498 7f440532f700 5 journal submit_entry seq 4195 len 205 (0x2c1fbd0) -5190> 2012-10-11 13:43:50.790506 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5189> 2012-10-11 13:43:50.790513 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5188> 2012-10-11 13:43:50.790541 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1669, time: 2012-10-11 13:43:50.790541, event: done, request: osd pg remove(epoch 7; pg1.73; ) v1 -5187> 2012-10-11 13:43:50.790558 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 39863) -5186> 2012-10-11 13:43:50.790567 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 652 ==== pg_query(0.69 epoch 8) v2 ==== 109+0+0 (2736627605 0 0) 0x274b000 con 0x2fe2280 -5185> 2012-10-11 13:43:50.790583 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1670, time: 2012-10-11 13:43:50.315146, event: header_read, request: pg_query(0.69 epoch 8) v2 -5184> 2012-10-11 13:43:50.790593 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1670, time: 2012-10-11 13:43:50.315150, event: throttled, request: pg_query(0.69 epoch 8) v2 -5183> 2012-10-11 13:43:50.790604 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1670, time: 2012-10-11 13:43:50.315154, event: all_read, request: pg_query(0.69 epoch 8) v2 -5182> 2012-10-11 13:43:50.790614 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1670, time: 2012-10-11 13:43:50.790581, event: dispatched, request: pg_query(0.69 epoch 8) v2 -5181> 2012-10-11 13:43:50.790624 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1670, time: 2012-10-11 13:43:50.790624, event: waiting_for_osdmap, request: pg_query(0.69 epoch 8) v2 -5180> 2012-10-11 13:43:50.790636 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1670, time: 2012-10-11 13:43:50.790636, event: started, request: pg_query(0.69 epoch 8) v2 -5179> 2012-10-11 13:43:50.790653 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1670, time: 2012-10-11 13:43:50.790653, event: done, request: pg_query(0.69 epoch 8) v2 -5178> 2012-10-11 13:43:50.790666 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 39754) -5177> 2012-10-11 13:43:50.790675 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 997 ==== osd pg remove(epoch 7; pg1.74; ) v1 ==== 25+0+0 (1872711637 0 0) 0x2a33c40 con 0x2fe2140 -5176> 2012-10-11 13:43:50.790690 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1671, time: 2012-10-11 13:43:49.387117, event: header_read, request: osd pg remove(epoch 7; pg1.74; ) v1 -5175> 2012-10-11 13:43:50.790701 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1671, time: 2012-10-11 13:43:49.387119, event: throttled, request: osd pg remove(epoch 7; pg1.74; ) v1 -5174> 2012-10-11 13:43:50.790711 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1671, time: 2012-10-11 13:43:49.387122, event: all_read, request: osd pg remove(epoch 7; pg1.74; ) v1 -5173> 2012-10-11 13:43:50.790721 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1671, time: 2012-10-11 13:43:50.790688, event: dispatched, request: osd pg remove(epoch 7; pg1.74; ) v1 -5172> 2012-10-11 13:43:50.790732 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1671, time: 2012-10-11 13:43:50.790732, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.74; ) v1 -5171> 2012-10-11 13:43:50.790744 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1671, time: 2012-10-11 13:43:50.790744, event: started, request: osd pg remove(epoch 7; pg1.74; ) v1 -5170> 2012-10-11 13:43:50.790755 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.74 -5169> 2012-10-11 13:43:50.790775 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.74 0x2adb9e0)/0x2adb9e0 -5168> 2012-10-11 13:43:50.790785 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -5167> 2012-10-11 13:43:50.790792 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -5166> 2012-10-11 13:43:50.790799 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4196 0x301d480 -5165> 2012-10-11 13:43:50.790808 7f440532f700 5 journal submit_entry seq 4196 len 205 (0x2c782a0) -5164> 2012-10-11 13:43:50.790816 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -5163> 2012-10-11 13:43:50.790823 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -5162> 2012-10-11 13:43:50.790848 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1671, time: 2012-10-11 13:43:50.790848, event: done, request: osd pg remove(epoch 7; pg1.74; ) v1 -5161> 2012-10-11 13:43:50.790866 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 39729) -5160> 2012-10-11 13:43:50.790875 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 653 ==== pg_query(2.67 epoch 8) v2 ==== 109+0+0 (85827800 0 0) 0x2ac7e00 con 0x2fe2280 -5159> 2012-10-11 13:43:50.790891 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1672, time: 2012-10-11 13:43:50.315158, event: header_read, request: pg_query(2.67 epoch 8) v2 -5158> 2012-10-11 13:43:50.790902 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1672, time: 2012-10-11 13:43:50.315161, event: throttled, request: pg_query(2.67 epoch 8) v2 -5157> 2012-10-11 13:43:50.790912 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1672, time: 2012-10-11 13:43:50.315166, event: all_read, request: pg_query(2.67 epoch 8) v2 -5156> 2012-10-11 13:43:50.790922 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1672, time: 2012-10-11 13:43:50.790889, event: dispatched, request: pg_query(2.67 epoch 8) v2 -5155> 2012-10-11 13:43:50.790932 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1672, time: 2012-10-11 13:43:50.790932, event: waiting_for_osdmap, request: pg_query(2.67 epoch 8) v2 -5154> 2012-10-11 13:43:50.790944 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1672, time: 2012-10-11 13:43:50.790944, event: started, request: pg_query(2.67 epoch 8) v2 -5153> 2012-10-11 13:43:50.790961 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1672, time: 2012-10-11 13:43:50.790961, event: done, request: pg_query(2.67 epoch 8) v2 -5152> 2012-10-11 13:43:50.790974 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 39620) -5151> 2012-10-11 13:43:50.790982 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 998 ==== osd pg remove(epoch 7; pg1.76; ) v1 ==== 25+0+0 (4259820955 0 0) 0x2a33a80 con 0x2fe2140 -5150> 2012-10-11 13:43:50.790997 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1673, time: 2012-10-11 13:43:49.387124, event: header_read, request: osd pg remove(epoch 7; pg1.76; ) v1 -5149> 2012-10-11 13:43:50.791008 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1673, time: 2012-10-11 13:43:49.387126, event: throttled, request: osd pg remove(epoch 7; pg1.76; ) v1 -5148> 2012-10-11 13:43:50.791018 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1673, time: 2012-10-11 13:43:49.387129, event: all_read, request: osd pg remove(epoch 7; pg1.76; ) v1 -5147> 2012-10-11 13:43:50.791028 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1673, time: 2012-10-11 13:43:50.790995, event: dispatched, request: osd pg remove(epoch 7; pg1.76; ) v1 -5146> 2012-10-11 13:43:50.791039 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1673, time: 2012-10-11 13:43:50.791039, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.76; ) v1 -5145> 2012-10-11 13:43:50.791051 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1673, time: 2012-10-11 13:43:50.791051, event: started, request: osd pg remove(epoch 7; pg1.76; ) v1 -5144> 2012-10-11 13:43:50.791061 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.76 -5143> 2012-10-11 13:43:50.791081 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.76 0x2adb980)/0x2adb980 -5142> 2012-10-11 13:43:50.791090 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 310178 > 104857600 -5141> 2012-10-11 13:43:50.824897 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (39620 -> 40091) -5140> 2012-10-11 13:43:50.824940 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (40091 -> 40562) -5139> 2012-10-11 13:43:50.824954 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (40562 -> 41033) -5138> 2012-10-11 13:43:50.824969 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (41033 -> 41504) -5137> 2012-10-11 13:43:50.824982 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (41504 -> 41975) -5136> 2012-10-11 13:43:50.824994 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (41975 -> 42446) -5135> 2012-10-11 13:43:50.825008 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (42446 -> 42917) -5134> 2012-10-11 13:43:50.825020 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (42917 -> 43388) -5133> 2012-10-11 13:43:50.825033 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (43388 -> 43859) -5132> 2012-10-11 13:43:50.825045 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (43859 -> 44330) -5131> 2012-10-11 13:43:50.825059 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (44330 -> 44801) -5130> 2012-10-11 13:43:50.825071 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (44801 -> 45272) -5129> 2012-10-11 13:43:50.825083 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (45272 -> 45743) -5128> 2012-10-11 13:43:50.825095 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (45743 -> 46214) -5127> 2012-10-11 13:43:50.825107 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (46214 -> 46685) -5126> 2012-10-11 13:43:50.825118 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (46685 -> 47156) -5125> 2012-10-11 13:43:50.825130 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (47156 -> 47627) -5124> 2012-10-11 13:43:50.825142 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (47627 -> 48098) -5123> 2012-10-11 13:43:50.825154 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (48098 -> 48569) -5122> 2012-10-11 13:43:50.825166 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (48569 -> 49040) -5121> 2012-10-11 13:43:50.825178 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (49040 -> 49511) -5120> 2012-10-11 13:43:50.825190 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (49511 -> 49982) -5119> 2012-10-11 13:43:50.825202 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (49982 -> 50453) -5118> 2012-10-11 13:43:50.825213 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (50453 -> 50924) -5117> 2012-10-11 13:43:50.825225 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (50924 -> 51395) -5116> 2012-10-11 13:43:50.871863 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (51395 -> 51420) -5115> 2012-10-11 13:43:50.871894 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (51420 -> 51445) -5114> 2012-10-11 13:43:50.871903 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (51445 -> 51470) -5113> 2012-10-11 13:43:50.879235 7f43ff21b700 5 throttle(msgr_dispatch_throttler-hbserver 0x1d9bc88) get 47 (0 -> 47) -5112> 2012-10-11 13:43:50.879280 7f440432d700 1 -- 149.165.228.10:6803/338 <== osd.1 149.165.228.10:0/1098 2 ==== osd_ping(ping e8 stamp 2012-10-11 13:43:50.879138) v2 ==== 47+0+0 (2991420381 0 0) 0x27a2a80 con 0x2fe2640 -5111> 2012-10-11 13:43:50.879302 7f440432d700 1 -- 149.165.228.10:6803/338 --> 149.165.228.10:0/1098 -- osd_ping(ping_reply e8 stamp 2012-10-11 13:43:50.879138) v2 -- ?+0 0x20a0000 con 0x2fe2640 -5110> 2012-10-11 13:43:50.879316 7f440432d700 5 throttle(msgr_dispatch_throttler-hbserver 0x1d9bc88) put 47 (0xb7c748 -> 0) -5109> 2012-10-11 13:43:50.905563 7f4400224700 5 osd.0 8 heartbeat: osd_stat(1028 MB used, 2732 GB avail, 2733 GB total, peers [1,2]/[]) -5108> 2012-10-11 13:43:50.905587 7f4400224700 1 -- 149.165.228.10:0/338 --> 149.165.228.10:6806/1098 -- osd_ping(ping e8 stamp 2012-10-11 13:43:50.905584) v2 -- ?+0 0x27a28c0 con 0x1dff640 -5107> 2012-10-11 13:43:50.905609 7f4400224700 1 -- 149.165.228.10:0/338 --> 149.165.228.10:6809/1657 -- osd_ping(ping e8 stamp 2012-10-11 13:43:50.905584) v2 -- ?+0 0x20a0000 con 0x2f22c80 -5106> 2012-10-11 13:43:50.906406 7f43fed16700 5 throttle(msgr_dispatch_throttler-hbclient 0x1d9aa88) get 47 (0 -> 47) -5105> 2012-10-11 13:43:50.906441 7f4404b2e700 1 -- 149.165.228.10:0/338 <== osd.2 149.165.228.10:6809/1657 1 ==== osd_ping(ping_reply e8 stamp 2012-10-11 13:43:50.905584) v2 ==== 47+0+0 (1989713112 0 0) 0x2337a80 con 0x2f22c80 -5104> 2012-10-11 13:43:50.906465 7f4404b2e700 5 throttle(msgr_dispatch_throttler-hbclient 0x1d9aa88) put 47 (0xb7c748 -> 0) -5103> 2012-10-11 13:43:50.907620 7f43ff51e700 5 throttle(msgr_dispatch_throttler-hbclient 0x1d9aa88) get 47 (0 -> 47) -5102> 2012-10-11 13:43:50.909116 7f4404b2e700 1 -- 149.165.228.10:0/338 <== osd.1 149.165.228.10:6806/1098 2 ==== osd_ping(ping_reply e8 stamp 2012-10-11 13:43:50.905584) v2 ==== 47+0+0 (1989713112 0 0) 0x2337a80 con 0x1dff640 -5101> 2012-10-11 13:43:50.909142 7f4404b2e700 5 throttle(msgr_dispatch_throttler-hbclient 0x1d9aa88) put 47 (0xb7c748 -> 0) -5100> 2012-10-11 13:43:50.937157 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (51470 -> 51941) -5099> 2012-10-11 13:43:50.937198 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (51941 -> 52412) -5098> 2012-10-11 13:43:50.937213 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (52412 -> 52883) -5097> 2012-10-11 13:43:50.937227 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (52883 -> 53354) -5096> 2012-10-11 13:43:50.937240 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (53354 -> 53825) -5095> 2012-10-11 13:43:50.937264 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (53825 -> 54296) -5094> 2012-10-11 13:43:50.937278 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (54296 -> 54767) -5093> 2012-10-11 13:43:50.937295 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (54767 -> 55238) -5092> 2012-10-11 13:43:50.937308 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (55238 -> 55709) -5091> 2012-10-11 13:43:50.937321 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (55709 -> 56180) -5090> 2012-10-11 13:43:50.937334 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (56180 -> 56651) -5089> 2012-10-11 13:43:50.937348 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (56651 -> 57122) -5088> 2012-10-11 13:43:50.937361 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (57122 -> 57593) -5087> 2012-10-11 13:43:50.937374 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (57593 -> 58064) -5086> 2012-10-11 13:43:50.937386 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (58064 -> 58535) -5085> 2012-10-11 13:43:50.937399 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (58535 -> 59006) -5084> 2012-10-11 13:43:50.937411 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (59006 -> 59477) -5083> 2012-10-11 13:43:50.937423 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (59477 -> 59948) -5082> 2012-10-11 13:43:50.937437 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (59948 -> 60419) -5081> 2012-10-11 13:43:50.937450 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (60419 -> 60890) -5080> 2012-10-11 13:43:50.937463 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (60890 -> 61361) -5079> 2012-10-11 13:43:50.937475 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (61361 -> 61832) -5078> 2012-10-11 13:43:50.937487 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (61832 -> 62303) -5077> 2012-10-11 13:43:50.937499 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (62303 -> 62774) -5076> 2012-10-11 13:43:50.937511 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (62774 -> 63245) -5075> 2012-10-11 13:43:50.937524 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (63245 -> 63716) -5074> 2012-10-11 13:43:50.937536 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (63716 -> 64187) -5073> 2012-10-11 13:43:50.937550 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (64187 -> 64658) -5072> 2012-10-11 13:43:50.937563 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (64658 -> 65129) -5071> 2012-10-11 13:43:50.937575 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (65129 -> 65600) -5070> 2012-10-11 13:43:51.016985 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (65600 -> 65625) -5069> 2012-10-11 13:43:51.017017 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (65625 -> 65650) -5068> 2012-10-11 13:43:51.017027 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (65650 -> 65675) -5067> 2012-10-11 13:43:51.017035 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (65675 -> 65700) -5066> 2012-10-11 13:43:51.017043 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (65700 -> 65725) -5065> 2012-10-11 13:43:51.017051 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (65725 -> 65750) -5064> 2012-10-11 13:43:51.017059 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (65750 -> 65775) -5063> 2012-10-11 13:43:51.017070 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (65775 -> 65800) -5062> 2012-10-11 13:43:51.017082 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (65800 -> 65825) -5061> 2012-10-11 13:43:51.017090 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 25 (65825 -> 65850) -5060> 2012-10-11 13:43:51.017098 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (65850 -> 66321) -5059> 2012-10-11 13:43:51.017118 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (66321 -> 66792) -5058> 2012-10-11 13:43:51.017131 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (66792 -> 67263) -5057> 2012-10-11 13:43:51.017145 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (67263 -> 67734) -5056> 2012-10-11 13:43:51.017159 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (67734 -> 68205) -5055> 2012-10-11 13:43:51.017171 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (68205 -> 68676) -5054> 2012-10-11 13:43:51.017187 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (68676 -> 69147) -5053> 2012-10-11 13:43:51.017200 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (69147 -> 69618) -5052> 2012-10-11 13:43:51.017212 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (69618 -> 70089) -5051> 2012-10-11 13:43:51.017225 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (70089 -> 70560) -5050> 2012-10-11 13:43:51.017237 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (70560 -> 71031) -5049> 2012-10-11 13:43:51.123265 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955aa0 seq 3697 osr(0.f7 0x27a1150) 0x2ab11b0 -5048> 2012-10-11 13:43:51.123291 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955aa0 seq 3697 osr(0.f7 0x27a1150) 921 bytes (queue has 500 ops and 309978 bytes) -5047> 2012-10-11 13:43:51.123321 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.f7) v3 -- ?+0 0x28d1540 -5046> 2012-10-11 13:43:51.123400 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955a50 seq 3698 osr(1.f6 0x3176180) 0x311ec60 -5045> 2012-10-11 13:43:51.123407 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955a50 seq 3698 osr(1.f6 0x3176180) 921 bytes (queue has 500 ops and 309978 bytes) -5044> 2012-10-11 13:43:51.123433 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.f6) v3 -- ?+0 0x206da80 -5043> 2012-10-11 13:43:51.123453 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955aa0 seq 3697 osr(0.f7 0x27a1150)/0x27a1150 start -5042> 2012-10-11 13:43:51.123485 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955b90 seq 3699 osr(2.f5 0x25cf480) 0x311e000 -5041> 2012-10-11 13:43:51.123496 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955b90 seq 3699 osr(2.f5 0x25cf480) 921 bytes (queue has 500 ops and 309978 bytes) -5040> 2012-10-11 13:43:51.123508 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.f5) v3 -- ?+0 0x206dc40 -5039> 2012-10-11 13:43:51.123540 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2955a50 seq 3698 osr(1.f6 0x3176180)/0x3176180 start -5038> 2012-10-11 13:43:51.123562 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955b40 seq 3700 osr(0.f6 0x27a1180) 0x311ef30 -5037> 2012-10-11 13:43:51.123568 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955b40 seq 3700 osr(0.f6 0x27a1180) 921 bytes (queue has 500 ops and 309978 bytes) -5036> 2012-10-11 13:43:51.123578 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.f6) v3 -- ?+0 0x206de00 -5035> 2012-10-11 13:43:51.123620 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955af0 seq 3701 osr(2.f4 0x2468d20) 0x311ebd0 -5034> 2012-10-11 13:43:51.123625 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955af0 seq 3701 osr(2.f4 0x2468d20) 921 bytes (queue has 500 ops and 309978 bytes) -5033> 2012-10-11 13:43:51.123635 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.f4) v3 -- ?+0 0x1ed6700 -5032> 2012-10-11 13:43:51.123678 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955cd0 seq 3702 osr(1.f5 0x31761b0) 0x2ac9c60 -5031> 2012-10-11 13:43:51.123683 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955cd0 seq 3702 osr(1.f5 0x31761b0) 921 bytes (queue has 500 ops and 309978 bytes) -5030> 2012-10-11 13:43:51.123693 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.f5) v3 -- ?+0 0x1ed68c0 -5029> 2012-10-11 13:43:51.123735 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955c80 seq 3703 osr(0.f1 0x2468e70) 0x2ac9b40 -5028> 2012-10-11 13:43:51.123741 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955c80 seq 3703 osr(0.f1 0x2468e70) 921 bytes (queue has 500 ops and 309978 bytes) -5027> 2012-10-11 13:43:51.123751 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.f1) v3 -- ?+0 0x1ed6e00 -5026> 2012-10-11 13:43:51.123791 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955c30 seq 3704 osr(1.f0 0x2e38ea0) 0x2ac9a20 -5025> 2012-10-11 13:43:51.123797 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955c30 seq 3704 osr(1.f0 0x2e38ea0) 921 bytes (queue has 500 ops and 309978 bytes) -5024> 2012-10-11 13:43:51.123807 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.f0) v3 -- ?+0 0x2a271c0 -5023> 2012-10-11 13:43:51.123850 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955be0 seq 3705 osr(2.ef 0x2468f80) 0x2a32990 -5022> 2012-10-11 13:43:51.123855 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955be0 seq 3705 osr(2.ef 0x2468f80) 921 bytes (queue has 500 ops and 309978 bytes) -5021> 2012-10-11 13:43:51.123864 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.ef) v3 -- ?+0 0x2a27380 -5020> 2012-10-11 13:43:51.123883 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955e60 seq 3706 osr(0.eb 0x2468f90) 0x2a326c0 -5019> 2012-10-11 13:43:51.123886 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955e60 seq 3706 osr(0.eb 0x2468f90) 921 bytes (queue has 500 ops and 309978 bytes) -5018> 2012-10-11 13:43:51.123895 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.eb) v3 -- ?+0 0x2a27540 -5017> 2012-10-11 13:43:51.123914 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955e10 seq 3707 osr(1.ea 0x2e38fc0) 0x2a32870 -5016> 2012-10-11 13:43:51.123917 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955e10 seq 3707 osr(1.ea 0x2e38fc0) 921 bytes (queue has 500 ops and 309978 bytes) -5015> 2012-10-11 13:43:51.123925 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.ea) v3 -- ?+0 0x2a27700 -5014> 2012-10-11 13:43:51.123941 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955dc0 seq 3708 osr(2.e9 0x2468b40) 0x2a32ea0 -5013> 2012-10-11 13:43:51.123944 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955dc0 seq 3708 osr(2.e9 0x2468b40) 921 bytes (queue has 500 ops and 309978 bytes) -5012> 2012-10-11 13:43:51.123953 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.e9) v3 -- ?+0 0x24af540 -5011> 2012-10-11 13:43:51.123968 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955d70 seq 3709 osr(0.e7 0x2468c50) 0x2a32900 -5010> 2012-10-11 13:43:51.123971 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955d70 seq 3709 osr(0.e7 0x2468c50) 921 bytes (queue has 500 ops and 309978 bytes) -5009> 2012-10-11 13:43:51.123981 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.e7) v3 -- ?+0 0x3435a80 -5008> 2012-10-11 13:43:51.123997 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955d20 seq 3710 osr(1.e6 0x2e38c80) 0x2a32ab0 -5007> 2012-10-11 13:43:51.124002 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955d20 seq 3710 osr(1.e6 0x2e38c80) 921 bytes (queue has 500 ops and 309978 bytes) -5006> 2012-10-11 13:43:51.124010 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.e6) v3 -- ?+0 0x3435c40 -5005> 2012-10-11 13:43:51.124026 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27a7280 seq 3711 osr(0.ae 0x2468300) 0x2ac9360 -5004> 2012-10-11 13:43:51.124030 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27a7280 seq 3711 osr(0.ae 0x2468300) 921 bytes (queue has 500 ops and 309978 bytes) -5003> 2012-10-11 13:43:51.124040 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.ae) v3 -- ?+0 0x3435e00 -5002> 2012-10-11 13:43:51.124056 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955fa0 seq 3712 osr(2.e5 0x2468a20) 0x24b6ab0 -5001> 2012-10-11 13:43:51.124059 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955fa0 seq 3712 osr(2.e5 0x2468a20) 921 bytes (queue has 500 ops and 309978 bytes) -5000> 2012-10-11 13:43:51.124070 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27a7230 seq 3713 osr(2.ac 0x3176e70) 0x2ac9480 -4999> 2012-10-11 13:43:51.124074 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27a7230 seq 3713 osr(2.ac 0x3176e70) 921 bytes (queue has 500 ops and 309978 bytes) -4998> 2012-10-11 13:43:51.124083 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955f50 seq 3714 osr(0.d6 0x2468b80) 0x24b6d80 -4997> 2012-10-11 13:43:51.124087 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955f50 seq 3714 osr(0.d6 0x2468b80) 921 bytes (queue has 500 ops and 309978 bytes) -4996> 2012-10-11 13:43:51.124081 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.e5) v3 -- ?+0 0x3216700 -4995> 2012-10-11 13:43:51.124097 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955f00 seq 3715 osr(2.d4 0x3176fe0) 0x3157e10 -4994> 2012-10-11 13:43:51.124101 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955f00 seq 3715 osr(2.d4 0x3176fe0) 921 bytes (queue has 500 ops and 309978 bytes) -4993> 2012-10-11 13:43:51.124104 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.ac) v3 -- ?+0 0x32168c0 -4992> 2012-10-11 13:43:51.124110 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2955eb0 seq 3716 osr(1.d5 0x2e38bb0) 0x3157ea0 -4991> 2012-10-11 13:43:51.124113 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2955eb0 seq 3716 osr(1.d5 0x2e38bb0) 921 bytes (queue has 500 ops and 309978 bytes) -4990> 2012-10-11 13:43:51.124113 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.d6) v3 -- ?+0 0x3216c40 -4989> 2012-10-11 13:43:51.124122 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24971e0 seq 3717 osr(0.12 0x1d715c0) 0x3157000 -4988> 2012-10-11 13:43:51.124121 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.d4) v3 -- ?+0 0x2229000 -4987> 2012-10-11 13:43:51.124127 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24971e0 seq 3717 osr(0.12 0x1d715c0) 921 bytes (queue has 500 ops and 309978 bytes) -4986> 2012-10-11 13:43:51.124130 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.d5) v3 -- ?+0 0x2229380 -4985> 2012-10-11 13:43:51.124136 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497190 seq 3718 osr(2.10 0x1d71520) 0x3157090 -4984> 2012-10-11 13:43:51.124139 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497190 seq 3718 osr(2.10 0x1d71520) 921 bytes (queue has 500 ops and 309978 bytes) -4983> 2012-10-11 13:43:51.124139 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.12) v3 -- ?+0 0x2229540 -4982> 2012-10-11 13:43:51.124149 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497140 seq 3719 osr(1.10 0x27a14a0) 0x3157120 -4981> 2012-10-11 13:43:51.124147 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.10) v3 -- ?+0 0x2229700 -4980> 2012-10-11 13:43:51.124152 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497140 seq 3719 osr(1.10 0x27a14a0) 921 bytes (queue has 500 ops and 309978 bytes) -4979> 2012-10-11 13:43:51.124163 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24970f0 seq 3720 osr(0.11 0x1d715f0) 0x2931e10 -4978> 2012-10-11 13:43:51.124168 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24970f0 seq 3720 osr(0.11 0x1d715f0) 921 bytes (queue has 500 ops and 309978 bytes) -4977> 2012-10-11 13:43:51.124165 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.10) v3 -- ?+0 0x2229a80 -4976> 2012-10-11 13:43:51.124177 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.11) v3 -- ?+0 0x29e6a80 -4975> 2012-10-11 13:43:51.124187 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24970a0 seq 3721 osr(1.11 0x27a1470) 0x29315a0 -4974> 2012-10-11 13:43:51.124197 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24970a0 seq 3721 osr(1.11 0x27a1470) 921 bytes (queue has 500 ops and 309978 bytes) -4973> 2012-10-11 13:43:51.124203 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497050 seq 3722 osr(0.10 0x1d714d0) 0x2931240 -4972> 2012-10-11 13:43:51.124206 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497050 seq 3722 osr(0.10 0x1d714d0) 921 bytes (queue has 500 ops and 309978 bytes) -4971> 2012-10-11 13:43:51.124209 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497000 seq 3723 osr(1.f 0x27a14d0) 0x2931b40 -4970> 2012-10-11 13:43:51.124212 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497000 seq 3723 osr(1.f 0x27a14d0) 915 bytes (queue has 500 ops and 309978 bytes) -4969> 2012-10-11 13:43:51.124214 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497e60 seq 3724 osr(0.e 0x1d71530) 0x2931750 -4968> 2012-10-11 13:43:51.124217 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497e60 seq 3724 osr(0.e 0x1d71530) 915 bytes (queue has 500 ops and 309978 bytes) -4967> 2012-10-11 13:43:51.124219 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497e10 seq 3725 osr(2.c 0x1d713d0) 0x2931630 -4966> 2012-10-11 13:43:51.124223 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497e10 seq 3725 osr(2.c 0x1d713d0) 915 bytes (queue has 500 ops and 309978 bytes) -4965> 2012-10-11 13:43:51.124226 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497dc0 seq 3726 osr(2.f 0x1d714f0) 0x29313f0 -4964> 2012-10-11 13:43:51.124219 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.11) v3 -- ?+0 0x29e6e00 -4963> 2012-10-11 13:43:51.124230 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497dc0 seq 3726 osr(2.f 0x1d714f0) 915 bytes (queue has 500 ops and 309978 bytes) -4962> 2012-10-11 13:43:51.124233 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497d70 seq 3727 osr(1.d 0x27a1530) 0x2931990 -4961> 2012-10-11 13:43:51.124236 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497d70 seq 3727 osr(1.d 0x27a1530) 915 bytes (queue has 500 ops and 309978 bytes) -4960> 2012-10-11 13:43:51.124238 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497d20 seq 3728 osr(2.e 0x1d71470) 0x2931900 -4959> 2012-10-11 13:43:51.124241 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497d20 seq 3728 osr(2.e 0x1d71470) 915 bytes (queue has 500 ops and 309978 bytes) -4958> 2012-10-11 13:43:51.124237 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.10) v3 -- ?+0 0x304e000 -4957> 2012-10-11 13:43:51.124244 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497cd0 seq 3729 osr(0.ca 0x24689c0) 0x2931000 -4956> 2012-10-11 13:43:51.124246 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497cd0 seq 3729 osr(0.ca 0x24689c0) 921 bytes (queue has 500 ops and 309978 bytes) -4955> 2012-10-11 13:43:51.124249 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497c80 seq 3730 osr(2.c8 0x24684e0) 0x2931d80 -4954> 2012-10-11 13:43:51.124252 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497c80 seq 3730 osr(2.c8 0x24684e0) 921 bytes (queue has 500 ops and 309978 bytes) -4953> 2012-10-11 13:43:51.124249 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.f) v3 -- ?+0 0x304e1c0 -4952> 2012-10-11 13:43:51.124256 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497c30 seq 3731 osr(0.c9 0x24689f0) 0x2931a20 -4951> 2012-10-11 13:43:51.124259 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497c30 seq 3731 osr(0.c9 0x24689f0) 921 bytes (queue has 500 ops and 309978 bytes) -4950> 2012-10-11 13:43:51.124262 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a43c0 seq 3732 osr(1.c8 0x2e38620) 0x22ffbd0 -4949> 2012-10-11 13:43:51.124264 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a43c0 seq 3732 osr(1.c8 0x2e38620) 921 bytes (queue has 500 ops and 309978 bytes) -4948> 2012-10-11 13:43:51.124267 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4e10 seq 3733 osr(1.c9 0x2e389f0) 0x31c5090 -4947> 2012-10-11 13:43:51.124263 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.e) v3 -- ?+0 0x304e540 -4946> 2012-10-11 13:43:51.124269 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4e10 seq 3733 osr(1.c9 0x2e389f0) 921 bytes (queue has 500 ops and 309978 bytes) -4945> 2012-10-11 13:43:51.124272 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27c7910 seq 3734 osr(0.c5 0x24686b0) 0x31c5360 -4944> 2012-10-11 13:43:51.124274 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27c7910 seq 3734 osr(0.c5 0x24686b0) 921 bytes (queue has 500 ops and 309978 bytes) -4943> 2012-10-11 13:43:51.124274 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.c) v3 -- ?+0 0x304e8c0 -4942> 2012-10-11 13:43:51.124277 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27c7fa0 seq 3735 osr(1.c4 0x2e386e0) 0x31c56c0 -4941> 2012-10-11 13:43:51.124280 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27c7fa0 seq 3735 osr(1.c4 0x2e386e0) 921 bytes (queue has 500 ops and 309978 bytes) -4940> 2012-10-11 13:43:51.124283 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27c7780 seq 3736 osr(2.c7 0x24684a0) 0x2e555a0 -4939> 2012-10-11 13:43:51.124281 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.f) v3 -- ?+0 0x304ea80 -4938> 2012-10-11 13:43:51.124285 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27c7780 seq 3736 osr(2.c7 0x24684a0) 921 bytes (queue has 500 ops and 309978 bytes) -4937> 2012-10-11 13:43:51.124288 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27c79b0 seq 3737 osr(0.4 0x1d71310) 0x2e55090 -4936> 2012-10-11 13:43:51.124290 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27c79b0 seq 3737 osr(0.4 0x1d71310) 915 bytes (queue has 500 ops and 309978 bytes) -4935> 2012-10-11 13:43:51.124290 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.d) v3 -- ?+0 0x304ee00 -4934> 2012-10-11 13:43:51.124298 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.e) v3 -- ?+0 0x311c700 -4933> 2012-10-11 13:43:51.124312 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.ca) v3 -- ?+0 0x311c540 -4932> 2012-10-11 13:43:51.124317 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22c2a00 seq 3738 osr(0.c4 0x24686e0) 0x2e55480 -4931> 2012-10-11 13:43:51.124322 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22c2a00 seq 3738 osr(0.c4 0x24686e0) 921 bytes (queue has 500 ops and 309978 bytes) -4930> 2012-10-11 13:43:51.124322 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.c8) v3 -- ?+0 0x311c380 -4929> 2012-10-11 13:43:51.124330 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.c9) v3 -- ?+0 0x311c1c0 -4928> 2012-10-11 13:43:51.124337 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22c2690 seq 3739 osr(1.3 0x27a1310) 0x2e55360 -4927> 2012-10-11 13:43:51.124340 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22c2690 seq 3739 osr(1.3 0x27a1310) 915 bytes (queue has 500 ops and 309978 bytes) -4926> 2012-10-11 13:43:51.124339 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.c8) v3 -- ?+0 0x311c000 -4925> 2012-10-11 13:43:51.124346 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.c9) v3 -- ?+0 0x309e8c0 -4924> 2012-10-11 13:43:51.124354 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1fae9b0 seq 3740 osr(0.2 0x1d712c0) 0x30391b0 -4923> 2012-10-11 13:43:51.124358 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1fae9b0 seq 3740 osr(0.2 0x1d712c0) 915 bytes (queue has 500 ops and 309978 bytes) -4922> 2012-10-11 13:43:51.124355 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.c5) v3 -- ?+0 0x309ec40 -4921> 2012-10-11 13:43:51.124363 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.c4) v3 -- ?+0 0x309ee00 -4920> 2012-10-11 13:43:51.124371 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3418230 seq 3741 osr(2.0 0x3176330) 0x3039f30 -4919> 2012-10-11 13:43:51.124371 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.c7) v3 -- ?+0 0x309e000 -4918> 2012-10-11 13:43:51.124375 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3418230 seq 3741 osr(2.0 0x3176330) 915 bytes (queue has 500 ops and 309978 bytes) -4917> 2012-10-11 13:43:51.124379 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.4) v3 -- ?+0 0x309e380 -4916> 2012-10-11 13:43:51.124390 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27a71e0 seq 3742 osr(0.ad 0x2468330) 0x2ac91b0 -4915> 2012-10-11 13:43:51.124389 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.c4) v3 -- ?+0 0x309e700 -4914> 2012-10-11 13:43:51.124395 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27a71e0 seq 3742 osr(0.ad 0x2468330) 921 bytes (queue has 500 ops and 309978 bytes) -4913> 2012-10-11 13:43:51.124399 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.3) v3 -- ?+0 0x206d000 -4912> 2012-10-11 13:43:51.124409 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.2) v3 -- ?+0 0x206d380 -4911> 2012-10-11 13:43:51.124411 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27a7190 seq 3743 osr(1.ac 0x2e38360) 0x2ac9090 -4910> 2012-10-11 13:43:51.124422 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27a7190 seq 3743 osr(1.ac 0x2e38360) 921 bytes (queue has 500 ops and 309978 bytes) -4909> 2012-10-11 13:43:51.124420 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.0) v3 -- ?+0 0x206d540 -4908> 2012-10-11 13:43:51.124428 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.ad) v3 -- ?+0 0x206d700 -4907> 2012-10-11 13:43:51.124434 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3418190 seq 3744 osr(0.c2 0x2468740) 0x3039b40 -4906> 2012-10-11 13:43:51.124438 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3418190 seq 3744 osr(0.c2 0x2468740) 921 bytes (queue has 500 ops and 309978 bytes) -4905> 2012-10-11 13:43:51.124440 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.ac) v3 -- ?+0 0x31acc40 -4904> 2012-10-11 13:43:51.124450 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27a7140 seq 3745 osr(2.af 0x3176de0) 0x2ac9240 -4903> 2012-10-11 13:43:51.124450 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.c2) v3 -- ?+0 0x31ace00 -4902> 2012-10-11 13:43:51.124453 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27a7140 seq 3745 osr(2.af 0x3176de0) 921 bytes (queue has 500 ops and 309978 bytes) -4901> 2012-10-11 13:43:51.124459 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.af) v3 -- ?+0 0x31ac000 -4900> 2012-10-11 13:43:51.124463 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4f50 seq 3746 osr(1.c3 0x2e38710) 0x3039000 -4899> 2012-10-11 13:43:51.124470 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4f50 seq 3746 osr(1.c3 0x2e38710) 921 bytes (queue has 500 ops and 309978 bytes) -4898> 2012-10-11 13:43:51.124482 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27a70f0 seq 3747 osr(0.aa 0x24683c0) 0x2ac95a0 -4897> 2012-10-11 13:43:51.124486 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27a70f0 seq 3747 osr(0.aa 0x24683c0) 921 bytes (queue has 500 ops and 309978 bytes) -4896> 2012-10-11 13:43:51.124494 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27a70a0 seq 3748 osr(2.a8 0x24681f0) 0x2ac9ea0 -4895> 2012-10-11 13:43:51.124498 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27a70a0 seq 3748 osr(2.a8 0x24681f0) 921 bytes (queue has 500 ops and 309978 bytes) -4894> 2012-10-11 13:43:51.124507 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27a7050 seq 3749 osr(2.ab 0x3176ea0) 0x24b6cf0 -4893> 2012-10-11 13:43:51.124510 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27a7050 seq 3749 osr(2.ab 0x3176ea0) 921 bytes (queue has 500 ops and 309978 bytes) -4892> 2012-10-11 13:43:51.124519 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27a7000 seq 3750 osr(1.a9 0x2e383f0) 0x31c5f30 -4891> 2012-10-11 13:43:51.124522 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27a7000 seq 3750 osr(1.a9 0x2e383f0) 921 bytes (queue has 500 ops and 309978 bytes) -4890> 2012-10-11 13:43:51.124531 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4500 seq 3751 osr(2.c0 0x24686d0) 0x2ac97e0 -4889> 2012-10-11 13:43:51.124534 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4500 seq 3751 osr(2.c0 0x24686d0) 921 bytes (queue has 500 ops and 309978 bytes) -4888> 2012-10-11 13:43:51.124543 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4820 seq 3752 osr(2.c3 0x2468780) 0x2ac9750 -4887> 2012-10-11 13:43:51.124546 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4820 seq 3752 osr(2.c3 0x2468780) 921 bytes (queue has 500 ops and 309978 bytes) -4886> 2012-10-11 13:43:51.124559 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4640 seq 3753 osr(1.1 0x27a1370) 0x2ac92d0 -4885> 2012-10-11 13:43:51.124563 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4640 seq 3753 osr(1.1 0x27a1370) 915 bytes (queue has 500 ops and 309978 bytes) -4884> 2012-10-11 13:43:51.124571 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4190 seq 3754 osr(2.2 0x31762d0) 0x311ecf0 -4883> 2012-10-11 13:43:51.124575 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4190 seq 3754 osr(2.2 0x31762d0) 915 bytes (queue has 500 ops and 309978 bytes) -4882> 2012-10-11 13:43:51.124583 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4dc0 seq 3755 osr(1.c1 0x2e38770) 0x311eab0 -4881> 2012-10-11 13:43:51.124587 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4dc0 seq 3755 osr(1.c1 0x2e38770) 921 bytes (queue has 500 ops and 309978 bytes) -4880> 2012-10-11 13:43:51.124595 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6cd0 seq 3756 osr(1.b9 0x2e384f0) 0x2f21e10 -4879> 2012-10-11 13:43:51.124599 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6cd0 seq 3756 osr(1.b9 0x2e384f0) 198 bytes (queue has 500 ops and 309978 bytes) -4878> 2012-10-11 13:43:51.124613 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4c80 seq 3757 osr(2.c2 0x2468420) 0x311eb40 -4877> 2012-10-11 13:43:51.124616 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4c80 seq 3757 osr(2.c2 0x2468420) 921 bytes (queue has 500 ops and 309978 bytes) -4876> 2012-10-11 13:43:51.124625 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4370 seq 3758 osr(0.be 0x2468400) 0x311e870 -4875> 2012-10-11 13:43:51.124628 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4370 seq 3758 osr(0.be 0x2468400) 921 bytes (queue has 500 ops and 309978 bytes) -4874> 2012-10-11 13:43:51.124637 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2574c30 seq 3759 osr(2.bc 0x2468320) 0x311e120 -4873> 2012-10-11 13:43:51.124640 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2574c30 seq 3759 osr(2.bc 0x2468320) 921 bytes (queue has 500 ops and 309978 bytes) -4872> 2012-10-11 13:43:51.124649 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2574460 seq 3760 osr(0.bc 0x2468460) 0x311eea0 -4871> 2012-10-11 13:43:51.124653 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2574460 seq 3760 osr(0.bc 0x2468460) 921 bytes (queue has 500 ops and 309978 bytes) -4870> 2012-10-11 13:43:51.124661 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25745f0 seq 3761 osr(1.bd 0x2e38430) 0x311e750 -4869> 2012-10-11 13:43:51.124665 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25745f0 seq 3761 osr(1.bd 0x2e38430) 921 bytes (queue has 500 ops and 309978 bytes) -4868> 2012-10-11 13:43:51.124673 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3394cd0 seq 3762 osr(1.bb 0x2e38490) 0x311e480 -4867> 2012-10-11 13:43:51.124676 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3394cd0 seq 3762 osr(1.bb 0x2e38490) 921 bytes (queue has 500 ops and 309978 bytes) -4866> 2012-10-11 13:43:51.124687 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3394320 seq 3763 osr(2.ba 0x2468290) 0x311e6c0 -4865> 2012-10-11 13:43:51.124693 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3394320 seq 3763 osr(2.ba 0x2468290) 921 bytes (queue has 500 ops and 309978 bytes) -4864> 2012-10-11 13:43:51.124702 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29518c0 seq 3764 osr(0.b1 0x2468270) 0x311e510 -4863> 2012-10-11 13:43:51.124705 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29518c0 seq 3764 osr(0.b1 0x2468270) 921 bytes (queue has 500 ops and 309978 bytes) -4862> 2012-10-11 13:43:51.124714 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a60a0 seq 3765 osr(1.c2 0x2e38740) 0x250e7e0 -4861> 2012-10-11 13:43:51.124717 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a60a0 seq 3765 osr(1.c2 0x2e38740) 198 bytes (queue has 500 ops and 309978 bytes) -4860> 2012-10-11 13:43:51.124726 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6190 seq 3766 osr(1.cb 0x2e38990) 0x250eea0 -4859> 2012-10-11 13:43:51.124729 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6190 seq 3766 osr(1.cb 0x2e38990) 198 bytes (queue has 500 ops and 309978 bytes) -4858> 2012-10-11 13:43:51.124738 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fc4b0 seq 3767 osr(1.cf 0x2e388d0) 0x2a26510 -4857> 2012-10-11 13:43:51.124741 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fc4b0 seq 3767 osr(1.cf 0x2e388d0) 198 bytes (queue has 500 ops and 309978 bytes) -4856> 2012-10-11 13:43:51.124751 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fc460 seq 3768 osr(1.ee 0x2e38f00) 0x2e55d80 -4855> 2012-10-11 13:43:51.124754 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fc460 seq 3768 osr(1.ee 0x2e38f00) 198 bytes (queue has 500 ops and 309978 bytes) -4854> 2012-10-11 13:43:51.124763 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fc370 seq 3769 osr(1.f9 0x31760f0) 0x1d86bd0 -4853> 2012-10-11 13:43:51.124766 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fc370 seq 3769 osr(1.f9 0x31760f0) 198 bytes (queue has 500 ops and 309978 bytes) -4852> 2012-10-11 13:43:51.124775 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1f31b40 seq 3770 osr(1.fd 0x3176030) 0x22b9510 -4851> 2012-10-11 13:43:51.124778 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1f31b40 seq 3770 osr(1.fd 0x3176030) 198 bytes (queue has 500 ops and 309978 bytes) -4850> 2012-10-11 13:43:51.124787 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1f31a50 seq 3771 osr(2.4 0x3176270) 0x22b96c0 -4849> 2012-10-11 13:43:51.124791 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1f31a50 seq 3771 osr(2.4 0x3176270) 194 bytes (queue has 500 ops and 309978 bytes) -4848> 2012-10-11 13:43:51.124800 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1f31000 seq 3772 osr(2.7 0x1d71320) 0x31cb6c0 -4847> 2012-10-11 13:43:51.124803 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1f31000 seq 3772 osr(2.7 0x1d71320) 194 bytes (queue has 500 ops and 309978 bytes) -4846> 2012-10-11 13:43:51.124812 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1f31280 seq 3773 osr(2.12 0x1d715a0) 0x2e55a20 -4845> 2012-10-11 13:43:51.124815 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1f31280 seq 3773 osr(2.12 0x1d715a0) 198 bytes (queue has 500 ops and 309978 bytes) -4844> 2012-10-11 13:43:51.124820 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 77 (0xb7c748 -> 423) -4843> 2012-10-11 13:43:51.124824 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 63992 (0xb7c748 -> 248486) -4842> 2012-10-11 13:43:51.124826 7f440a339700 5 journal put_throttle finished 77 ops and 63992 bytes, now 423 ops and 248486 bytes -4841> 2012-10-11 13:43:51.125018 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955b90 seq 3699 osr(2.f5 0x25cf480)/0x25cf480 start -4840> 2012-10-11 13:43:51.125044 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2955b40 seq 3700 osr(0.f6 0x27a1180)/0x27a1180 start -4839> 2012-10-11 13:43:51.125412 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.c3) v3 -- ?+0 0x31ac1c0 -4838> 2012-10-11 13:43:51.125431 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.aa) v3 -- ?+0 0x31ac380 -4837> 2012-10-11 13:43:51.125441 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.a8) v3 -- ?+0 0x31ac540 -4836> 2012-10-11 13:43:51.125450 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.ab) v3 -- ?+0 0x31ac700 -4835> 2012-10-11 13:43:51.125458 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.a9) v3 -- ?+0 0x1ed7000 -4834> 2012-10-11 13:43:51.125467 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.c0) v3 -- ?+0 0x1ed71c0 -4833> 2012-10-11 13:43:51.125477 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.c3) v3 -- ?+0 0x1ed7380 -4832> 2012-10-11 13:43:51.125485 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.1) v3 -- ?+0 0x1ed7540 -4831> 2012-10-11 13:43:51.125494 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.2) v3 -- ?+0 0x1ed7700 -4830> 2012-10-11 13:43:51.125503 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.c1) v3 -- ?+0 0x29e4000 -4829> 2012-10-11 13:43:51.125511 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.c2) v3 -- ?+0 0x29e41c0 -4828> 2012-10-11 13:43:51.125520 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.be) v3 -- ?+0 0x29e4380 -4827> 2012-10-11 13:43:51.125528 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.bc) v3 -- ?+0 0x29e4540 -4826> 2012-10-11 13:43:51.125537 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.bc) v3 -- ?+0 0x29e4700 -4825> 2012-10-11 13:43:51.125545 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.bd) v3 -- ?+0 0x29e4a80 -4824> 2012-10-11 13:43:51.125554 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:1.bb) v3 -- ?+0 0x29e4c40 -4823> 2012-10-11 13:43:51.125562 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:2.ba) v3 -- ?+0 0x29e6000 -4822> 2012-10-11 13:43:51.125571 7f4406b32700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e6:0.b1) v3 -- ?+0 0x29e61c0 -4821> 2012-10-11 13:43:51.125922 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955af0 seq 3701 osr(2.f4 0x2468d20)/0x2468d20 start -4820> 2012-10-11 13:43:51.126742 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955cd0 seq 3702 osr(1.f5 0x31761b0)/0x31761b0 start -4819> 2012-10-11 13:43:51.127564 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955c80 seq 3703 osr(0.f1 0x2468e70)/0x2468e70 start -4818> 2012-10-11 13:43:51.128417 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955c30 seq 3704 osr(1.f0 0x2e38ea0)/0x2e38ea0 start -4817> 2012-10-11 13:43:51.129236 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955be0 seq 3705 osr(2.ef 0x2468f80)/0x2468f80 start -4816> 2012-10-11 13:43:51.133876 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4815> 2012-10-11 13:43:51.133893 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4814> 2012-10-11 13:43:51.133901 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4197 0x301dea0 -4813> 2012-10-11 13:43:51.134501 7f440532f700 5 journal submit_entry seq 4197 len 205 (0x2c780c0) -4812> 2012-10-11 13:43:51.134538 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4811> 2012-10-11 13:43:51.134540 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4810> 2012-10-11 13:43:51.134427 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (71031 -> 71502) -4809> 2012-10-11 13:43:51.134607 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1673, time: 2012-10-11 13:43:51.134607, event: done, request: osd pg remove(epoch 7; pg1.76; ) v1 -4808> 2012-10-11 13:43:51.134626 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (71502 -> 71973) -4807> 2012-10-11 13:43:51.134633 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 71948) -4806> 2012-10-11 13:43:51.134637 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 654 ==== pg_query(0.22 epoch 8) v2 ==== 109+0+0 (1376935369 0 0) 0x2ac7c40 con 0x2fe2280 -4805> 2012-10-11 13:43:51.134648 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1674, time: 2012-10-11 13:43:50.315170, event: header_read, request: pg_query(0.22 epoch 8) v2 -4804> 2012-10-11 13:43:51.134652 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (71948 -> 72419) -4803> 2012-10-11 13:43:51.134653 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1674, time: 2012-10-11 13:43:50.315174, event: throttled, request: pg_query(0.22 epoch 8) v2 -4802> 2012-10-11 13:43:51.134657 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1674, time: 2012-10-11 13:43:50.315178, event: all_read, request: pg_query(0.22 epoch 8) v2 -4801> 2012-10-11 13:43:51.134661 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1674, time: 2012-10-11 13:43:51.134647, event: dispatched, request: pg_query(0.22 epoch 8) v2 -4800> 2012-10-11 13:43:51.134664 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1674, time: 2012-10-11 13:43:51.134664, event: waiting_for_osdmap, request: pg_query(0.22 epoch 8) v2 -4799> 2012-10-11 13:43:51.134671 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1674, time: 2012-10-11 13:43:51.134671, event: started, request: pg_query(0.22 epoch 8) v2 -4798> 2012-10-11 13:43:51.134675 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (72419 -> 72890) -4797> 2012-10-11 13:43:51.134683 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1674, time: 2012-10-11 13:43:51.134683, event: done, request: pg_query(0.22 epoch 8) v2 -4796> 2012-10-11 13:43:51.134690 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 72781) -4795> 2012-10-11 13:43:51.134692 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 999 ==== osd pg remove(epoch 7; pg1.7d; ) v1 ==== 25+0+0 (1687696936 0 0) 0x2a338c0 con 0x2fe2140 -4794> 2012-10-11 13:43:51.134697 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (72781 -> 73252) -4793> 2012-10-11 13:43:51.134699 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1675, time: 2012-10-11 13:43:49.387131, event: header_read, request: osd pg remove(epoch 7; pg1.7d; ) v1 -4792> 2012-10-11 13:43:51.134703 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1675, time: 2012-10-11 13:43:49.387133, event: throttled, request: osd pg remove(epoch 7; pg1.7d; ) v1 -4791> 2012-10-11 13:43:51.134707 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1675, time: 2012-10-11 13:43:49.387136, event: all_read, request: osd pg remove(epoch 7; pg1.7d; ) v1 -4790> 2012-10-11 13:43:51.134711 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1675, time: 2012-10-11 13:43:51.134698, event: dispatched, request: osd pg remove(epoch 7; pg1.7d; ) v1 -4789> 2012-10-11 13:43:51.134715 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1675, time: 2012-10-11 13:43:51.134715, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.7d; ) v1 -4788> 2012-10-11 13:43:51.134719 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (73252 -> 73723) -4787> 2012-10-11 13:43:51.134720 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1675, time: 2012-10-11 13:43:51.134719, event: started, request: osd pg remove(epoch 7; pg1.7d; ) v1 -4786> 2012-10-11 13:43:51.134724 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.7d -4785> 2012-10-11 13:43:51.134739 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (73723 -> 74194) -4784> 2012-10-11 13:43:51.134743 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.7d 0x2adb830)/0x2adb830 -4783> 2012-10-11 13:43:51.134747 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4782> 2012-10-11 13:43:51.134748 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4781> 2012-10-11 13:43:51.134749 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4198 0x301dbd0 -4780> 2012-10-11 13:43:51.134752 7f440532f700 5 journal submit_entry seq 4198 len 205 (0x2c78900) -4779> 2012-10-11 13:43:51.134753 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4778> 2012-10-11 13:43:51.134754 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4777> 2012-10-11 13:43:51.134765 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (74194 -> 74665) -4776> 2012-10-11 13:43:51.134776 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1675, time: 2012-10-11 13:43:51.134776, event: done, request: osd pg remove(epoch 7; pg1.7d; ) v1 -4775> 2012-10-11 13:43:51.134786 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (74665 -> 75136) -4774> 2012-10-11 13:43:51.134805 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (75136 -> 75607) -4773> 2012-10-11 13:43:51.134821 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 75582) -4772> 2012-10-11 13:43:51.134827 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 655 ==== pg_query(1.68 epoch 8) v2 ==== 109+0+0 (1620516513 0 0) 0x2ac7a80 con 0x2fe2280 -4771> 2012-10-11 13:43:51.134838 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1676, time: 2012-10-11 13:43:50.315182, event: header_read, request: pg_query(1.68 epoch 8) v2 -4770> 2012-10-11 13:43:51.134843 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1676, time: 2012-10-11 13:43:50.315186, event: throttled, request: pg_query(1.68 epoch 8) v2 -4769> 2012-10-11 13:43:51.134846 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1676, time: 2012-10-11 13:43:50.315191, event: all_read, request: pg_query(1.68 epoch 8) v2 -4768> 2012-10-11 13:43:51.134849 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1676, time: 2012-10-11 13:43:51.134836, event: dispatched, request: pg_query(1.68 epoch 8) v2 -4767> 2012-10-11 13:43:51.134857 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1676, time: 2012-10-11 13:43:51.134857, event: waiting_for_osdmap, request: pg_query(1.68 epoch 8) v2 -4766> 2012-10-11 13:43:51.134862 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1676, time: 2012-10-11 13:43:51.134862, event: started, request: pg_query(1.68 epoch 8) v2 -4765> 2012-10-11 13:43:51.134872 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1676, time: 2012-10-11 13:43:51.134872, event: done, request: pg_query(1.68 epoch 8) v2 -4764> 2012-10-11 13:43:51.134877 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (75582 -> 76053) -4763> 2012-10-11 13:43:51.134881 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 75944) -4762> 2012-10-11 13:43:51.134884 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1000 ==== osd pg remove(epoch 7; pg1.82; ) v1 ==== 25+0+0 (2072839821 0 0) 0x2a33700 con 0x2fe2140 -4761> 2012-10-11 13:43:51.134891 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1677, time: 2012-10-11 13:43:49.387139, event: header_read, request: osd pg remove(epoch 7; pg1.82; ) v1 -4760> 2012-10-11 13:43:51.134893 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (75944 -> 76415) -4759> 2012-10-11 13:43:51.134895 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1677, time: 2012-10-11 13:43:49.387141, event: throttled, request: osd pg remove(epoch 7; pg1.82; ) v1 -4758> 2012-10-11 13:43:51.134899 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1677, time: 2012-10-11 13:43:49.387145, event: all_read, request: osd pg remove(epoch 7; pg1.82; ) v1 -4757> 2012-10-11 13:43:51.134902 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1677, time: 2012-10-11 13:43:51.134890, event: dispatched, request: osd pg remove(epoch 7; pg1.82; ) v1 -4756> 2012-10-11 13:43:51.134906 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (76415 -> 76886) -4755> 2012-10-11 13:43:51.134906 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1677, time: 2012-10-11 13:43:51.134906, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.82; ) v1 -4754> 2012-10-11 13:43:51.134911 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1677, time: 2012-10-11 13:43:51.134911, event: started, request: osd pg remove(epoch 7; pg1.82; ) v1 -4753> 2012-10-11 13:43:51.134915 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.82 -4752> 2012-10-11 13:43:51.134922 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (76886 -> 77357) -4751> 2012-10-11 13:43:51.134929 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.82 0x2adbb40)/0x2adbb40 -4750> 2012-10-11 13:43:51.134935 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (77357 -> 77828) -4749> 2012-10-11 13:43:51.134938 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955e60 seq 3706 osr(0.eb 0x2468f90)/0x2468f90 start -4748> 2012-10-11 13:43:51.134947 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (77828 -> 78299) -4747> 2012-10-11 13:43:51.134959 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (78299 -> 78770) -4746> 2012-10-11 13:43:51.134971 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (78770 -> 79241) -4745> 2012-10-11 13:43:51.134983 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (79241 -> 79712) -4744> 2012-10-11 13:43:51.134996 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (79712 -> 80183) -4743> 2012-10-11 13:43:51.135008 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (80183 -> 80654) -4742> 2012-10-11 13:43:51.135019 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (80654 -> 81125) -4741> 2012-10-11 13:43:51.135031 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (81125 -> 81596) -4740> 2012-10-11 13:43:51.135043 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (81596 -> 82067) -4739> 2012-10-11 13:43:51.135055 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (82067 -> 82538) -4738> 2012-10-11 13:43:51.135066 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (82538 -> 83009) -4737> 2012-10-11 13:43:51.135078 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (83009 -> 83480) -4736> 2012-10-11 13:43:51.135090 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (83480 -> 83951) -4735> 2012-10-11 13:43:51.135105 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (83951 -> 84422) -4734> 2012-10-11 13:43:51.135117 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (84422 -> 84893) -4733> 2012-10-11 13:43:51.135128 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (84893 -> 85364) -4732> 2012-10-11 13:43:51.135140 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (85364 -> 85835) -4731> 2012-10-11 13:43:51.135152 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (85835 -> 86306) -4730> 2012-10-11 13:43:51.135164 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (86306 -> 86777) -4729> 2012-10-11 13:43:51.135175 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (86777 -> 87248) -4728> 2012-10-11 13:43:51.135187 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (87248 -> 87719) -4727> 2012-10-11 13:43:51.135191 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2955e10 seq 3707 osr(1.ea 0x2e38fc0)/0x2e38fc0 start -4726> 2012-10-11 13:43:51.135199 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (87719 -> 88190) -4725> 2012-10-11 13:43:51.135215 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (88190 -> 88661) -4724> 2012-10-11 13:43:51.135231 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (88661 -> 89132) -4723> 2012-10-11 13:43:51.135243 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (89132 -> 89603) -4722> 2012-10-11 13:43:51.135255 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (89603 -> 90074) -4721> 2012-10-11 13:43:51.135267 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (90074 -> 90545) -4720> 2012-10-11 13:43:51.135280 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (90545 -> 91016) -4719> 2012-10-11 13:43:51.135292 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (91016 -> 91487) -4718> 2012-10-11 13:43:51.135304 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (91487 -> 91958) -4717> 2012-10-11 13:43:51.135316 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (91958 -> 92429) -4716> 2012-10-11 13:43:51.135328 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (92429 -> 92900) -4715> 2012-10-11 13:43:51.135330 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4714> 2012-10-11 13:43:51.135336 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4713> 2012-10-11 13:43:51.135338 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4199 0x301d630 -4712> 2012-10-11 13:43:51.135340 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (92900 -> 93371) -4711> 2012-10-11 13:43:51.135342 7f440532f700 5 journal submit_entry seq 4199 len 205 (0x2cc4bd0) -4710> 2012-10-11 13:43:51.135344 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4709> 2012-10-11 13:43:51.135345 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4708> 2012-10-11 13:43:51.135352 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (93371 -> 93842) -4707> 2012-10-11 13:43:51.135364 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (93842 -> 94313) -4706> 2012-10-11 13:43:51.135370 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1677, time: 2012-10-11 13:43:51.135370, event: done, request: osd pg remove(epoch 7; pg1.82; ) v1 -4705> 2012-10-11 13:43:51.135377 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (94313 -> 94784) -4704> 2012-10-11 13:43:51.135383 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 94759) -4703> 2012-10-11 13:43:51.135389 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (94759 -> 95230) -4702> 2012-10-11 13:43:51.135386 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 656 ==== pg_query(2.60 epoch 8) v2 ==== 109+0+0 (276089697 0 0) 0x2ac78c0 con 0x2fe2280 -4701> 2012-10-11 13:43:51.135395 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1678, time: 2012-10-11 13:43:50.315194, event: header_read, request: pg_query(2.60 epoch 8) v2 -4700> 2012-10-11 13:43:51.135401 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (95230 -> 95701) -4699> 2012-10-11 13:43:51.135399 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1678, time: 2012-10-11 13:43:50.315198, event: throttled, request: pg_query(2.60 epoch 8) v2 -4698> 2012-10-11 13:43:51.135404 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1678, time: 2012-10-11 13:43:50.315219, event: all_read, request: pg_query(2.60 epoch 8) v2 -4697> 2012-10-11 13:43:51.135407 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1678, time: 2012-10-11 13:43:51.135394, event: dispatched, request: pg_query(2.60 epoch 8) v2 -4696> 2012-10-11 13:43:51.135411 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1678, time: 2012-10-11 13:43:51.135411, event: waiting_for_osdmap, request: pg_query(2.60 epoch 8) v2 -4695> 2012-10-11 13:43:51.135414 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (95701 -> 96172) -4694> 2012-10-11 13:43:51.135416 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1678, time: 2012-10-11 13:43:51.135416, event: started, request: pg_query(2.60 epoch 8) v2 -4693> 2012-10-11 13:43:51.135426 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (96172 -> 96643) -4692> 2012-10-11 13:43:51.135426 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1678, time: 2012-10-11 13:43:51.135426, event: done, request: pg_query(2.60 epoch 8) v2 -4691> 2012-10-11 13:43:51.135434 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 96534) -4690> 2012-10-11 13:43:51.135439 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (96534 -> 97005) -4689> 2012-10-11 13:43:51.135437 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1001 ==== osd pg remove(epoch 7; pg1.83; ) v1 ==== 25+0+0 (850492330 0 0) 0x2a33540 con 0x2fe2140 -4688> 2012-10-11 13:43:51.135444 7f440d33f700 5 osd.0 8 tick -4687> 2012-10-11 13:43:51.135452 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (97005 -> 97476) -4686> 2012-10-11 13:43:51.135464 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (97476 -> 97947) -4685> 2012-10-11 13:43:51.135476 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (97947 -> 98418) -4684> 2012-10-11 13:43:51.135488 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (98418 -> 98889) -4683> 2012-10-11 13:43:51.135504 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (98889 -> 99360) -4682> 2012-10-11 13:43:51.135516 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (99360 -> 99831) -4681> 2012-10-11 13:43:51.135528 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (99831 -> 100302) -4680> 2012-10-11 13:43:51.135540 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (100302 -> 100773) -4679> 2012-10-11 13:43:51.135553 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (100773 -> 101244) -4678> 2012-10-11 13:43:51.135553 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1679, time: 2012-10-11 13:43:49.483286, event: header_read, request: osd pg remove(epoch 7; pg1.83; ) v1 -4677> 2012-10-11 13:43:51.135565 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (101244 -> 101715) -4676> 2012-10-11 13:43:51.135567 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1679, time: 2012-10-11 13:43:49.483304, event: throttled, request: osd pg remove(epoch 7; pg1.83; ) v1 -4675> 2012-10-11 13:43:51.135571 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1679, time: 2012-10-11 13:43:49.483312, event: all_read, request: osd pg remove(epoch 7; pg1.83; ) v1 -4674> 2012-10-11 13:43:51.135575 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1679, time: 2012-10-11 13:43:51.135444, event: dispatched, request: osd pg remove(epoch 7; pg1.83; ) v1 -4673> 2012-10-11 13:43:51.135577 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (101715 -> 102186) -4672> 2012-10-11 13:43:51.135579 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1679, time: 2012-10-11 13:43:51.135579, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg1.83; ) v1 -4671> 2012-10-11 13:43:51.135584 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1679, time: 2012-10-11 13:43:51.135584, event: started, request: osd pg remove(epoch 7; pg1.83; ) v1 -4670> 2012-10-11 13:43:51.135588 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.83 -4669> 2012-10-11 13:43:51.135603 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.83 0x2adbb10)/0x2adbb10 -4668> 2012-10-11 13:43:51.135607 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4667> 2012-10-11 13:43:51.135608 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4666> 2012-10-11 13:43:51.135610 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4200 0x301d5a0 -4665> 2012-10-11 13:43:51.135612 7f440532f700 5 journal submit_entry seq 4200 len 205 (0x2cc4c60) -4664> 2012-10-11 13:43:51.135614 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4663> 2012-10-11 13:43:51.135616 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4662> 2012-10-11 13:43:51.135638 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1679, time: 2012-10-11 13:43:51.135638, event: done, request: osd pg remove(epoch 7; pg1.83; ) v1 -4661> 2012-10-11 13:43:51.135662 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 102161) -4660> 2012-10-11 13:43:51.135668 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 657 ==== pg_query(0.62 epoch 8) v2 ==== 109+0+0 (2458763256 0 0) 0x2ac7700 con 0x2fe2280 -4659> 2012-10-11 13:43:51.135677 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1680, time: 2012-10-11 13:43:50.315272, event: header_read, request: pg_query(0.62 epoch 8) v2 -4658> 2012-10-11 13:43:51.135682 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1680, time: 2012-10-11 13:43:50.315280, event: throttled, request: pg_query(0.62 epoch 8) v2 -4657> 2012-10-11 13:43:51.135685 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1680, time: 2012-10-11 13:43:50.315286, event: all_read, request: pg_query(0.62 epoch 8) v2 -4656> 2012-10-11 13:43:51.135688 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1680, time: 2012-10-11 13:43:51.135676, event: dispatched, request: pg_query(0.62 epoch 8) v2 -4655> 2012-10-11 13:43:51.135692 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1680, time: 2012-10-11 13:43:51.135692, event: waiting_for_osdmap, request: pg_query(0.62 epoch 8) v2 -4654> 2012-10-11 13:43:51.135697 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1680, time: 2012-10-11 13:43:51.135697, event: started, request: pg_query(0.62 epoch 8) v2 -4653> 2012-10-11 13:43:51.135710 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1680, time: 2012-10-11 13:43:51.135710, event: done, request: pg_query(0.62 epoch 8) v2 -4652> 2012-10-11 13:43:51.135717 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 102052) -4651> 2012-10-11 13:43:51.135719 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1002 ==== osd pg remove(epoch 7; pg2.22; ) v1 ==== 25+0+0 (1366594947 0 0) 0x2a33380 con 0x2fe2140 -4650> 2012-10-11 13:43:51.135727 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1681, time: 2012-10-11 13:43:49.483318, event: header_read, request: osd pg remove(epoch 7; pg2.22; ) v1 -4649> 2012-10-11 13:43:51.135733 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1681, time: 2012-10-11 13:43:49.483321, event: throttled, request: osd pg remove(epoch 7; pg2.22; ) v1 -4648> 2012-10-11 13:43:51.135737 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1681, time: 2012-10-11 13:43:49.483325, event: all_read, request: osd pg remove(epoch 7; pg2.22; ) v1 -4647> 2012-10-11 13:43:51.135742 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1681, time: 2012-10-11 13:43:51.135727, event: dispatched, request: osd pg remove(epoch 7; pg2.22; ) v1 -4646> 2012-10-11 13:43:51.135746 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1681, time: 2012-10-11 13:43:51.135746, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.22; ) v1 -4645> 2012-10-11 13:43:51.135764 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1681, time: 2012-10-11 13:43:51.135764, event: started, request: osd pg remove(epoch 7; pg2.22; ) v1 -4644> 2012-10-11 13:43:51.135769 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.22 -4643> 2012-10-11 13:43:51.135782 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.22 0x1d71920)/0x1d71920 -4642> 2012-10-11 13:43:51.135787 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4641> 2012-10-11 13:43:51.135788 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4640> 2012-10-11 13:43:51.135789 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4201 0x301d240 -4639> 2012-10-11 13:43:51.135792 7f440532f700 5 journal submit_entry seq 4201 len 205 (0x2d19480) -4638> 2012-10-11 13:43:51.135794 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4637> 2012-10-11 13:43:51.135795 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4636> 2012-10-11 13:43:51.135816 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1681, time: 2012-10-11 13:43:51.135816, event: done, request: osd pg remove(epoch 7; pg2.22; ) v1 -4635> 2012-10-11 13:43:51.135826 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 102027) -4634> 2012-10-11 13:43:51.135829 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 658 ==== pg_query(1.61 epoch 8) v2 ==== 109+0+0 (1596760682 0 0) 0x2ac7540 con 0x2fe2280 -4633> 2012-10-11 13:43:51.135839 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1682, time: 2012-10-11 13:43:50.315438, event: header_read, request: pg_query(1.61 epoch 8) v2 -4632> 2012-10-11 13:43:51.135843 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1682, time: 2012-10-11 13:43:50.315445, event: throttled, request: pg_query(1.61 epoch 8) v2 -4631> 2012-10-11 13:43:51.135849 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1682, time: 2012-10-11 13:43:50.315463, event: all_read, request: pg_query(1.61 epoch 8) v2 -4630> 2012-10-11 13:43:51.135852 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1682, time: 2012-10-11 13:43:51.135838, event: dispatched, request: pg_query(1.61 epoch 8) v2 -4629> 2012-10-11 13:43:51.135857 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1682, time: 2012-10-11 13:43:51.135857, event: waiting_for_osdmap, request: pg_query(1.61 epoch 8) v2 -4628> 2012-10-11 13:43:51.135862 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1682, time: 2012-10-11 13:43:51.135862, event: started, request: pg_query(1.61 epoch 8) v2 -4627> 2012-10-11 13:43:51.135873 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1682, time: 2012-10-11 13:43:51.135873, event: done, request: pg_query(1.61 epoch 8) v2 -4626> 2012-10-11 13:43:51.135880 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 101918) -4625> 2012-10-11 13:43:51.135882 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1003 ==== osd pg remove(epoch 7; pg2.2a; ) v1 ==== 25+0+0 (323981657 0 0) 0x2a331c0 con 0x2fe2140 -4624> 2012-10-11 13:43:51.135904 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1683, time: 2012-10-11 13:43:49.483328, event: header_read, request: osd pg remove(epoch 7; pg2.2a; ) v1 -4623> 2012-10-11 13:43:51.135910 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1683, time: 2012-10-11 13:43:49.483330, event: throttled, request: osd pg remove(epoch 7; pg2.2a; ) v1 -4622> 2012-10-11 13:43:51.135915 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1683, time: 2012-10-11 13:43:49.483334, event: all_read, request: osd pg remove(epoch 7; pg2.2a; ) v1 -4621> 2012-10-11 13:43:51.135933 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1683, time: 2012-10-11 13:43:51.135902, event: dispatched, request: osd pg remove(epoch 7; pg2.2a; ) v1 -4620> 2012-10-11 13:43:51.135937 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1683, time: 2012-10-11 13:43:51.135937, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.2a; ) v1 -4619> 2012-10-11 13:43:51.135942 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1683, time: 2012-10-11 13:43:51.135942, event: started, request: osd pg remove(epoch 7; pg2.2a; ) v1 -4618> 2012-10-11 13:43:51.135946 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.2a -4617> 2012-10-11 13:43:51.135960 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.2a 0x3176600)/0x3176600 -4616> 2012-10-11 13:43:51.135965 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4615> 2012-10-11 13:43:51.135966 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4614> 2012-10-11 13:43:51.135968 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4202 0x301d7e0 -4613> 2012-10-11 13:43:51.135972 7f440532f700 5 journal submit_entry seq 4202 len 205 (0x1fa88a0) -4612> 2012-10-11 13:43:51.135974 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4611> 2012-10-11 13:43:51.135977 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4610> 2012-10-11 13:43:51.135997 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1683, time: 2012-10-11 13:43:51.135997, event: done, request: osd pg remove(epoch 7; pg2.2a; ) v1 -4609> 2012-10-11 13:43:51.136008 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 101893) -4608> 2012-10-11 13:43:51.136011 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 659 ==== pg_query(0.21 epoch 8) v2 ==== 109+0+0 (1529614140 0 0) 0x2ac7380 con 0x2fe2280 -4607> 2012-10-11 13:43:51.136021 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1684, time: 2012-10-11 13:43:50.315567, event: header_read, request: pg_query(0.21 epoch 8) v2 -4606> 2012-10-11 13:43:51.136026 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1684, time: 2012-10-11 13:43:50.315576, event: throttled, request: pg_query(0.21 epoch 8) v2 -4605> 2012-10-11 13:43:51.136030 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1684, time: 2012-10-11 13:43:50.315583, event: all_read, request: pg_query(0.21 epoch 8) v2 -4604> 2012-10-11 13:43:51.136035 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1684, time: 2012-10-11 13:43:51.136020, event: dispatched, request: pg_query(0.21 epoch 8) v2 -4603> 2012-10-11 13:43:51.136039 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1684, time: 2012-10-11 13:43:51.136039, event: waiting_for_osdmap, request: pg_query(0.21 epoch 8) v2 -4602> 2012-10-11 13:43:51.136045 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1684, time: 2012-10-11 13:43:51.136045, event: started, request: pg_query(0.21 epoch 8) v2 -4601> 2012-10-11 13:43:51.136055 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1684, time: 2012-10-11 13:43:51.136055, event: done, request: pg_query(0.21 epoch 8) v2 -4600> 2012-10-11 13:43:51.136062 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 101784) -4599> 2012-10-11 13:43:51.136066 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1004 ==== osd pg remove(epoch 7; pg2.2d; ) v1 ==== 25+0+0 (3910571101 0 0) 0x2a33000 con 0x2fe2140 -4598> 2012-10-11 13:43:51.136074 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1685, time: 2012-10-11 13:43:49.483337, event: header_read, request: osd pg remove(epoch 7; pg2.2d; ) v1 -4597> 2012-10-11 13:43:51.136079 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1685, time: 2012-10-11 13:43:49.483339, event: throttled, request: osd pg remove(epoch 7; pg2.2d; ) v1 -4596> 2012-10-11 13:43:51.136083 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1685, time: 2012-10-11 13:43:49.483342, event: all_read, request: osd pg remove(epoch 7; pg2.2d; ) v1 -4595> 2012-10-11 13:43:51.136088 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1685, time: 2012-10-11 13:43:51.136073, event: dispatched, request: osd pg remove(epoch 7; pg2.2d; ) v1 -4594> 2012-10-11 13:43:51.136093 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1685, time: 2012-10-11 13:43:51.136093, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.2d; ) v1 -4593> 2012-10-11 13:43:51.136098 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1685, time: 2012-10-11 13:43:51.136098, event: started, request: osd pg remove(epoch 7; pg2.2d; ) v1 -4592> 2012-10-11 13:43:51.136117 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.2d -4591> 2012-10-11 13:43:51.136131 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.2d 0x3176570)/0x3176570 -4590> 2012-10-11 13:43:51.136135 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4589> 2012-10-11 13:43:51.136137 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4588> 2012-10-11 13:43:51.136138 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4203 0x301dab0 -4587> 2012-10-11 13:43:51.136142 7f440532f700 5 journal submit_entry seq 4203 len 205 (0x320b3f0) -4586> 2012-10-11 13:43:51.136144 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4585> 2012-10-11 13:43:51.136146 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4584> 2012-10-11 13:43:51.136166 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1685, time: 2012-10-11 13:43:51.136165, event: done, request: osd pg remove(epoch 7; pg2.2d; ) v1 -4583> 2012-10-11 13:43:51.136188 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 101759) -4582> 2012-10-11 13:43:51.136192 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 660 ==== pg_query(0.20 epoch 8) v2 ==== 109+0+0 (1547288943 0 0) 0x2ac71c0 con 0x2fe2280 -4581> 2012-10-11 13:43:51.136203 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1686, time: 2012-10-11 13:43:50.315816, event: header_read, request: pg_query(0.20 epoch 8) v2 -4580> 2012-10-11 13:43:51.136208 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1686, time: 2012-10-11 13:43:50.315825, event: throttled, request: pg_query(0.20 epoch 8) v2 -4579> 2012-10-11 13:43:51.136213 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1686, time: 2012-10-11 13:43:50.315848, event: all_read, request: pg_query(0.20 epoch 8) v2 -4578> 2012-10-11 13:43:51.136218 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1686, time: 2012-10-11 13:43:51.136202, event: dispatched, request: pg_query(0.20 epoch 8) v2 -4577> 2012-10-11 13:43:51.136223 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1686, time: 2012-10-11 13:43:51.136222, event: waiting_for_osdmap, request: pg_query(0.20 epoch 8) v2 -4576> 2012-10-11 13:43:51.136229 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1686, time: 2012-10-11 13:43:51.136229, event: started, request: pg_query(0.20 epoch 8) v2 -4575> 2012-10-11 13:43:51.136239 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1686, time: 2012-10-11 13:43:51.136239, event: done, request: pg_query(0.20 epoch 8) v2 -4574> 2012-10-11 13:43:51.136256 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 101650) -4573> 2012-10-11 13:43:51.136261 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1005 ==== osd pg remove(epoch 7; pg2.30; ) v1 ==== 25+0+0 (1199203961 0 0) 0x2d6ee00 con 0x2fe2140 -4572> 2012-10-11 13:43:51.136270 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1687, time: 2012-10-11 13:43:49.483345, event: header_read, request: osd pg remove(epoch 7; pg2.30; ) v1 -4571> 2012-10-11 13:43:51.136275 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1687, time: 2012-10-11 13:43:49.483347, event: throttled, request: osd pg remove(epoch 7; pg2.30; ) v1 -4570> 2012-10-11 13:43:51.136281 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1687, time: 2012-10-11 13:43:49.483352, event: all_read, request: osd pg remove(epoch 7; pg2.30; ) v1 -4569> 2012-10-11 13:43:51.136285 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1687, time: 2012-10-11 13:43:51.136269, event: dispatched, request: osd pg remove(epoch 7; pg2.30; ) v1 -4568> 2012-10-11 13:43:51.136290 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1687, time: 2012-10-11 13:43:51.136290, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.30; ) v1 -4567> 2012-10-11 13:43:51.136296 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1687, time: 2012-10-11 13:43:51.136296, event: started, request: osd pg remove(epoch 7; pg2.30; ) v1 -4566> 2012-10-11 13:43:51.136301 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.30 -4565> 2012-10-11 13:43:51.136314 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.30 0x1d71ab0)/0x1d71ab0 -4564> 2012-10-11 13:43:51.136318 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4563> 2012-10-11 13:43:51.136319 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4562> 2012-10-11 13:43:51.136321 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4204 0x301d000 -4561> 2012-10-11 13:43:51.136324 7f440532f700 5 journal submit_entry seq 4204 len 205 (0x320bae0) -4560> 2012-10-11 13:43:51.136327 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4559> 2012-10-11 13:43:51.136328 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4558> 2012-10-11 13:43:51.136349 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1687, time: 2012-10-11 13:43:51.136349, event: done, request: osd pg remove(epoch 7; pg2.30; ) v1 -4557> 2012-10-11 13:43:51.136359 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 101625) -4556> 2012-10-11 13:43:51.136363 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 661 ==== pg_query(2.1d epoch 8) v2 ==== 109+0+0 (1625457543 0 0) 0x2ac7000 con 0x2fe2280 -4555> 2012-10-11 13:43:51.136372 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1688, time: 2012-10-11 13:43:50.316044, event: header_read, request: pg_query(2.1d epoch 8) v2 -4554> 2012-10-11 13:43:51.136377 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1688, time: 2012-10-11 13:43:50.316052, event: throttled, request: pg_query(2.1d epoch 8) v2 -4553> 2012-10-11 13:43:51.136381 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1688, time: 2012-10-11 13:43:50.316058, event: all_read, request: pg_query(2.1d epoch 8) v2 -4552> 2012-10-11 13:43:51.136399 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1688, time: 2012-10-11 13:43:51.136371, event: dispatched, request: pg_query(2.1d epoch 8) v2 -4551> 2012-10-11 13:43:51.136405 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1688, time: 2012-10-11 13:43:51.136405, event: waiting_for_osdmap, request: pg_query(2.1d epoch 8) v2 -4550> 2012-10-11 13:43:51.136411 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1688, time: 2012-10-11 13:43:51.136410, event: started, request: pg_query(2.1d epoch 8) v2 -4549> 2012-10-11 13:43:51.136422 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1688, time: 2012-10-11 13:43:51.136421, event: done, request: pg_query(2.1d epoch 8) v2 -4548> 2012-10-11 13:43:51.136429 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 101516) -4547> 2012-10-11 13:43:51.136433 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1006 ==== osd pg remove(epoch 7; pg2.31; ) v1 ==== 25+0+0 (239475550 0 0) 0x2d6ec40 con 0x2fe2140 -4546> 2012-10-11 13:43:51.136442 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1689, time: 2012-10-11 13:43:49.483355, event: header_read, request: osd pg remove(epoch 7; pg2.31; ) v1 -4545> 2012-10-11 13:43:51.136447 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1689, time: 2012-10-11 13:43:49.483357, event: throttled, request: osd pg remove(epoch 7; pg2.31; ) v1 -4544> 2012-10-11 13:43:51.136452 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1689, time: 2012-10-11 13:43:49.483360, event: all_read, request: osd pg remove(epoch 7; pg2.31; ) v1 -4543> 2012-10-11 13:43:51.136457 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1689, time: 2012-10-11 13:43:51.136441, event: dispatched, request: osd pg remove(epoch 7; pg2.31; ) v1 -4542> 2012-10-11 13:43:51.136462 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1689, time: 2012-10-11 13:43:51.136462, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.31; ) v1 -4541> 2012-10-11 13:43:51.136467 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1689, time: 2012-10-11 13:43:51.136467, event: started, request: osd pg remove(epoch 7; pg2.31; ) v1 -4540> 2012-10-11 13:43:51.136472 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.31 -4539> 2012-10-11 13:43:51.136484 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.31 0x1d71b00)/0x1d71b00 -4538> 2012-10-11 13:43:51.136488 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4537> 2012-10-11 13:43:51.136490 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4536> 2012-10-11 13:43:51.136491 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4205 0x301d990 -4535> 2012-10-11 13:43:51.136541 7f440532f700 5 journal submit_entry seq 4205 len 205 (0x320bfc0) -4534> 2012-10-11 13:43:51.136544 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4533> 2012-10-11 13:43:51.136545 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4532> 2012-10-11 13:43:51.136596 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1689, time: 2012-10-11 13:43:51.136596, event: done, request: osd pg remove(epoch 7; pg2.31; ) v1 -4531> 2012-10-11 13:43:51.136619 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 101491) -4530> 2012-10-11 13:43:51.136623 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 662 ==== pg_query(0.1f epoch 8) v2 ==== 109+0+0 (3793483550 0 0) 0x33d2e00 con 0x2fe2280 -4529> 2012-10-11 13:43:51.136633 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1690, time: 2012-10-11 13:43:50.316141, event: header_read, request: pg_query(0.1f epoch 8) v2 -4528> 2012-10-11 13:43:51.136638 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1690, time: 2012-10-11 13:43:50.316149, event: throttled, request: pg_query(0.1f epoch 8) v2 -4527> 2012-10-11 13:43:51.136643 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1690, time: 2012-10-11 13:43:50.316170, event: all_read, request: pg_query(0.1f epoch 8) v2 -4526> 2012-10-11 13:43:51.136648 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1690, time: 2012-10-11 13:43:51.136632, event: dispatched, request: pg_query(0.1f epoch 8) v2 -4525> 2012-10-11 13:43:51.136652 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1690, time: 2012-10-11 13:43:51.136652, event: waiting_for_osdmap, request: pg_query(0.1f epoch 8) v2 -4524> 2012-10-11 13:43:51.136668 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1690, time: 2012-10-11 13:43:51.136668, event: started, request: pg_query(0.1f epoch 8) v2 -4523> 2012-10-11 13:43:51.136678 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1690, time: 2012-10-11 13:43:51.136678, event: done, request: pg_query(0.1f epoch 8) v2 -4522> 2012-10-11 13:43:51.136686 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 101382) -4521> 2012-10-11 13:43:51.136690 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1007 ==== osd pg remove(epoch 7; pg2.36; ) v1 ==== 25+0+0 (4095680090 0 0) 0x2d6ea80 con 0x2fe2140 -4520> 2012-10-11 13:43:51.136699 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1691, time: 2012-10-11 13:43:49.483363, event: header_read, request: osd pg remove(epoch 7; pg2.36; ) v1 -4519> 2012-10-11 13:43:51.136704 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1691, time: 2012-10-11 13:43:49.483365, event: throttled, request: osd pg remove(epoch 7; pg2.36; ) v1 -4518> 2012-10-11 13:43:51.136708 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1691, time: 2012-10-11 13:43:49.483369, event: all_read, request: osd pg remove(epoch 7; pg2.36; ) v1 -4517> 2012-10-11 13:43:51.136713 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1691, time: 2012-10-11 13:43:51.136698, event: dispatched, request: osd pg remove(epoch 7; pg2.36; ) v1 -4516> 2012-10-11 13:43:51.136717 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1691, time: 2012-10-11 13:43:51.136717, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.36; ) v1 -4515> 2012-10-11 13:43:51.136724 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1691, time: 2012-10-11 13:43:51.136723, event: started, request: osd pg remove(epoch 7; pg2.36; ) v1 -4514> 2012-10-11 13:43:51.136729 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.36 -4513> 2012-10-11 13:43:51.136742 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.36 0x31766d0)/0x31766d0 -4512> 2012-10-11 13:43:51.136746 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 303689 > 104857600 -4511> 2012-10-11 13:43:51.168951 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (101382 -> 101853) -4510> 2012-10-11 13:43:51.169015 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (101853 -> 102324) -4509> 2012-10-11 13:43:51.169039 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (102324 -> 102795) -4508> 2012-10-11 13:43:51.169062 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (102795 -> 103266) -4507> 2012-10-11 13:43:51.169084 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (103266 -> 103737) -4506> 2012-10-11 13:43:51.169106 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (103737 -> 104208) -4505> 2012-10-11 13:43:51.169128 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (104208 -> 104679) -4504> 2012-10-11 13:43:51.169150 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (104679 -> 105150) -4503> 2012-10-11 13:43:51.169173 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (105150 -> 105621) -4502> 2012-10-11 13:43:51.169196 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (105621 -> 106092) -4501> 2012-10-11 13:43:51.169218 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (106092 -> 106563) -4500> 2012-10-11 13:43:51.169243 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (106563 -> 107034) -4499> 2012-10-11 13:43:51.169285 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (107034 -> 107505) -4498> 2012-10-11 13:43:51.169308 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (107505 -> 107976) -4497> 2012-10-11 13:43:51.169329 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (107976 -> 108447) -4496> 2012-10-11 13:43:51.169351 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (108447 -> 108918) -4495> 2012-10-11 13:43:51.169374 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (108918 -> 109389) -4494> 2012-10-11 13:43:51.170228 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (109389 -> 109860) -4493> 2012-10-11 13:43:51.170290 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (109860 -> 110331) -4492> 2012-10-11 13:43:51.170319 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (110331 -> 110802) -4491> 2012-10-11 13:43:51.170347 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (110802 -> 111273) -4490> 2012-10-11 13:43:51.170373 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (111273 -> 111744) -4489> 2012-10-11 13:43:51.170398 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (111744 -> 112215) -4488> 2012-10-11 13:43:51.170423 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (112215 -> 112686) -4487> 2012-10-11 13:43:51.170450 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (112686 -> 113157) -4486> 2012-10-11 13:43:51.170475 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (113157 -> 113628) -4485> 2012-10-11 13:43:51.170499 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (113628 -> 114099) -4484> 2012-10-11 13:43:51.170524 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (114099 -> 114570) -4483> 2012-10-11 13:43:51.170552 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (114570 -> 115041) -4482> 2012-10-11 13:43:51.170577 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (115041 -> 115512) -4481> 2012-10-11 13:43:51.170602 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (115512 -> 115983) -4480> 2012-10-11 13:43:51.170629 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (115983 -> 116454) -4479> 2012-10-11 13:43:51.170654 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (116454 -> 116925) -4478> 2012-10-11 13:43:51.170929 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (116925 -> 117396) -4477> 2012-10-11 13:43:51.170966 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (117396 -> 117867) -4476> 2012-10-11 13:43:51.170992 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (117867 -> 118338) -4475> 2012-10-11 13:43:51.171017 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (118338 -> 118809) -4474> 2012-10-11 13:43:51.171057 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (118809 -> 119280) -4473> 2012-10-11 13:43:51.171085 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (119280 -> 119751) -4472> 2012-10-11 13:43:51.193916 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955dc0 seq 3708 osr(2.e9 0x2468b40)/0x2468b40 start -4471> 2012-10-11 13:43:51.194201 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2955d70 seq 3709 osr(0.e7 0x2468c50)/0x2468c50 start -4470> 2012-10-11 13:43:51.194333 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4469> 2012-10-11 13:43:51.194340 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4468> 2012-10-11 13:43:51.194342 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4206 0x301dc60 -4467> 2012-10-11 13:43:51.194348 7f440532f700 5 journal submit_entry seq 4206 len 205 (0x320be10) -4466> 2012-10-11 13:43:51.194352 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4465> 2012-10-11 13:43:51.194355 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4464> 2012-10-11 13:43:51.194421 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1691, time: 2012-10-11 13:43:51.194421, event: done, request: osd pg remove(epoch 7; pg2.36; ) v1 -4463> 2012-10-11 13:43:51.194443 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 119726) -4462> 2012-10-11 13:43:51.194448 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 663 ==== pg_query(1.1e epoch 8) v2 ==== 109+0+0 (563181098 0 0) 0x33d2c40 con 0x2fe2280 -4461> 2012-10-11 13:43:51.194460 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1692, time: 2012-10-11 13:43:50.317525, event: header_read, request: pg_query(1.1e epoch 8) v2 -4460> 2012-10-11 13:43:51.194466 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1692, time: 2012-10-11 13:43:50.317535, event: throttled, request: pg_query(1.1e epoch 8) v2 -4459> 2012-10-11 13:43:51.194471 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1692, time: 2012-10-11 13:43:50.317542, event: all_read, request: pg_query(1.1e epoch 8) v2 -4458> 2012-10-11 13:43:51.194476 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1692, time: 2012-10-11 13:43:51.194459, event: dispatched, request: pg_query(1.1e epoch 8) v2 -4457> 2012-10-11 13:43:51.194482 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1692, time: 2012-10-11 13:43:51.194482, event: waiting_for_osdmap, request: pg_query(1.1e epoch 8) v2 -4456> 2012-10-11 13:43:51.194491 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1692, time: 2012-10-11 13:43:51.194491, event: started, request: pg_query(1.1e epoch 8) v2 -4455> 2012-10-11 13:43:51.194507 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1692, time: 2012-10-11 13:43:51.194507, event: done, request: pg_query(1.1e epoch 8) v2 -4454> 2012-10-11 13:43:51.194515 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 119617) -4453> 2012-10-11 13:43:51.194519 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1008 ==== osd pg remove(epoch 7; pg2.3a; ) v1 ==== 25+0+0 (2537134317 0 0) 0x2d6e8c0 con 0x2fe2140 -4452> 2012-10-11 13:43:51.194527 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1693, time: 2012-10-11 13:43:49.483371, event: header_read, request: osd pg remove(epoch 7; pg2.3a; ) v1 -4451> 2012-10-11 13:43:51.194533 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1693, time: 2012-10-11 13:43:49.483374, event: throttled, request: osd pg remove(epoch 7; pg2.3a; ) v1 -4450> 2012-10-11 13:43:51.194538 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1693, time: 2012-10-11 13:43:49.483377, event: all_read, request: osd pg remove(epoch 7; pg2.3a; ) v1 -4449> 2012-10-11 13:43:51.194543 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1693, time: 2012-10-11 13:43:51.194526, event: dispatched, request: osd pg remove(epoch 7; pg2.3a; ) v1 -4448> 2012-10-11 13:43:51.194549 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1693, time: 2012-10-11 13:43:51.194548, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.3a; ) v1 -4447> 2012-10-11 13:43:51.194555 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1693, time: 2012-10-11 13:43:51.194555, event: started, request: osd pg remove(epoch 7; pg2.3a; ) v1 -4446> 2012-10-11 13:43:51.194560 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.3a -4445> 2012-10-11 13:43:51.194582 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.3a 0x1d71db0)/0x1d71db0 -4444> 2012-10-11 13:43:51.194586 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4443> 2012-10-11 13:43:51.194588 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4442> 2012-10-11 13:43:51.194591 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4207 0x301d900 -4441> 2012-10-11 13:43:51.194594 7f440532f700 5 journal submit_entry seq 4207 len 205 (0x3235ba0) -4440> 2012-10-11 13:43:51.194596 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4439> 2012-10-11 13:43:51.194598 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4438> 2012-10-11 13:43:51.194619 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1693, time: 2012-10-11 13:43:51.194618, event: done, request: osd pg remove(epoch 7; pg2.3a; ) v1 -4437> 2012-10-11 13:43:51.194629 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 119592) -4436> 2012-10-11 13:43:51.194633 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 664 ==== pg_query(0.1d epoch 8) v2 ==== 109+0+0 (3962596280 0 0) 0x33d2a80 con 0x2fe2280 -4435> 2012-10-11 13:43:51.194643 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1694, time: 2012-10-11 13:43:50.318300, event: header_read, request: pg_query(0.1d epoch 8) v2 -4434> 2012-10-11 13:43:51.194648 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1694, time: 2012-10-11 13:43:50.318312, event: throttled, request: pg_query(0.1d epoch 8) v2 -4433> 2012-10-11 13:43:51.194653 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1694, time: 2012-10-11 13:43:50.318322, event: all_read, request: pg_query(0.1d epoch 8) v2 -4432> 2012-10-11 13:43:51.194658 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1694, time: 2012-10-11 13:43:51.194642, event: dispatched, request: pg_query(0.1d epoch 8) v2 -4431> 2012-10-11 13:43:51.194663 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1694, time: 2012-10-11 13:43:51.194663, event: waiting_for_osdmap, request: pg_query(0.1d epoch 8) v2 -4430> 2012-10-11 13:43:51.194669 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1694, time: 2012-10-11 13:43:51.194669, event: started, request: pg_query(0.1d epoch 8) v2 -4429> 2012-10-11 13:43:51.194679 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1694, time: 2012-10-11 13:43:51.194679, event: done, request: pg_query(0.1d epoch 8) v2 -4428> 2012-10-11 13:43:51.194686 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 119483) -4427> 2012-10-11 13:43:51.194690 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1009 ==== osd pg remove(epoch 7; pg2.3e; ) v1 ==== 25+0+0 (3055819392 0 0) 0x2d6e700 con 0x2fe2140 -4426> 2012-10-11 13:43:51.194698 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1695, time: 2012-10-11 13:43:49.483379, event: header_read, request: osd pg remove(epoch 7; pg2.3e; ) v1 -4425> 2012-10-11 13:43:51.194704 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1695, time: 2012-10-11 13:43:49.483381, event: throttled, request: osd pg remove(epoch 7; pg2.3e; ) v1 -4424> 2012-10-11 13:43:51.194708 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1695, time: 2012-10-11 13:43:49.483385, event: all_read, request: osd pg remove(epoch 7; pg2.3e; ) v1 -4423> 2012-10-11 13:43:51.194713 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1695, time: 2012-10-11 13:43:51.194697, event: dispatched, request: osd pg remove(epoch 7; pg2.3e; ) v1 -4422> 2012-10-11 13:43:51.194719 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1695, time: 2012-10-11 13:43:51.194719, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.3e; ) v1 -4421> 2012-10-11 13:43:51.194725 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1695, time: 2012-10-11 13:43:51.194725, event: started, request: osd pg remove(epoch 7; pg2.3e; ) v1 -4420> 2012-10-11 13:43:51.194730 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.3e -4419> 2012-10-11 13:43:51.194743 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.3e 0x1d71c50)/0x1d71c50 -4418> 2012-10-11 13:43:51.194747 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 302247 > 104857600 -4417> 2012-10-11 13:43:51.194802 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955d20 seq 3710 osr(1.e6 0x2e38c80)/0x2e38c80 start -4416> 2012-10-11 13:43:51.195185 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4415> 2012-10-11 13:43:51.195194 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4414> 2012-10-11 13:43:51.195195 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4208 0x301d750 -4413> 2012-10-11 13:43:51.195199 7f440532f700 5 journal submit_entry seq 4208 len 205 (0x3235ed0) -4412> 2012-10-11 13:43:51.195201 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4411> 2012-10-11 13:43:51.195205 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4410> 2012-10-11 13:43:51.195230 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1695, time: 2012-10-11 13:43:51.195230, event: done, request: osd pg remove(epoch 7; pg2.3e; ) v1 -4409> 2012-10-11 13:43:51.195243 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 119458) -4408> 2012-10-11 13:43:51.195248 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 665 ==== pg_query(0.1c epoch 8) v2 ==== 109+0+0 (3945113067 0 0) 0x33d28c0 con 0x2fe2280 -4407> 2012-10-11 13:43:51.195258 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1696, time: 2012-10-11 13:43:50.318329, event: header_read, request: pg_query(0.1c epoch 8) v2 -4406> 2012-10-11 13:43:51.195264 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1696, time: 2012-10-11 13:43:50.318335, event: throttled, request: pg_query(0.1c epoch 8) v2 -4405> 2012-10-11 13:43:51.195269 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1696, time: 2012-10-11 13:43:50.318341, event: all_read, request: pg_query(0.1c epoch 8) v2 -4404> 2012-10-11 13:43:51.195273 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1696, time: 2012-10-11 13:43:51.195257, event: dispatched, request: pg_query(0.1c epoch 8) v2 -4403> 2012-10-11 13:43:51.195278 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1696, time: 2012-10-11 13:43:51.195278, event: waiting_for_osdmap, request: pg_query(0.1c epoch 8) v2 -4402> 2012-10-11 13:43:51.195285 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1696, time: 2012-10-11 13:43:51.195284, event: started, request: pg_query(0.1c epoch 8) v2 -4401> 2012-10-11 13:43:51.195296 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1696, time: 2012-10-11 13:43:51.195296, event: done, request: pg_query(0.1c epoch 8) v2 -4400> 2012-10-11 13:43:51.195304 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 119349) -4399> 2012-10-11 13:43:51.195308 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1010 ==== osd pg remove(epoch 7; pg2.56; ) v1 ==== 25+0+0 (3810504945 0 0) 0x2d6e540 con 0x2fe2140 -4398> 2012-10-11 13:43:51.195316 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1697, time: 2012-10-11 13:43:49.483387, event: header_read, request: osd pg remove(epoch 7; pg2.56; ) v1 -4397> 2012-10-11 13:43:51.195322 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1697, time: 2012-10-11 13:43:49.483389, event: throttled, request: osd pg remove(epoch 7; pg2.56; ) v1 -4396> 2012-10-11 13:43:51.195327 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1697, time: 2012-10-11 13:43:49.483393, event: all_read, request: osd pg remove(epoch 7; pg2.56; ) v1 -4395> 2012-10-11 13:43:51.195331 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1697, time: 2012-10-11 13:43:51.195315, event: dispatched, request: osd pg remove(epoch 7; pg2.56; ) v1 -4394> 2012-10-11 13:43:51.195337 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1697, time: 2012-10-11 13:43:51.195337, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.56; ) v1 -4393> 2012-10-11 13:43:51.195343 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1697, time: 2012-10-11 13:43:51.195343, event: started, request: osd pg remove(epoch 7; pg2.56; ) v1 -4392> 2012-10-11 13:43:51.195348 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.56 -4391> 2012-10-11 13:43:51.195362 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.56 0x31768b0)/0x31768b0 -4390> 2012-10-11 13:43:51.195366 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 301526 > 104857600 -4389> 2012-10-11 13:43:51.195886 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x27a7280 seq 3711 osr(0.ae 0x2468300)/0x2468300 start -4388> 2012-10-11 13:43:51.196183 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2955fa0 seq 3712 osr(2.e5 0x2468a20)/0x2468a20 start -4387> 2012-10-11 13:43:51.196313 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4386> 2012-10-11 13:43:51.196319 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4385> 2012-10-11 13:43:51.196321 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4209 0x301df30 -4384> 2012-10-11 13:43:51.196326 7f440532f700 5 journal submit_entry seq 4209 len 205 (0x325b210) -4383> 2012-10-11 13:43:51.196329 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4382> 2012-10-11 13:43:51.196330 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4381> 2012-10-11 13:43:51.196357 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1697, time: 2012-10-11 13:43:51.196356, event: done, request: osd pg remove(epoch 7; pg2.56; ) v1 -4380> 2012-10-11 13:43:51.196369 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 119324) -4379> 2012-10-11 13:43:51.196373 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 666 ==== pg_query(2.18 epoch 8) v2 ==== 109+0+0 (2074113176 0 0) 0x33d2700 con 0x2fe2280 -4378> 2012-10-11 13:43:51.196384 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1698, time: 2012-10-11 13:43:50.318346, event: header_read, request: pg_query(2.18 epoch 8) v2 -4377> 2012-10-11 13:43:51.196389 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1698, time: 2012-10-11 13:43:50.318349, event: throttled, request: pg_query(2.18 epoch 8) v2 -4376> 2012-10-11 13:43:51.196393 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1698, time: 2012-10-11 13:43:50.318369, event: all_read, request: pg_query(2.18 epoch 8) v2 -4375> 2012-10-11 13:43:51.196401 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1698, time: 2012-10-11 13:43:51.196383, event: dispatched, request: pg_query(2.18 epoch 8) v2 -4374> 2012-10-11 13:43:51.196407 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1698, time: 2012-10-11 13:43:51.196407, event: waiting_for_osdmap, request: pg_query(2.18 epoch 8) v2 -4373> 2012-10-11 13:43:51.196413 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1698, time: 2012-10-11 13:43:51.196413, event: started, request: pg_query(2.18 epoch 8) v2 -4372> 2012-10-11 13:43:51.196425 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1698, time: 2012-10-11 13:43:51.196425, event: done, request: pg_query(2.18 epoch 8) v2 -4371> 2012-10-11 13:43:51.196432 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 119215) -4370> 2012-10-11 13:43:51.196436 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1011 ==== osd pg remove(epoch 7; pg2.5a; ) v1 ==== 25+0+0 (2151233094 0 0) 0x2d6e380 con 0x2fe2140 -4369> 2012-10-11 13:43:51.196444 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1699, time: 2012-10-11 13:43:49.483396, event: header_read, request: osd pg remove(epoch 7; pg2.5a; ) v1 -4368> 2012-10-11 13:43:51.196449 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1699, time: 2012-10-11 13:43:49.483398, event: throttled, request: osd pg remove(epoch 7; pg2.5a; ) v1 -4367> 2012-10-11 13:43:51.196454 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1699, time: 2012-10-11 13:43:49.483401, event: all_read, request: osd pg remove(epoch 7; pg2.5a; ) v1 -4366> 2012-10-11 13:43:51.196459 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1699, time: 2012-10-11 13:43:51.196443, event: dispatched, request: osd pg remove(epoch 7; pg2.5a; ) v1 -4365> 2012-10-11 13:43:51.196464 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1699, time: 2012-10-11 13:43:51.196464, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.5a; ) v1 -4364> 2012-10-11 13:43:51.196470 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1699, time: 2012-10-11 13:43:51.196470, event: started, request: osd pg remove(epoch 7; pg2.5a; ) v1 -4363> 2012-10-11 13:43:51.196478 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.5a -4362> 2012-10-11 13:43:51.196492 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.5a 0x21301c0)/0x21301c0 -4361> 2012-10-11 13:43:51.196496 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4360> 2012-10-11 13:43:51.196498 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4359> 2012-10-11 13:43:51.196499 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4210 0x301d6c0 -4358> 2012-10-11 13:43:51.196503 7f440532f700 5 journal submit_entry seq 4210 len 205 (0x21cff60) -4357> 2012-10-11 13:43:51.196504 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4356> 2012-10-11 13:43:51.196507 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4355> 2012-10-11 13:43:51.196527 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1699, time: 2012-10-11 13:43:51.196527, event: done, request: osd pg remove(epoch 7; pg2.5a; ) v1 -4354> 2012-10-11 13:43:51.196538 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 119190) -4353> 2012-10-11 13:43:51.196542 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 667 ==== pg_query(0.1a epoch 8) v2 ==== 109+0+0 (4183359489 0 0) 0x33d2540 con 0x2fe2280 -4352> 2012-10-11 13:43:51.196552 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1700, time: 2012-10-11 13:43:50.318406, event: header_read, request: pg_query(0.1a epoch 8) v2 -4351> 2012-10-11 13:43:51.196557 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1700, time: 2012-10-11 13:43:50.318417, event: throttled, request: pg_query(0.1a epoch 8) v2 -4350> 2012-10-11 13:43:51.196562 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1700, time: 2012-10-11 13:43:50.318426, event: all_read, request: pg_query(0.1a epoch 8) v2 -4349> 2012-10-11 13:43:51.196567 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1700, time: 2012-10-11 13:43:51.196551, event: dispatched, request: pg_query(0.1a epoch 8) v2 -4348> 2012-10-11 13:43:51.196571 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1700, time: 2012-10-11 13:43:51.196571, event: waiting_for_osdmap, request: pg_query(0.1a epoch 8) v2 -4347> 2012-10-11 13:43:51.196578 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1700, time: 2012-10-11 13:43:51.196578, event: started, request: pg_query(0.1a epoch 8) v2 -4346> 2012-10-11 13:43:51.196588 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1700, time: 2012-10-11 13:43:51.196588, event: done, request: pg_query(0.1a epoch 8) v2 -4345> 2012-10-11 13:43:51.196596 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 119081) -4344> 2012-10-11 13:43:51.196598 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1012 ==== osd pg remove(epoch 7; pg2.62; ) v1 ==== 25+0+0 (1265917617 0 0) 0x2d6e1c0 con 0x2fe2140 -4343> 2012-10-11 13:43:51.196607 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1701, time: 2012-10-11 13:43:49.483403, event: header_read, request: osd pg remove(epoch 7; pg2.62; ) v1 -4342> 2012-10-11 13:43:51.196612 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1701, time: 2012-10-11 13:43:49.483405, event: throttled, request: osd pg remove(epoch 7; pg2.62; ) v1 -4341> 2012-10-11 13:43:51.196617 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1701, time: 2012-10-11 13:43:49.483409, event: all_read, request: osd pg remove(epoch 7; pg2.62; ) v1 -4340> 2012-10-11 13:43:51.196622 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1701, time: 2012-10-11 13:43:51.196604, event: dispatched, request: osd pg remove(epoch 7; pg2.62; ) v1 -4339> 2012-10-11 13:43:51.196627 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1701, time: 2012-10-11 13:43:51.196626, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.62; ) v1 -4338> 2012-10-11 13:43:51.196632 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1701, time: 2012-10-11 13:43:51.196632, event: started, request: osd pg remove(epoch 7; pg2.62; ) v1 -4337> 2012-10-11 13:43:51.196637 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.62 -4336> 2012-10-11 13:43:51.196650 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.62 0x3176930)/0x3176930 -4335> 2012-10-11 13:43:51.196654 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 300084 > 104857600 -4334> 2012-10-11 13:43:51.196791 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x27a7230 seq 3713 osr(2.ac 0x3176e70)/0x3176e70 start -4333> 2012-10-11 13:43:51.197136 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4332> 2012-10-11 13:43:51.197142 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4331> 2012-10-11 13:43:51.197143 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4211 0x301de10 -4330> 2012-10-11 13:43:51.197147 7f440532f700 5 journal submit_entry seq 4211 len 205 (0x2442450) -4329> 2012-10-11 13:43:51.197149 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4328> 2012-10-11 13:43:51.197151 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4327> 2012-10-11 13:43:51.197181 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1701, time: 2012-10-11 13:43:51.197181, event: done, request: osd pg remove(epoch 7; pg2.62; ) v1 -4326> 2012-10-11 13:43:51.197192 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 119056) -4325> 2012-10-11 13:43:51.197195 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 668 ==== pg_query(1.1b epoch 8) v2 ==== 109+0+0 (986939701 0 0) 0x33d2380 con 0x2fe2280 -4324> 2012-10-11 13:43:51.197204 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1702, time: 2012-10-11 13:43:50.318546, event: header_read, request: pg_query(1.1b epoch 8) v2 -4323> 2012-10-11 13:43:51.197208 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1702, time: 2012-10-11 13:43:50.318557, event: throttled, request: pg_query(1.1b epoch 8) v2 -4322> 2012-10-11 13:43:51.197211 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1702, time: 2012-10-11 13:43:50.318580, event: all_read, request: pg_query(1.1b epoch 8) v2 -4321> 2012-10-11 13:43:51.197215 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1702, time: 2012-10-11 13:43:51.197203, event: dispatched, request: pg_query(1.1b epoch 8) v2 -4320> 2012-10-11 13:43:51.197219 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1702, time: 2012-10-11 13:43:51.197219, event: waiting_for_osdmap, request: pg_query(1.1b epoch 8) v2 -4319> 2012-10-11 13:43:51.197224 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1702, time: 2012-10-11 13:43:51.197224, event: started, request: pg_query(1.1b epoch 8) v2 -4318> 2012-10-11 13:43:51.197233 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1702, time: 2012-10-11 13:43:51.197233, event: done, request: pg_query(1.1b epoch 8) v2 -4317> 2012-10-11 13:43:51.197239 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 118947) -4316> 2012-10-11 13:43:51.197241 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1013 ==== osd pg remove(epoch 7; pg2.63; ) v1 ==== 25+0+0 (38282134 0 0) 0x2d6e000 con 0x2fe2140 -4315> 2012-10-11 13:43:51.198861 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1703, time: 2012-10-11 13:43:49.483412, event: header_read, request: osd pg remove(epoch 7; pg2.63; ) v1 -4314> 2012-10-11 13:43:51.198871 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1703, time: 2012-10-11 13:43:49.483414, event: throttled, request: osd pg remove(epoch 7; pg2.63; ) v1 -4313> 2012-10-11 13:43:51.198876 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1703, time: 2012-10-11 13:43:49.483417, event: all_read, request: osd pg remove(epoch 7; pg2.63; ) v1 -4312> 2012-10-11 13:43:51.198880 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1703, time: 2012-10-11 13:43:51.198859, event: dispatched, request: osd pg remove(epoch 7; pg2.63; ) v1 -4311> 2012-10-11 13:43:51.198885 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1703, time: 2012-10-11 13:43:51.198885, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.63; ) v1 -4310> 2012-10-11 13:43:51.198892 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1703, time: 2012-10-11 13:43:51.198892, event: started, request: osd pg remove(epoch 7; pg2.63; ) v1 -4309> 2012-10-11 13:43:51.198897 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.63 -4308> 2012-10-11 13:43:51.198915 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.63 0x2130520)/0x2130520 -4307> 2012-10-11 13:43:51.198919 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 299363 > 104857600 -4306> 2012-10-11 13:43:51.214300 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955f50 seq 3714 osr(0.d6 0x2468b80)/0x2468b80 start -4305> 2012-10-11 13:43:51.214324 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4304> 2012-10-11 13:43:51.214340 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4303> 2012-10-11 13:43:51.214347 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4212 0x301d870 -4302> 2012-10-11 13:43:51.214361 7f440532f700 5 journal submit_entry seq 4212 len 205 (0x2238510) -4301> 2012-10-11 13:43:51.214369 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4300> 2012-10-11 13:43:51.214378 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4299> 2012-10-11 13:43:51.214446 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1703, time: 2012-10-11 13:43:51.214446, event: done, request: osd pg remove(epoch 7; pg2.63; ) v1 -4298> 2012-10-11 13:43:51.214473 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 118922) -4297> 2012-10-11 13:43:51.214484 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 669 ==== pg_query(2.1a epoch 8) v2 ==== 109+0+0 (1972103230 0 0) 0x33d21c0 con 0x2fe2280 -4296> 2012-10-11 13:43:51.214504 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1704, time: 2012-10-11 13:43:50.318673, event: header_read, request: pg_query(2.1a epoch 8) v2 -4295> 2012-10-11 13:43:51.214515 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1704, time: 2012-10-11 13:43:50.318681, event: throttled, request: pg_query(2.1a epoch 8) v2 -4294> 2012-10-11 13:43:51.214528 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1704, time: 2012-10-11 13:43:50.318688, event: all_read, request: pg_query(2.1a epoch 8) v2 -4293> 2012-10-11 13:43:51.214539 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1704, time: 2012-10-11 13:43:51.214502, event: dispatched, request: pg_query(2.1a epoch 8) v2 -4292> 2012-10-11 13:43:51.214549 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1704, time: 2012-10-11 13:43:51.214549, event: waiting_for_osdmap, request: pg_query(2.1a epoch 8) v2 -4291> 2012-10-11 13:43:51.214564 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1704, time: 2012-10-11 13:43:51.214564, event: started, request: pg_query(2.1a epoch 8) v2 -4290> 2012-10-11 13:43:51.214584 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1704, time: 2012-10-11 13:43:51.214584, event: done, request: pg_query(2.1a epoch 8) v2 -4289> 2012-10-11 13:43:51.214598 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 118813) -4288> 2012-10-11 13:43:51.214607 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1014 ==== osd pg remove(epoch 7; pg2.69; ) v1 ==== 25+0+0 (3523992834 0 0) 0x2936e00 con 0x2fe2140 -4287> 2012-10-11 13:43:51.214622 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1705, time: 2012-10-11 13:43:49.483419, event: header_read, request: osd pg remove(epoch 7; pg2.69; ) v1 -4286> 2012-10-11 13:43:51.214633 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1705, time: 2012-10-11 13:43:49.483421, event: throttled, request: osd pg remove(epoch 7; pg2.69; ) v1 -4285> 2012-10-11 13:43:51.214643 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1705, time: 2012-10-11 13:43:49.483427, event: all_read, request: osd pg remove(epoch 7; pg2.69; ) v1 -4284> 2012-10-11 13:43:51.214654 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1705, time: 2012-10-11 13:43:51.214621, event: dispatched, request: osd pg remove(epoch 7; pg2.69; ) v1 -4283> 2012-10-11 13:43:51.214664 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1705, time: 2012-10-11 13:43:51.214664, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.69; ) v1 -4282> 2012-10-11 13:43:51.214676 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1705, time: 2012-10-11 13:43:51.214676, event: started, request: osd pg remove(epoch 7; pg2.69; ) v1 -4281> 2012-10-11 13:43:51.214689 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.69 -4280> 2012-10-11 13:43:51.214716 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.69 0x3176a90)/0x3176a90 -4279> 2012-10-11 13:43:51.214726 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 298642 > 104857600 -4278> 2012-10-11 13:43:51.215556 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4277> 2012-10-11 13:43:51.215570 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4276> 2012-10-11 13:43:51.215577 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4213 0x301da20 -4275> 2012-10-11 13:43:51.215587 7f440532f700 5 journal submit_entry seq 4213 len 205 (0x2238360) -4274> 2012-10-11 13:43:51.215595 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4273> 2012-10-11 13:43:51.215603 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4272> 2012-10-11 13:43:51.215635 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1705, time: 2012-10-11 13:43:51.215634, event: done, request: osd pg remove(epoch 7; pg2.69; ) v1 -4271> 2012-10-11 13:43:51.215654 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 118788) -4270> 2012-10-11 13:43:51.215663 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 670 ==== pg_query(1.19 epoch 8) v2 ==== 109+0+0 (888675731 0 0) 0x33d2000 con 0x2fe2280 -4269> 2012-10-11 13:43:51.215680 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1706, time: 2012-10-11 13:43:50.318815, event: header_read, request: pg_query(1.19 epoch 8) v2 -4268> 2012-10-11 13:43:51.215691 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1706, time: 2012-10-11 13:43:50.318837, event: throttled, request: pg_query(1.19 epoch 8) v2 -4267> 2012-10-11 13:43:51.215701 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1706, time: 2012-10-11 13:43:50.318865, event: all_read, request: pg_query(1.19 epoch 8) v2 -4266> 2012-10-11 13:43:51.215711 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1706, time: 2012-10-11 13:43:51.215679, event: dispatched, request: pg_query(1.19 epoch 8) v2 -4265> 2012-10-11 13:43:51.215721 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1706, time: 2012-10-11 13:43:51.215721, event: waiting_for_osdmap, request: pg_query(1.19 epoch 8) v2 -4264> 2012-10-11 13:43:51.215733 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1706, time: 2012-10-11 13:43:51.215733, event: started, request: pg_query(1.19 epoch 8) v2 -4263> 2012-10-11 13:43:51.215750 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1706, time: 2012-10-11 13:43:51.215750, event: done, request: pg_query(1.19 epoch 8) v2 -4262> 2012-10-11 13:43:51.215764 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 118679) -4261> 2012-10-11 13:43:51.215772 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1015 ==== osd pg remove(epoch 7; pg2.6a; ) v1 ==== 25+0+0 (156195435 0 0) 0x2936c40 con 0x2fe2140 -4260> 2012-10-11 13:43:51.215786 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1707, time: 2012-10-11 13:43:49.483429, event: header_read, request: osd pg remove(epoch 7; pg2.6a; ) v1 -4259> 2012-10-11 13:43:51.215797 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1707, time: 2012-10-11 13:43:49.483431, event: throttled, request: osd pg remove(epoch 7; pg2.6a; ) v1 -4258> 2012-10-11 13:43:51.215807 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1707, time: 2012-10-11 13:43:49.483435, event: all_read, request: osd pg remove(epoch 7; pg2.6a; ) v1 -4257> 2012-10-11 13:43:51.215819 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1707, time: 2012-10-11 13:43:51.215785, event: dispatched, request: osd pg remove(epoch 7; pg2.6a; ) v1 -4256> 2012-10-11 13:43:51.215829 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1707, time: 2012-10-11 13:43:51.215829, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.6a; ) v1 -4255> 2012-10-11 13:43:51.215841 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1707, time: 2012-10-11 13:43:51.215840, event: started, request: osd pg remove(epoch 7; pg2.6a; ) v1 -4254> 2012-10-11 13:43:51.215851 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.6a -4253> 2012-10-11 13:43:51.215871 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.6a 0x3176a60)/0x3176a60 -4252> 2012-10-11 13:43:51.215869 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2955eb0 seq 3716 osr(1.d5 0x2e38bb0)/0x2e38bb0 start -4251> 2012-10-11 13:43:51.215882 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4250> 2012-10-11 13:43:51.215889 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4249> 2012-10-11 13:43:51.215897 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4214 0x301dcf0 -4248> 2012-10-11 13:43:51.215906 7f440532f700 5 journal submit_entry seq 4214 len 205 (0x2238f30) -4247> 2012-10-11 13:43:51.215913 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4246> 2012-10-11 13:43:51.215921 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4245> 2012-10-11 13:43:51.215950 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1707, time: 2012-10-11 13:43:51.215950, event: done, request: osd pg remove(epoch 7; pg2.6a; ) v1 -4244> 2012-10-11 13:43:51.215968 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 118654) -4243> 2012-10-11 13:43:51.215977 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 671 ==== pg_query(0.17 epoch 8) v2 ==== 109+0+0 (3669329286 0 0) 0x256ee00 con 0x2fe2280 -4242> 2012-10-11 13:43:51.215992 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1708, time: 2012-10-11 13:43:50.319092, event: header_read, request: pg_query(0.17 epoch 8) v2 -4241> 2012-10-11 13:43:51.216003 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1708, time: 2012-10-11 13:43:50.319107, event: throttled, request: pg_query(0.17 epoch 8) v2 -4240> 2012-10-11 13:43:51.216013 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1708, time: 2012-10-11 13:43:50.319116, event: all_read, request: pg_query(0.17 epoch 8) v2 -4239> 2012-10-11 13:43:51.216023 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1708, time: 2012-10-11 13:43:51.215991, event: dispatched, request: pg_query(0.17 epoch 8) v2 -4238> 2012-10-11 13:43:51.216033 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1708, time: 2012-10-11 13:43:51.216033, event: waiting_for_osdmap, request: pg_query(0.17 epoch 8) v2 -4237> 2012-10-11 13:43:51.216044 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1708, time: 2012-10-11 13:43:51.216044, event: started, request: pg_query(0.17 epoch 8) v2 -4236> 2012-10-11 13:43:51.216061 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1708, time: 2012-10-11 13:43:51.216061, event: done, request: pg_query(0.17 epoch 8) v2 -4235> 2012-10-11 13:43:51.216075 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 118545) -4234> 2012-10-11 13:43:51.216083 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1016 ==== osd pg remove(epoch 7; pg2.6b; ) v1 ==== 25+0+0 (1081288524 0 0) 0x2936a80 con 0x2fe2140 -4233> 2012-10-11 13:43:51.216097 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1709, time: 2012-10-11 13:43:49.483437, event: header_read, request: osd pg remove(epoch 7; pg2.6b; ) v1 -4232> 2012-10-11 13:43:51.216108 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1709, time: 2012-10-11 13:43:49.483439, event: throttled, request: osd pg remove(epoch 7; pg2.6b; ) v1 -4231> 2012-10-11 13:43:51.216118 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1709, time: 2012-10-11 13:43:49.483442, event: all_read, request: osd pg remove(epoch 7; pg2.6b; ) v1 -4230> 2012-10-11 13:43:51.216129 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1709, time: 2012-10-11 13:43:51.216096, event: dispatched, request: osd pg remove(epoch 7; pg2.6b; ) v1 -4229> 2012-10-11 13:43:51.216139 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1709, time: 2012-10-11 13:43:51.216139, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.6b; ) v1 -4228> 2012-10-11 13:43:51.216150 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1709, time: 2012-10-11 13:43:51.216150, event: started, request: osd pg remove(epoch 7; pg2.6b; ) v1 -4227> 2012-10-11 13:43:51.216161 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.6b -4226> 2012-10-11 13:43:51.216180 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.6b 0x3176a30)/0x3176a30 -4225> 2012-10-11 13:43:51.216189 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 297200 > 104857600 -4224> 2012-10-11 13:43:51.216199 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2955f00 seq 3715 osr(2.d4 0x3176fe0)/0x3176fe0 start -4223> 2012-10-11 13:43:51.216693 7f4408335700 5 filestore(/data/osd.0) _do_op 0x24971e0 seq 3717 osr(0.12 0x1d715c0)/0x1d715c0 start -4222> 2012-10-11 13:43:51.216708 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4221> 2012-10-11 13:43:51.216722 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4220> 2012-10-11 13:43:51.216730 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4215 0x22ff3f0 -4219> 2012-10-11 13:43:51.216741 7f440532f700 5 journal submit_entry seq 4215 len 205 (0x2238d80) -4218> 2012-10-11 13:43:51.216749 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4217> 2012-10-11 13:43:51.216757 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4216> 2012-10-11 13:43:51.216792 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1709, time: 2012-10-11 13:43:51.216792, event: done, request: osd pg remove(epoch 7; pg2.6b; ) v1 -4215> 2012-10-11 13:43:51.216812 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 118520) -4214> 2012-10-11 13:43:51.216823 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 672 ==== pg_query(0.14 epoch 8) v2 ==== 109+0+0 (3549157235 0 0) 0x256ec40 con 0x2fe2280 -4213> 2012-10-11 13:43:51.216840 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1710, time: 2012-10-11 13:43:50.319396, event: header_read, request: pg_query(0.14 epoch 8) v2 -4212> 2012-10-11 13:43:51.216851 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1710, time: 2012-10-11 13:43:50.319410, event: throttled, request: pg_query(0.14 epoch 8) v2 -4211> 2012-10-11 13:43:51.216861 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1710, time: 2012-10-11 13:43:50.319431, event: all_read, request: pg_query(0.14 epoch 8) v2 -4210> 2012-10-11 13:43:51.216872 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1710, time: 2012-10-11 13:43:51.216839, event: dispatched, request: pg_query(0.14 epoch 8) v2 -4209> 2012-10-11 13:43:51.216882 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1710, time: 2012-10-11 13:43:51.216882, event: waiting_for_osdmap, request: pg_query(0.14 epoch 8) v2 -4208> 2012-10-11 13:43:51.216894 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1710, time: 2012-10-11 13:43:51.216894, event: started, request: pg_query(0.14 epoch 8) v2 -4207> 2012-10-11 13:43:51.216912 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1710, time: 2012-10-11 13:43:51.216912, event: done, request: pg_query(0.14 epoch 8) v2 -4206> 2012-10-11 13:43:51.216928 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 118411) -4205> 2012-10-11 13:43:51.216937 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1017 ==== osd pg remove(epoch 7; pg2.6f; ) v1 ==== 25+0+0 (1634641185 0 0) 0x29368c0 con 0x2fe2140 -4204> 2012-10-11 13:43:51.216951 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1711, time: 2012-10-11 13:43:49.483445, event: header_read, request: osd pg remove(epoch 7; pg2.6f; ) v1 -4203> 2012-10-11 13:43:51.216962 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1711, time: 2012-10-11 13:43:49.483447, event: throttled, request: osd pg remove(epoch 7; pg2.6f; ) v1 -4202> 2012-10-11 13:43:51.216972 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1711, time: 2012-10-11 13:43:49.483450, event: all_read, request: osd pg remove(epoch 7; pg2.6f; ) v1 -4201> 2012-10-11 13:43:51.216982 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1711, time: 2012-10-11 13:43:51.216950, event: dispatched, request: osd pg remove(epoch 7; pg2.6f; ) v1 -4200> 2012-10-11 13:43:51.216993 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1711, time: 2012-10-11 13:43:51.216993, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.6f; ) v1 -4199> 2012-10-11 13:43:51.217004 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1711, time: 2012-10-11 13:43:51.217004, event: started, request: osd pg remove(epoch 7; pg2.6f; ) v1 -4198> 2012-10-11 13:43:51.217015 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.6f -4197> 2012-10-11 13:43:51.217035 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.6f 0x21306e0)/0x21306e0 -4196> 2012-10-11 13:43:51.217045 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 296479 > 104857600 -4195> 2012-10-11 13:43:51.217589 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2497190 seq 3718 osr(2.10 0x1d71520)/0x1d71520 start -4194> 2012-10-11 13:43:51.217608 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4193> 2012-10-11 13:43:51.217621 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4192> 2012-10-11 13:43:51.217630 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4216 0x22ffd80 -4191> 2012-10-11 13:43:51.217641 7f440532f700 5 journal submit_entry seq 4216 len 205 (0x32e85d0) -4190> 2012-10-11 13:43:51.217649 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4189> 2012-10-11 13:43:51.217657 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4188> 2012-10-11 13:43:51.217689 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1711, time: 2012-10-11 13:43:51.217689, event: done, request: osd pg remove(epoch 7; pg2.6f; ) v1 -4187> 2012-10-11 13:43:51.217710 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 118386) -4186> 2012-10-11 13:43:51.217720 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 673 ==== pg_notify(0.15,0.63,0.66,1.14,1.62,1.65,2.27,2.61,2.64 epoch 8) v4 ==== 4035+0+0 (1829863519 0 0) 0x256ea80 con 0x2fe2280 -4185> 2012-10-11 13:43:51.217740 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1712, time: 2012-10-11 13:43:50.320179, event: header_read, request: pg_notify(0.15,0.63,0.66,1.14,1.62,1.65,2.27,2.61,2.64 epoch 8) v4 -4184> 2012-10-11 13:43:51.217754 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1712, time: 2012-10-11 13:43:50.320196, event: throttled, request: pg_notify(0.15,0.63,0.66,1.14,1.62,1.65,2.27,2.61,2.64 epoch 8) v4 -4183> 2012-10-11 13:43:51.217766 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1712, time: 2012-10-11 13:43:50.320238, event: all_read, request: pg_notify(0.15,0.63,0.66,1.14,1.62,1.65,2.27,2.61,2.64 epoch 8) v4 -4182> 2012-10-11 13:43:51.217779 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1712, time: 2012-10-11 13:43:51.217739, event: dispatched, request: pg_notify(0.15,0.63,0.66,1.14,1.62,1.65,2.27,2.61,2.64 epoch 8) v4 -4181> 2012-10-11 13:43:51.217791 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1712, time: 2012-10-11 13:43:51.217791, event: waiting_for_osdmap, request: pg_notify(0.15,0.63,0.66,1.14,1.62,1.65,2.27,2.61,2.64 epoch 8) v4 -4180> 2012-10-11 13:43:51.217805 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1712, time: 2012-10-11 13:43:51.217805, event: started, request: pg_notify(0.15,0.63,0.66,1.14,1.62,1.65,2.27,2.61,2.64 epoch 8) v4 -4179> 2012-10-11 13:43:51.217872 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1712, time: 2012-10-11 13:43:51.217872, event: done, request: pg_notify(0.15,0.63,0.66,1.14,1.62,1.65,2.27,2.61,2.64 epoch 8) v4 -4178> 2012-10-11 13:43:51.217889 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 4035 (0xb7c748 -> 114351) -4177> 2012-10-11 13:43:51.217901 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1018 ==== osd pg remove(epoch 7; pg2.72; ) v1 ==== 25+0+0 (3473037061 0 0) 0x2936700 con 0x2fe2140 -4176> 2012-10-11 13:43:51.217917 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1713, time: 2012-10-11 13:43:49.483453, event: header_read, request: osd pg remove(epoch 7; pg2.72; ) v1 -4175> 2012-10-11 13:43:51.217928 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1713, time: 2012-10-11 13:43:49.483455, event: throttled, request: osd pg remove(epoch 7; pg2.72; ) v1 -4174> 2012-10-11 13:43:51.217939 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1713, time: 2012-10-11 13:43:49.483458, event: all_read, request: osd pg remove(epoch 7; pg2.72; ) v1 -4173> 2012-10-11 13:43:51.217949 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1713, time: 2012-10-11 13:43:51.217915, event: dispatched, request: osd pg remove(epoch 7; pg2.72; ) v1 -4172> 2012-10-11 13:43:51.217960 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1713, time: 2012-10-11 13:43:51.217960, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.72; ) v1 -4171> 2012-10-11 13:43:51.217971 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1713, time: 2012-10-11 13:43:51.217971, event: started, request: osd pg remove(epoch 7; pg2.72; ) v1 -4170> 2012-10-11 13:43:51.217982 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.72 -4169> 2012-10-11 13:43:51.218003 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.72 0x21304c0)/0x21304c0 -4168> 2012-10-11 13:43:51.218014 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 295758 > 104857600 -4167> 2012-10-11 13:43:51.218484 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2497140 seq 3719 osr(1.10 0x27a14a0)/0x27a14a0 start -4166> 2012-10-11 13:43:51.218502 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4165> 2012-10-11 13:43:51.218514 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4164> 2012-10-11 13:43:51.218522 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4217 0x250e510 -4163> 2012-10-11 13:43:51.218532 7f440532f700 5 journal submit_entry seq 4217 len 205 (0x32e8b10) -4162> 2012-10-11 13:43:51.218541 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4161> 2012-10-11 13:43:51.218548 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4160> 2012-10-11 13:43:51.218580 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1713, time: 2012-10-11 13:43:51.218580, event: done, request: osd pg remove(epoch 7; pg2.72; ) v1 -4159> 2012-10-11 13:43:51.218600 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 114326) -4158> 2012-10-11 13:43:51.218609 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 674 ==== pg_query(2.11 epoch 8) v2 ==== 109+0+0 (1142671443 0 0) 0x256e8c0 con 0x2fe2280 -4157> 2012-10-11 13:43:51.218626 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1714, time: 2012-10-11 13:43:50.321611, event: header_read, request: pg_query(2.11 epoch 8) v2 -4156> 2012-10-11 13:43:51.218637 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1714, time: 2012-10-11 13:43:50.321625, event: throttled, request: pg_query(2.11 epoch 8) v2 -4155> 2012-10-11 13:43:51.218647 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1714, time: 2012-10-11 13:43:50.321643, event: all_read, request: pg_query(2.11 epoch 8) v2 -4154> 2012-10-11 13:43:51.218657 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1714, time: 2012-10-11 13:43:51.218624, event: dispatched, request: pg_query(2.11 epoch 8) v2 -4153> 2012-10-11 13:43:51.218669 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1714, time: 2012-10-11 13:43:51.218668, event: waiting_for_osdmap, request: pg_query(2.11 epoch 8) v2 -4152> 2012-10-11 13:43:51.218680 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1714, time: 2012-10-11 13:43:51.218680, event: started, request: pg_query(2.11 epoch 8) v2 -4151> 2012-10-11 13:43:51.218698 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1714, time: 2012-10-11 13:43:51.218698, event: done, request: pg_query(2.11 epoch 8) v2 -4150> 2012-10-11 13:43:51.218711 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 114217) -4149> 2012-10-11 13:43:51.218720 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1019 ==== osd pg remove(epoch 7; pg2.73; ) v1 ==== 25+0+0 (2252220962 0 0) 0x2936540 con 0x2fe2140 -4148> 2012-10-11 13:43:51.218735 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1715, time: 2012-10-11 13:43:49.483461, event: header_read, request: osd pg remove(epoch 7; pg2.73; ) v1 -4147> 2012-10-11 13:43:51.218746 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1715, time: 2012-10-11 13:43:49.483463, event: throttled, request: osd pg remove(epoch 7; pg2.73; ) v1 -4146> 2012-10-11 13:43:51.218756 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1715, time: 2012-10-11 13:43:49.483466, event: all_read, request: osd pg remove(epoch 7; pg2.73; ) v1 -4145> 2012-10-11 13:43:51.218766 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1715, time: 2012-10-11 13:43:51.218733, event: dispatched, request: osd pg remove(epoch 7; pg2.73; ) v1 -4144> 2012-10-11 13:43:51.218777 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1715, time: 2012-10-11 13:43:51.218777, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.73; ) v1 -4143> 2012-10-11 13:43:51.218789 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1715, time: 2012-10-11 13:43:51.218789, event: started, request: osd pg remove(epoch 7; pg2.73; ) v1 -4142> 2012-10-11 13:43:51.218799 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.73 -4141> 2012-10-11 13:43:51.218820 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.73 0x21304a0)/0x21304a0 -4140> 2012-10-11 13:43:51.218829 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 295037 > 104857600 -4139> 2012-10-11 13:43:51.219340 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x24970f0 seq 3720 osr(0.11 0x1d715f0)/0x1d715f0 start -4138> 2012-10-11 13:43:51.219356 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4137> 2012-10-11 13:43:51.220067 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4136> 2012-10-11 13:43:51.220069 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4218 0x22ffab0 -4135> 2012-10-11 13:43:51.220073 7f440532f700 5 journal submit_entry seq 4218 len 205 (0x32e8600) -4134> 2012-10-11 13:43:51.220075 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4133> 2012-10-11 13:43:51.220077 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4132> 2012-10-11 13:43:51.220103 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1715, time: 2012-10-11 13:43:51.220103, event: done, request: osd pg remove(epoch 7; pg2.73; ) v1 -4131> 2012-10-11 13:43:51.220116 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 114192) -4130> 2012-10-11 13:43:51.220119 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 675 ==== pg_query(0.13 epoch 8) v2 ==== 109+0+0 (3336748234 0 0) 0x256e700 con 0x2fe2280 -4129> 2012-10-11 13:43:51.220128 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1716, time: 2012-10-11 13:43:50.321951, event: header_read, request: pg_query(0.13 epoch 8) v2 -4128> 2012-10-11 13:43:51.220133 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1716, time: 2012-10-11 13:43:50.321967, event: throttled, request: pg_query(0.13 epoch 8) v2 -4127> 2012-10-11 13:43:51.220136 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1716, time: 2012-10-11 13:43:50.321974, event: all_read, request: pg_query(0.13 epoch 8) v2 -4126> 2012-10-11 13:43:51.220139 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1716, time: 2012-10-11 13:43:51.220127, event: dispatched, request: pg_query(0.13 epoch 8) v2 -4125> 2012-10-11 13:43:51.220143 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1716, time: 2012-10-11 13:43:51.220143, event: waiting_for_osdmap, request: pg_query(0.13 epoch 8) v2 -4124> 2012-10-11 13:43:51.220148 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1716, time: 2012-10-11 13:43:51.220148, event: started, request: pg_query(0.13 epoch 8) v2 -4123> 2012-10-11 13:43:51.220158 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1716, time: 2012-10-11 13:43:51.220158, event: done, request: pg_query(0.13 epoch 8) v2 -4122> 2012-10-11 13:43:51.220164 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 114083) -4121> 2012-10-11 13:43:51.220166 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1020 ==== osd pg remove(epoch 7; pg2.75; ) v1 ==== 25+0+0 (895177217 0 0) 0x2936380 con 0x2fe2140 -4120> 2012-10-11 13:43:51.220173 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1717, time: 2012-10-11 13:43:49.483469, event: header_read, request: osd pg remove(epoch 7; pg2.75; ) v1 -4119> 2012-10-11 13:43:51.220177 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1717, time: 2012-10-11 13:43:49.483471, event: throttled, request: osd pg remove(epoch 7; pg2.75; ) v1 -4118> 2012-10-11 13:43:51.220181 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1717, time: 2012-10-11 13:43:49.483505, event: all_read, request: osd pg remove(epoch 7; pg2.75; ) v1 -4117> 2012-10-11 13:43:51.220185 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1717, time: 2012-10-11 13:43:51.220172, event: dispatched, request: osd pg remove(epoch 7; pg2.75; ) v1 -4116> 2012-10-11 13:43:51.220188 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1717, time: 2012-10-11 13:43:51.220188, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.75; ) v1 -4115> 2012-10-11 13:43:51.220193 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1717, time: 2012-10-11 13:43:51.220193, event: started, request: osd pg remove(epoch 7; pg2.75; ) v1 -4114> 2012-10-11 13:43:51.220197 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.75 -4113> 2012-10-11 13:43:51.220211 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.75 0x3176af0)/0x3176af0 -4112> 2012-10-11 13:43:51.220214 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4111> 2012-10-11 13:43:51.220216 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4110> 2012-10-11 13:43:51.220217 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4219 0x22fff30 -4109> 2012-10-11 13:43:51.220219 7f440532f700 5 journal submit_entry seq 4219 len 205 (0x32e8e40) -4108> 2012-10-11 13:43:51.220221 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4107> 2012-10-11 13:43:51.220222 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4106> 2012-10-11 13:43:51.220241 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1717, time: 2012-10-11 13:43:51.220241, event: done, request: osd pg remove(epoch 7; pg2.75; ) v1 -4105> 2012-10-11 13:43:51.220249 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 114058) -4104> 2012-10-11 13:43:51.220252 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 676 ==== pg_query(1.12 epoch 8) v2 ==== 109+0+0 (90717694 0 0) 0x256e540 con 0x2fe2280 -4103> 2012-10-11 13:43:51.220260 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1718, time: 2012-10-11 13:43:50.323035, event: header_read, request: pg_query(1.12 epoch 8) v2 -4102> 2012-10-11 13:43:51.220264 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1718, time: 2012-10-11 13:43:50.323045, event: throttled, request: pg_query(1.12 epoch 8) v2 -4101> 2012-10-11 13:43:51.220267 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1718, time: 2012-10-11 13:43:50.323062, event: all_read, request: pg_query(1.12 epoch 8) v2 -4100> 2012-10-11 13:43:51.220270 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1718, time: 2012-10-11 13:43:51.220259, event: dispatched, request: pg_query(1.12 epoch 8) v2 -4099> 2012-10-11 13:43:51.220274 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1718, time: 2012-10-11 13:43:51.220274, event: waiting_for_osdmap, request: pg_query(1.12 epoch 8) v2 -4098> 2012-10-11 13:43:51.220279 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1718, time: 2012-10-11 13:43:51.220279, event: started, request: pg_query(1.12 epoch 8) v2 -4097> 2012-10-11 13:43:51.220288 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1718, time: 2012-10-11 13:43:51.220288, event: done, request: pg_query(1.12 epoch 8) v2 -4096> 2012-10-11 13:43:51.220294 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 113949) -4095> 2012-10-11 13:43:51.220296 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1021 ==== osd pg remove(epoch 7; pg2.7c; ) v1 ==== 25+0+0 (1046227964 0 0) 0x29361c0 con 0x2fe2140 -4094> 2012-10-11 13:43:51.220303 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1719, time: 2012-10-11 13:43:49.483509, event: header_read, request: osd pg remove(epoch 7; pg2.7c; ) v1 -4093> 2012-10-11 13:43:51.220307 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1719, time: 2012-10-11 13:43:49.483512, event: throttled, request: osd pg remove(epoch 7; pg2.7c; ) v1 -4092> 2012-10-11 13:43:51.220311 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1719, time: 2012-10-11 13:43:49.483516, event: all_read, request: osd pg remove(epoch 7; pg2.7c; ) v1 -4091> 2012-10-11 13:43:51.220314 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1719, time: 2012-10-11 13:43:51.220302, event: dispatched, request: osd pg remove(epoch 7; pg2.7c; ) v1 -4090> 2012-10-11 13:43:51.220318 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1719, time: 2012-10-11 13:43:51.220318, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.7c; ) v1 -4089> 2012-10-11 13:43:51.220323 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1719, time: 2012-10-11 13:43:51.220323, event: started, request: osd pg remove(epoch 7; pg2.7c; ) v1 -4088> 2012-10-11 13:43:51.220327 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.7c -4087> 2012-10-11 13:43:51.220338 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.7c 0x2130640)/0x2130640 -4086> 2012-10-11 13:43:51.220341 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 293595 > 104857600 -4085> 2012-10-11 13:43:51.220043 7f4408335700 5 filestore(/data/osd.0) _do_op 0x24970a0 seq 3721 osr(1.11 0x27a1470)/0x27a1470 start -4084> 2012-10-11 13:43:51.221949 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4083> 2012-10-11 13:43:51.221963 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4082> 2012-10-11 13:43:51.221971 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4220 0x22ff6c0 -4081> 2012-10-11 13:43:51.221981 7f440532f700 5 journal submit_entry seq 4220 len 205 (0x331b4e0) -4080> 2012-10-11 13:43:51.221990 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4079> 2012-10-11 13:43:51.221998 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4078> 2012-10-11 13:43:51.222042 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1719, time: 2012-10-11 13:43:51.222042, event: done, request: osd pg remove(epoch 7; pg2.7c; ) v1 -4077> 2012-10-11 13:43:51.222066 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 113924) -4076> 2012-10-11 13:43:51.222075 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 677 ==== pg_query(1.90 epoch 8) v2 ==== 109+0+0 (4255113420 0 0) 0x256e380 con 0x2fe2280 -4075> 2012-10-11 13:43:51.222093 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1720, time: 2012-10-11 13:43:50.363659, event: header_read, request: pg_query(1.90 epoch 8) v2 -4074> 2012-10-11 13:43:51.222104 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1720, time: 2012-10-11 13:43:50.363676, event: throttled, request: pg_query(1.90 epoch 8) v2 -4073> 2012-10-11 13:43:51.222114 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1720, time: 2012-10-11 13:43:50.363687, event: all_read, request: pg_query(1.90 epoch 8) v2 -4072> 2012-10-11 13:43:51.222124 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1720, time: 2012-10-11 13:43:51.222091, event: dispatched, request: pg_query(1.90 epoch 8) v2 -4071> 2012-10-11 13:43:51.222134 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1720, time: 2012-10-11 13:43:51.222134, event: waiting_for_osdmap, request: pg_query(1.90 epoch 8) v2 -4070> 2012-10-11 13:43:51.222147 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1720, time: 2012-10-11 13:43:51.222147, event: started, request: pg_query(1.90 epoch 8) v2 -4069> 2012-10-11 13:43:51.222166 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1720, time: 2012-10-11 13:43:51.222166, event: done, request: pg_query(1.90 epoch 8) v2 -4068> 2012-10-11 13:43:51.222180 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 113815) -4067> 2012-10-11 13:43:51.222189 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1022 ==== osd pg remove(epoch 7; pg2.7e; ) v1 ==== 25+0+0 (2888094130 0 0) 0x2936000 con 0x2fe2140 -4066> 2012-10-11 13:43:51.222203 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1721, time: 2012-10-11 13:43:49.483518, event: header_read, request: osd pg remove(epoch 7; pg2.7e; ) v1 -4065> 2012-10-11 13:43:51.222215 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1721, time: 2012-10-11 13:43:49.483520, event: throttled, request: osd pg remove(epoch 7; pg2.7e; ) v1 -4064> 2012-10-11 13:43:51.222225 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1721, time: 2012-10-11 13:43:49.483524, event: all_read, request: osd pg remove(epoch 7; pg2.7e; ) v1 -4063> 2012-10-11 13:43:51.222235 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1721, time: 2012-10-11 13:43:51.222202, event: dispatched, request: osd pg remove(epoch 7; pg2.7e; ) v1 -4062> 2012-10-11 13:43:51.222246 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1721, time: 2012-10-11 13:43:51.222246, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.7e; ) v1 -4061> 2012-10-11 13:43:51.222258 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1721, time: 2012-10-11 13:43:51.222258, event: started, request: osd pg remove(epoch 7; pg2.7e; ) v1 -4060> 2012-10-11 13:43:51.222268 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.7e -4059> 2012-10-11 13:43:51.222290 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.7e 0x1d71d70)/0x1d71d70 -4058> 2012-10-11 13:43:51.222300 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 292874 > 104857600 -4057> 2012-10-11 13:43:51.222313 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2497050 seq 3722 osr(0.10 0x1d714d0)/0x1d714d0 start -4056> 2012-10-11 13:43:51.223118 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4055> 2012-10-11 13:43:51.223131 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4054> 2012-10-11 13:43:51.223139 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4221 0x22ff5a0 -4053> 2012-10-11 13:43:51.223149 7f440532f700 5 journal submit_entry seq 4221 len 205 (0x331bf00) -4052> 2012-10-11 13:43:51.223158 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4051> 2012-10-11 13:43:51.223165 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4050> 2012-10-11 13:43:51.223204 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1721, time: 2012-10-11 13:43:51.223204, event: done, request: osd pg remove(epoch 7; pg2.7e; ) v1 -4049> 2012-10-11 13:43:51.223223 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 113790) -4048> 2012-10-11 13:43:51.223232 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 678 ==== pg_log(0.95 epoch 8 query_epoch 8) v3 ==== 507+0+0 (4168544646 0 0) 0x2bce000 con 0x2fe2280 -4047> 2012-10-11 13:43:51.223250 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1722, time: 2012-10-11 13:43:50.466662, event: header_read, request: pg_log(0.95 epoch 8 query_epoch 8) v3 -4046> 2012-10-11 13:43:51.223261 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1722, time: 2012-10-11 13:43:50.466679, event: throttled, request: pg_log(0.95 epoch 8 query_epoch 8) v3 -4045> 2012-10-11 13:43:51.223272 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1722, time: 2012-10-11 13:43:50.466732, event: all_read, request: pg_log(0.95 epoch 8 query_epoch 8) v3 -4044> 2012-10-11 13:43:51.223283 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1722, time: 2012-10-11 13:43:51.223248, event: dispatched, request: pg_log(0.95 epoch 8 query_epoch 8) v3 -4043> 2012-10-11 13:43:51.223293 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1722, time: 2012-10-11 13:43:51.223293, event: waiting_for_osdmap, request: pg_log(0.95 epoch 8 query_epoch 8) v3 -4042> 2012-10-11 13:43:51.223307 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1722, time: 2012-10-11 13:43:51.223306, event: started, request: pg_log(0.95 epoch 8 query_epoch 8) v3 -4041> 2012-10-11 13:43:51.223323 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1722, time: 2012-10-11 13:43:51.223323, event: done, request: pg_log(0.95 epoch 8 query_epoch 8) v3 -4040> 2012-10-11 13:43:51.223336 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 113283) -4039> 2012-10-11 13:43:51.223344 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1023 ==== osd pg remove(epoch 7; pg2.81; ) v1 ==== 25+0+0 (3006390551 0 0) 0x1f92e00 con 0x2fe2140 -4038> 2012-10-11 13:43:51.223359 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1723, time: 2012-10-11 13:43:49.483526, event: header_read, request: osd pg remove(epoch 7; pg2.81; ) v1 -4037> 2012-10-11 13:43:51.223370 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1723, time: 2012-10-11 13:43:49.483528, event: throttled, request: osd pg remove(epoch 7; pg2.81; ) v1 -4036> 2012-10-11 13:43:51.223380 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1723, time: 2012-10-11 13:43:49.483532, event: all_read, request: osd pg remove(epoch 7; pg2.81; ) v1 -4035> 2012-10-11 13:43:51.223391 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1723, time: 2012-10-11 13:43:51.223357, event: dispatched, request: osd pg remove(epoch 7; pg2.81; ) v1 -4034> 2012-10-11 13:43:51.223401 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1723, time: 2012-10-11 13:43:51.223401, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.81; ) v1 -4033> 2012-10-11 13:43:51.223412 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1723, time: 2012-10-11 13:43:51.223412, event: started, request: osd pg remove(epoch 7; pg2.81; ) v1 -4032> 2012-10-11 13:43:51.223422 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.81 -4031> 2012-10-11 13:43:51.223444 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.81 0x3176b40)/0x3176b40 -4030> 2012-10-11 13:43:51.223453 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 292153 > 104857600 -4029> 2012-10-11 13:43:51.223470 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -4028> 2012-10-11 13:43:51.223477 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -4027> 2012-10-11 13:43:51.223484 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4222 0x250e2d0 -4026> 2012-10-11 13:43:51.223493 7f440532f700 5 journal submit_entry seq 4222 len 205 (0x3339570) -4025> 2012-10-11 13:43:51.223502 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -4024> 2012-10-11 13:43:51.223509 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -4023> 2012-10-11 13:43:51.223538 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1723, time: 2012-10-11 13:43:51.223538, event: done, request: osd pg remove(epoch 7; pg2.81; ) v1 -4022> 2012-10-11 13:43:51.223556 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 113258) -4021> 2012-10-11 13:43:51.223565 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 679 ==== pg_log(2.93 epoch 8 query_epoch 8) v3 ==== 507+0+0 (3176957924 0 0) 0x2ec4000 con 0x2fe2280 -4020> 2012-10-11 13:43:51.223581 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1724, time: 2012-10-11 13:43:50.471356, event: header_read, request: pg_log(2.93 epoch 8 query_epoch 8) v3 -4019> 2012-10-11 13:43:51.223592 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1724, time: 2012-10-11 13:43:50.471369, event: throttled, request: pg_log(2.93 epoch 8 query_epoch 8) v3 -4018> 2012-10-11 13:43:51.223602 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1724, time: 2012-10-11 13:43:50.471390, event: all_read, request: pg_log(2.93 epoch 8 query_epoch 8) v3 -4017> 2012-10-11 13:43:51.223612 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1724, time: 2012-10-11 13:43:51.223579, event: dispatched, request: pg_log(2.93 epoch 8 query_epoch 8) v3 -4016> 2012-10-11 13:43:51.223623 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1724, time: 2012-10-11 13:43:51.223623, event: waiting_for_osdmap, request: pg_log(2.93 epoch 8 query_epoch 8) v3 -4015> 2012-10-11 13:43:51.223636 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1724, time: 2012-10-11 13:43:51.223635, event: started, request: pg_log(2.93 epoch 8 query_epoch 8) v3 -4014> 2012-10-11 13:43:51.223651 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1724, time: 2012-10-11 13:43:51.223651, event: done, request: pg_log(2.93 epoch 8 query_epoch 8) v3 -4013> 2012-10-11 13:43:51.223663 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 112751) -4012> 2012-10-11 13:43:51.223671 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1024 ==== osd pg remove(epoch 7; pg2.82; ) v1 ==== 25+0+0 (1752524414 0 0) 0x1f92c40 con 0x2fe2140 -4011> 2012-10-11 13:43:51.223687 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1725, time: 2012-10-11 13:43:49.483534, event: header_read, request: osd pg remove(epoch 7; pg2.82; ) v1 -4010> 2012-10-11 13:43:51.223698 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1725, time: 2012-10-11 13:43:49.483536, event: throttled, request: osd pg remove(epoch 7; pg2.82; ) v1 -4009> 2012-10-11 13:43:51.223708 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1725, time: 2012-10-11 13:43:49.483539, event: all_read, request: osd pg remove(epoch 7; pg2.82; ) v1 -4008> 2012-10-11 13:43:51.223718 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1725, time: 2012-10-11 13:43:51.223685, event: dispatched, request: osd pg remove(epoch 7; pg2.82; ) v1 -4007> 2012-10-11 13:43:51.223729 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1725, time: 2012-10-11 13:43:51.223729, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.82; ) v1 -4006> 2012-10-11 13:43:51.223740 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1725, time: 2012-10-11 13:43:51.223740, event: started, request: osd pg remove(epoch 7; pg2.82; ) v1 -4005> 2012-10-11 13:43:51.223750 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.82 -4004> 2012-10-11 13:43:51.223771 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.82 0x2130c80)/0x2130c80 -4003> 2012-10-11 13:43:51.223780 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 291432 > 104857600 -4002> 2012-10-11 13:43:51.223790 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2497e60 seq 3724 osr(0.e 0x1d71530)/0x1d71530 start -4001> 2012-10-11 13:43:51.224230 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2497000 seq 3723 osr(1.f 0x27a14d0)/0x27a14d0 start -4000> 2012-10-11 13:43:51.234488 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2497e10 seq 3725 osr(2.c 0x1d713d0)/0x1d713d0 start -3999> 2012-10-11 13:43:51.234494 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3998> 2012-10-11 13:43:51.234516 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3997> 2012-10-11 13:43:51.234525 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4223 0x250ed80 -3996> 2012-10-11 13:43:51.234537 7f440532f700 5 journal submit_entry seq 4223 len 205 (0x3339060) -3995> 2012-10-11 13:43:51.234547 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3994> 2012-10-11 13:43:51.234555 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3993> 2012-10-11 13:43:51.234628 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1725, time: 2012-10-11 13:43:51.234628, event: done, request: osd pg remove(epoch 7; pg2.82; ) v1 -3992> 2012-10-11 13:43:51.234655 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 112726) -3991> 2012-10-11 13:43:51.234666 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 680 ==== pg_log(2.8c epoch 8 query_epoch 8) v3 ==== 507+0+0 (2392122447 0 0) 0x3156a00 con 0x2fe2280 -3990> 2012-10-11 13:43:51.234686 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1726, time: 2012-10-11 13:43:50.482405, event: header_read, request: pg_log(2.8c epoch 8 query_epoch 8) v3 -3989> 2012-10-11 13:43:51.234697 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1726, time: 2012-10-11 13:43:50.482420, event: throttled, request: pg_log(2.8c epoch 8 query_epoch 8) v3 -3988> 2012-10-11 13:43:51.234708 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1726, time: 2012-10-11 13:43:50.482446, event: all_read, request: pg_log(2.8c epoch 8 query_epoch 8) v3 -3987> 2012-10-11 13:43:51.234718 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1726, time: 2012-10-11 13:43:51.234684, event: dispatched, request: pg_log(2.8c epoch 8 query_epoch 8) v3 -3986> 2012-10-11 13:43:51.234729 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1726, time: 2012-10-11 13:43:51.234729, event: waiting_for_osdmap, request: pg_log(2.8c epoch 8 query_epoch 8) v3 -3985> 2012-10-11 13:43:51.234745 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1726, time: 2012-10-11 13:43:51.234745, event: started, request: pg_log(2.8c epoch 8 query_epoch 8) v3 -3984> 2012-10-11 13:43:51.234762 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1726, time: 2012-10-11 13:43:51.234762, event: done, request: pg_log(2.8c epoch 8 query_epoch 8) v3 -3983> 2012-10-11 13:43:51.234775 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 112219) -3982> 2012-10-11 13:43:51.234784 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1025 ==== osd pg remove(epoch 7; pg2.83; ) v1 ==== 25+0+0 (558439257 0 0) 0x1f92a80 con 0x2fe2140 -3981> 2012-10-11 13:43:51.234800 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1727, time: 2012-10-11 13:43:49.483542, event: header_read, request: osd pg remove(epoch 7; pg2.83; ) v1 -3980> 2012-10-11 13:43:51.234813 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1727, time: 2012-10-11 13:43:49.483543, event: throttled, request: osd pg remove(epoch 7; pg2.83; ) v1 -3979> 2012-10-11 13:43:51.234825 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1727, time: 2012-10-11 13:43:49.483547, event: all_read, request: osd pg remove(epoch 7; pg2.83; ) v1 -3978> 2012-10-11 13:43:51.234836 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1727, time: 2012-10-11 13:43:51.234798, event: dispatched, request: osd pg remove(epoch 7; pg2.83; ) v1 -3977> 2012-10-11 13:43:51.234847 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1727, time: 2012-10-11 13:43:51.234847, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.83; ) v1 -3976> 2012-10-11 13:43:51.234859 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1727, time: 2012-10-11 13:43:51.234859, event: started, request: osd pg remove(epoch 7; pg2.83; ) v1 -3975> 2012-10-11 13:43:51.234869 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.83 -3974> 2012-10-11 13:43:51.234896 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.83 0x21309d0)/0x21309d0 -3973> 2012-10-11 13:43:51.234910 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 290717 > 104857600 -3972> 2012-10-11 13:43:51.235955 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3971> 2012-10-11 13:43:51.235968 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3970> 2012-10-11 13:43:51.235976 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4224 0x301d360 -3969> 2012-10-11 13:43:51.235987 7f440532f700 5 journal submit_entry seq 4224 len 205 (0x3339ab0) -3968> 2012-10-11 13:43:51.235996 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3967> 2012-10-11 13:43:51.236003 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3966> 2012-10-11 13:43:51.236040 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1727, time: 2012-10-11 13:43:51.236040, event: done, request: osd pg remove(epoch 7; pg2.83; ) v1 -3965> 2012-10-11 13:43:51.236060 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 112194) -3964> 2012-10-11 13:43:51.236069 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 681 ==== pg_log(0.8e epoch 8 query_epoch 8) v3 ==== 507+0+0 (2781101729 0 0) 0x3156500 con 0x2fe2280 -3963> 2012-10-11 13:43:51.236090 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1728, time: 2012-10-11 13:43:50.483715, event: header_read, request: pg_log(0.8e epoch 8 query_epoch 8) v3 -3962> 2012-10-11 13:43:51.236101 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1728, time: 2012-10-11 13:43:50.483728, event: throttled, request: pg_log(0.8e epoch 8 query_epoch 8) v3 -3961> 2012-10-11 13:43:51.236112 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1728, time: 2012-10-11 13:43:50.483748, event: all_read, request: pg_log(0.8e epoch 8 query_epoch 8) v3 -3960> 2012-10-11 13:43:51.236122 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1728, time: 2012-10-11 13:43:51.236088, event: dispatched, request: pg_log(0.8e epoch 8 query_epoch 8) v3 -3959> 2012-10-11 13:43:51.236133 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1728, time: 2012-10-11 13:43:51.236133, event: waiting_for_osdmap, request: pg_log(0.8e epoch 8 query_epoch 8) v3 -3958> 2012-10-11 13:43:51.236146 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1728, time: 2012-10-11 13:43:51.236146, event: started, request: pg_log(0.8e epoch 8 query_epoch 8) v3 -3957> 2012-10-11 13:43:51.236162 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1728, time: 2012-10-11 13:43:51.236162, event: done, request: pg_log(0.8e epoch 8 query_epoch 8) v3 -3956> 2012-10-11 13:43:51.236175 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 111687) -3955> 2012-10-11 13:43:51.236183 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1026 ==== osd pg remove(epoch 7; pg2.84; ) v1 ==== 25+0+0 (3675266653 0 0) 0x1f928c0 con 0x2fe2140 -3954> 2012-10-11 13:43:51.236198 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1729, time: 2012-10-11 13:43:49.483549, event: header_read, request: osd pg remove(epoch 7; pg2.84; ) v1 -3953> 2012-10-11 13:43:51.236209 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1729, time: 2012-10-11 13:43:49.483551, event: throttled, request: osd pg remove(epoch 7; pg2.84; ) v1 -3952> 2012-10-11 13:43:51.236219 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1729, time: 2012-10-11 13:43:49.483554, event: all_read, request: osd pg remove(epoch 7; pg2.84; ) v1 -3951> 2012-10-11 13:43:51.236230 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1729, time: 2012-10-11 13:43:51.236196, event: dispatched, request: osd pg remove(epoch 7; pg2.84; ) v1 -3950> 2012-10-11 13:43:51.236241 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1729, time: 2012-10-11 13:43:51.236241, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.84; ) v1 -3949> 2012-10-11 13:43:51.236252 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1729, time: 2012-10-11 13:43:51.236252, event: started, request: osd pg remove(epoch 7; pg2.84; ) v1 -3948> 2012-10-11 13:43:51.236262 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.84 -3947> 2012-10-11 13:43:51.236285 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.84 0x2130980)/0x2130980 -3946> 2012-10-11 13:43:51.236295 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 290002 > 104857600 -3945> 2012-10-11 13:43:51.236307 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2497dc0 seq 3726 osr(2.f 0x1d714f0)/0x1d714f0 start -3944> 2012-10-11 13:43:51.236321 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3943> 2012-10-11 13:43:51.236317 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2497d70 seq 3727 osr(1.d 0x27a1530)/0x27a1530 start -3942> 2012-10-11 13:43:51.236329 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3941> 2012-10-11 13:43:51.236340 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4225 0x2e55f30 -3940> 2012-10-11 13:43:51.236350 7f440532f700 5 journal submit_entry seq 4225 len 205 (0x3339900) -3939> 2012-10-11 13:43:51.236358 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3938> 2012-10-11 13:43:51.236365 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3937> 2012-10-11 13:43:51.236395 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1729, time: 2012-10-11 13:43:51.236395, event: done, request: osd pg remove(epoch 7; pg2.84; ) v1 -3936> 2012-10-11 13:43:51.236413 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 111662) -3935> 2012-10-11 13:43:51.236423 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 682 ==== pg_log(2.51 epoch 8 query_epoch 8) v3 ==== 507+0+0 (3740012390 0 0) 0x3156000 con 0x2fe2280 -3934> 2012-10-11 13:43:51.236439 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1730, time: 2012-10-11 13:43:50.485296, event: header_read, request: pg_log(2.51 epoch 8 query_epoch 8) v3 -3933> 2012-10-11 13:43:51.236452 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1730, time: 2012-10-11 13:43:50.485312, event: throttled, request: pg_log(2.51 epoch 8 query_epoch 8) v3 -3932> 2012-10-11 13:43:51.236463 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1730, time: 2012-10-11 13:43:50.485333, event: all_read, request: pg_log(2.51 epoch 8 query_epoch 8) v3 -3931> 2012-10-11 13:43:51.236473 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1730, time: 2012-10-11 13:43:51.236438, event: dispatched, request: pg_log(2.51 epoch 8 query_epoch 8) v3 -3930> 2012-10-11 13:43:51.236484 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1730, time: 2012-10-11 13:43:51.236484, event: waiting_for_osdmap, request: pg_log(2.51 epoch 8 query_epoch 8) v3 -3929> 2012-10-11 13:43:51.236498 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1730, time: 2012-10-11 13:43:51.236498, event: started, request: pg_log(2.51 epoch 8 query_epoch 8) v3 -3928> 2012-10-11 13:43:51.236513 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1730, time: 2012-10-11 13:43:51.236513, event: done, request: pg_log(2.51 epoch 8 query_epoch 8) v3 -3927> 2012-10-11 13:43:51.236526 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 111155) -3926> 2012-10-11 13:43:51.236534 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1027 ==== osd pg remove(epoch 7; pg2.87; ) v1 ==== 25+0+0 (5544244 0 0) 0x1f92700 con 0x2fe2140 -3925> 2012-10-11 13:43:51.236549 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1731, time: 2012-10-11 13:43:49.483556, event: header_read, request: osd pg remove(epoch 7; pg2.87; ) v1 -3924> 2012-10-11 13:43:51.236560 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1731, time: 2012-10-11 13:43:49.483558, event: throttled, request: osd pg remove(epoch 7; pg2.87; ) v1 -3923> 2012-10-11 13:43:51.236570 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1731, time: 2012-10-11 13:43:49.483561, event: all_read, request: osd pg remove(epoch 7; pg2.87; ) v1 -3922> 2012-10-11 13:43:51.236581 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1731, time: 2012-10-11 13:43:51.236547, event: dispatched, request: osd pg remove(epoch 7; pg2.87; ) v1 -3921> 2012-10-11 13:43:51.236591 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1731, time: 2012-10-11 13:43:51.236591, event: waiting_for_osdmap, request: osd pg remove(epoch 7; pg2.87; ) v1 -3920> 2012-10-11 13:43:51.236603 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1731, time: 2012-10-11 13:43:51.236603, event: started, request: osd pg remove(epoch 7; pg2.87; ) v1 -3919> 2012-10-11 13:43:51.236613 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 2.87 -3918> 2012-10-11 13:43:51.236634 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(2.87 0x2130a90)/0x2130a90 -3917> 2012-10-11 13:43:51.236643 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 289287 > 104857600 -3916> 2012-10-11 13:43:51.237225 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2497d20 seq 3728 osr(2.e 0x1d71470)/0x1d71470 start -3915> 2012-10-11 13:43:51.237229 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3914> 2012-10-11 13:43:51.237260 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3913> 2012-10-11 13:43:51.237269 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4226 0x250e870 -3912> 2012-10-11 13:43:51.237280 7f440532f700 5 journal submit_entry seq 4226 len 205 (0x3339750) -3911> 2012-10-11 13:43:51.237289 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3910> 2012-10-11 13:43:51.237296 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3909> 2012-10-11 13:43:51.237331 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1731, time: 2012-10-11 13:43:51.237331, event: done, request: osd pg remove(epoch 7; pg2.87; ) v1 -3908> 2012-10-11 13:43:51.237351 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 111130) -3907> 2012-10-11 13:43:51.237360 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 683 ==== pg_log(1.52 epoch 8 query_epoch 8) v3 ==== 507+0+0 (3493588804 0 0) 0x2dc0a00 con 0x2fe2280 -3906> 2012-10-11 13:43:51.237377 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1732, time: 2012-10-11 13:43:50.486875, event: header_read, request: pg_log(1.52 epoch 8 query_epoch 8) v3 -3905> 2012-10-11 13:43:51.237388 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1732, time: 2012-10-11 13:43:50.486886, event: throttled, request: pg_log(1.52 epoch 8 query_epoch 8) v3 -3904> 2012-10-11 13:43:51.237399 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1732, time: 2012-10-11 13:43:50.486900, event: all_read, request: pg_log(1.52 epoch 8 query_epoch 8) v3 -3903> 2012-10-11 13:43:51.237409 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1732, time: 2012-10-11 13:43:51.237376, event: dispatched, request: pg_log(1.52 epoch 8 query_epoch 8) v3 -3902> 2012-10-11 13:43:51.237419 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1732, time: 2012-10-11 13:43:51.237419, event: waiting_for_osdmap, request: pg_log(1.52 epoch 8 query_epoch 8) v3 -3901> 2012-10-11 13:43:51.237433 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1732, time: 2012-10-11 13:43:51.237433, event: started, request: pg_log(1.52 epoch 8 query_epoch 8) v3 -3900> 2012-10-11 13:43:51.237448 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1732, time: 2012-10-11 13:43:51.237448, event: done, request: pg_log(1.52 epoch 8 query_epoch 8) v3 -3899> 2012-10-11 13:43:51.237461 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 110623) -3898> 2012-10-11 13:43:51.237470 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1028 ==== osd_map(8..8 src has 1..8) v3 ==== 168+0+0 (3498318630 0 0) 0x20ab600 con 0x2fe2140 -3897> 2012-10-11 13:43:51.237488 7f440532f700 3 osd.0 8 handle_osd_map epochs [8,8], i have 8, src has [1,8] -3896> 2012-10-11 13:43:51.237499 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 168 (0xb7c748 -> 110455) -3895> 2012-10-11 13:43:51.237507 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 684 ==== pg_log(0.53 epoch 8 query_epoch 8) v3 ==== 507+0+0 (2763635437 0 0) 0x2dc0500 con 0x2fe2280 -3894> 2012-10-11 13:43:51.237522 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1733, time: 2012-10-11 13:43:50.487624, event: header_read, request: pg_log(0.53 epoch 8 query_epoch 8) v3 -3893> 2012-10-11 13:43:51.237532 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1733, time: 2012-10-11 13:43:50.487634, event: throttled, request: pg_log(0.53 epoch 8 query_epoch 8) v3 -3892> 2012-10-11 13:43:51.237543 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1733, time: 2012-10-11 13:43:50.487647, event: all_read, request: pg_log(0.53 epoch 8 query_epoch 8) v3 -3891> 2012-10-11 13:43:51.237553 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1733, time: 2012-10-11 13:43:51.237520, event: dispatched, request: pg_log(0.53 epoch 8 query_epoch 8) v3 -3890> 2012-10-11 13:43:51.237564 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1733, time: 2012-10-11 13:43:51.237564, event: waiting_for_osdmap, request: pg_log(0.53 epoch 8 query_epoch 8) v3 -3889> 2012-10-11 13:43:51.237577 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1733, time: 2012-10-11 13:43:51.237577, event: started, request: pg_log(0.53 epoch 8 query_epoch 8) v3 -3888> 2012-10-11 13:43:51.237592 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1733, time: 2012-10-11 13:43:51.237591, event: done, request: pg_log(0.53 epoch 8 query_epoch 8) v3 -3887> 2012-10-11 13:43:51.237604 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 109948) -3886> 2012-10-11 13:43:51.237612 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1029 ==== pg_query(1.88 epoch 8) v2 ==== 109+0+0 (3107104239 0 0) 0x2ca7000 con 0x2fe2140 -3885> 2012-10-11 13:43:51.237627 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1734, time: 2012-10-11 13:43:49.975738, event: header_read, request: pg_query(1.88 epoch 8) v2 -3884> 2012-10-11 13:43:51.237637 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1734, time: 2012-10-11 13:43:49.975741, event: throttled, request: pg_query(1.88 epoch 8) v2 -3883> 2012-10-11 13:43:51.237648 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1734, time: 2012-10-11 13:43:49.975746, event: all_read, request: pg_query(1.88 epoch 8) v2 -3882> 2012-10-11 13:43:51.237658 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1734, time: 2012-10-11 13:43:51.237625, event: dispatched, request: pg_query(1.88 epoch 8) v2 -3881> 2012-10-11 13:43:51.237668 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1734, time: 2012-10-11 13:43:51.237668, event: waiting_for_osdmap, request: pg_query(1.88 epoch 8) v2 -3880> 2012-10-11 13:43:51.237680 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1734, time: 2012-10-11 13:43:51.237680, event: started, request: pg_query(1.88 epoch 8) v2 -3879> 2012-10-11 13:43:51.237697 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1734, time: 2012-10-11 13:43:51.237697, event: done, request: pg_query(1.88 epoch 8) v2 -3878> 2012-10-11 13:43:51.237710 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 109839) -3877> 2012-10-11 13:43:51.237718 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 685 ==== pg_log(2.44 epoch 8 query_epoch 8) v3 ==== 507+0+0 (2117006283 0 0) 0x2dc0000 con 0x2fe2280 -3876> 2012-10-11 13:43:51.237733 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1735, time: 2012-10-11 13:43:50.488492, event: header_read, request: pg_log(2.44 epoch 8 query_epoch 8) v3 -3875> 2012-10-11 13:43:51.237744 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1735, time: 2012-10-11 13:43:50.488500, event: throttled, request: pg_log(2.44 epoch 8 query_epoch 8) v3 -3874> 2012-10-11 13:43:51.237754 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1735, time: 2012-10-11 13:43:50.488513, event: all_read, request: pg_log(2.44 epoch 8 query_epoch 8) v3 -3873> 2012-10-11 13:43:51.237764 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1735, time: 2012-10-11 13:43:51.237732, event: dispatched, request: pg_log(2.44 epoch 8 query_epoch 8) v3 -3872> 2012-10-11 13:43:51.237775 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1735, time: 2012-10-11 13:43:51.237775, event: waiting_for_osdmap, request: pg_log(2.44 epoch 8 query_epoch 8) v3 -3871> 2012-10-11 13:43:51.237787 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1735, time: 2012-10-11 13:43:51.237787, event: started, request: pg_log(2.44 epoch 8 query_epoch 8) v3 -3870> 2012-10-11 13:43:51.237801 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1735, time: 2012-10-11 13:43:51.237801, event: done, request: pg_log(2.44 epoch 8 query_epoch 8) v3 -3869> 2012-10-11 13:43:51.237813 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 109332) -3868> 2012-10-11 13:43:51.237821 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1030 ==== pg_query(0.40 epoch 8) v2 ==== 109+0+0 (22005938 0 0) 0x24af380 con 0x2fe2140 -3867> 2012-10-11 13:43:51.237835 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1736, time: 2012-10-11 13:43:49.975749, event: header_read, request: pg_query(0.40 epoch 8) v2 -3866> 2012-10-11 13:43:51.237846 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1736, time: 2012-10-11 13:43:49.975751, event: throttled, request: pg_query(0.40 epoch 8) v2 -3865> 2012-10-11 13:43:51.237857 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1736, time: 2012-10-11 13:43:49.975756, event: all_read, request: pg_query(0.40 epoch 8) v2 -3864> 2012-10-11 13:43:51.237867 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1736, time: 2012-10-11 13:43:51.237834, event: dispatched, request: pg_query(0.40 epoch 8) v2 -3863> 2012-10-11 13:43:51.237877 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1736, time: 2012-10-11 13:43:51.237877, event: waiting_for_osdmap, request: pg_query(0.40 epoch 8) v2 -3862> 2012-10-11 13:43:51.237889 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1736, time: 2012-10-11 13:43:51.237889, event: started, request: pg_query(0.40 epoch 8) v2 -3861> 2012-10-11 13:43:51.237905 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1736, time: 2012-10-11 13:43:51.237905, event: done, request: pg_query(0.40 epoch 8) v2 -3860> 2012-10-11 13:43:51.237918 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 109223) -3859> 2012-10-11 13:43:51.237926 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 686 ==== pg_log(0.46 epoch 8 query_epoch 8) v3 ==== 507+0+0 (3134772146 0 0) 0x2a7fa00 con 0x2fe2280 -3858> 2012-10-11 13:43:51.237941 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1737, time: 2012-10-11 13:43:50.489476, event: header_read, request: pg_log(0.46 epoch 8 query_epoch 8) v3 -3857> 2012-10-11 13:43:51.237952 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1737, time: 2012-10-11 13:43:50.489488, event: throttled, request: pg_log(0.46 epoch 8 query_epoch 8) v3 -3856> 2012-10-11 13:43:51.237962 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1737, time: 2012-10-11 13:43:50.489505, event: all_read, request: pg_log(0.46 epoch 8 query_epoch 8) v3 -3855> 2012-10-11 13:43:51.237972 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1737, time: 2012-10-11 13:43:51.237940, event: dispatched, request: pg_log(0.46 epoch 8 query_epoch 8) v3 -3854> 2012-10-11 13:43:51.237983 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1737, time: 2012-10-11 13:43:51.237983, event: waiting_for_osdmap, request: pg_log(0.46 epoch 8 query_epoch 8) v3 -3853> 2012-10-11 13:43:51.237995 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1737, time: 2012-10-11 13:43:51.237995, event: started, request: pg_log(0.46 epoch 8 query_epoch 8) v3 -3852> 2012-10-11 13:43:51.238009 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1737, time: 2012-10-11 13:43:51.238009, event: done, request: pg_log(0.46 epoch 8 query_epoch 8) v3 -3851> 2012-10-11 13:43:51.238021 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 108716) -3850> 2012-10-11 13:43:51.238027 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2497cd0 seq 3729 osr(0.ca 0x24689c0)/0x24689c0 start -3849> 2012-10-11 13:43:51.238030 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1031 ==== pg_query(1.84 epoch 8) v2 ==== 109+0+0 (2647387707 0 0) 0x1f92540 con 0x2fe2140 -3848> 2012-10-11 13:43:51.238048 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1738, time: 2012-10-11 13:43:49.975759, event: header_read, request: pg_query(1.84 epoch 8) v2 -3847> 2012-10-11 13:43:51.238059 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1738, time: 2012-10-11 13:43:49.975761, event: throttled, request: pg_query(1.84 epoch 8) v2 -3846> 2012-10-11 13:43:51.238069 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1738, time: 2012-10-11 13:43:49.975765, event: all_read, request: pg_query(1.84 epoch 8) v2 -3845> 2012-10-11 13:43:51.238079 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1738, time: 2012-10-11 13:43:51.238046, event: dispatched, request: pg_query(1.84 epoch 8) v2 -3844> 2012-10-11 13:43:51.238090 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1738, time: 2012-10-11 13:43:51.238089, event: waiting_for_osdmap, request: pg_query(1.84 epoch 8) v2 -3843> 2012-10-11 13:43:51.238101 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1738, time: 2012-10-11 13:43:51.238101, event: started, request: pg_query(1.84 epoch 8) v2 -3842> 2012-10-11 13:43:51.238117 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1738, time: 2012-10-11 13:43:51.238117, event: done, request: pg_query(1.84 epoch 8) v2 -3841> 2012-10-11 13:43:51.238130 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 108607) -3840> 2012-10-11 13:43:51.238138 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 687 ==== pg_log(1.45 epoch 8 query_epoch 8) v3 ==== 507+0+0 (2114869466 0 0) 0x2a7f500 con 0x2fe2280 -3839> 2012-10-11 13:43:51.238153 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1739, time: 2012-10-11 13:43:50.489819, event: header_read, request: pg_log(1.45 epoch 8 query_epoch 8) v3 -3838> 2012-10-11 13:43:51.238163 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1739, time: 2012-10-11 13:43:50.489826, event: throttled, request: pg_log(1.45 epoch 8 query_epoch 8) v3 -3837> 2012-10-11 13:43:51.238174 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1739, time: 2012-10-11 13:43:50.489839, event: all_read, request: pg_log(1.45 epoch 8 query_epoch 8) v3 -3836> 2012-10-11 13:43:51.238184 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1739, time: 2012-10-11 13:43:51.238151, event: dispatched, request: pg_log(1.45 epoch 8 query_epoch 8) v3 -3835> 2012-10-11 13:43:51.238194 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1739, time: 2012-10-11 13:43:51.238194, event: waiting_for_osdmap, request: pg_log(1.45 epoch 8 query_epoch 8) v3 -3834> 2012-10-11 13:43:51.238207 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1739, time: 2012-10-11 13:43:51.238207, event: started, request: pg_log(1.45 epoch 8 query_epoch 8) v3 -3833> 2012-10-11 13:43:51.238221 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1739, time: 2012-10-11 13:43:51.238221, event: done, request: pg_log(1.45 epoch 8 query_epoch 8) v3 -3832> 2012-10-11 13:43:51.238234 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 108100) -3831> 2012-10-11 13:43:51.238242 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1032 ==== pg_query(1.85 epoch 8) v2 ==== 109+0+0 (2598248552 0 0) 0x1f92380 con 0x2fe2140 -3830> 2012-10-11 13:43:51.238256 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1740, time: 2012-10-11 13:43:49.975768, event: header_read, request: pg_query(1.85 epoch 8) v2 -3829> 2012-10-11 13:43:51.238266 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1740, time: 2012-10-11 13:43:49.975770, event: throttled, request: pg_query(1.85 epoch 8) v2 -3828> 2012-10-11 13:43:51.238277 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1740, time: 2012-10-11 13:43:49.975774, event: all_read, request: pg_query(1.85 epoch 8) v2 -3827> 2012-10-11 13:43:51.238287 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1740, time: 2012-10-11 13:43:51.238254, event: dispatched, request: pg_query(1.85 epoch 8) v2 -3826> 2012-10-11 13:43:51.238297 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1740, time: 2012-10-11 13:43:51.238297, event: waiting_for_osdmap, request: pg_query(1.85 epoch 8) v2 -3825> 2012-10-11 13:43:51.238308 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1740, time: 2012-10-11 13:43:51.238308, event: started, request: pg_query(1.85 epoch 8) v2 -3824> 2012-10-11 13:43:51.238324 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1740, time: 2012-10-11 13:43:51.238324, event: done, request: pg_query(1.85 epoch 8) v2 -3823> 2012-10-11 13:43:51.238337 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 107991) -3822> 2012-10-11 13:43:51.238345 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 688 ==== pg_log(2.3d epoch 8 query_epoch 8) v3 ==== 507+0+0 (4099636388 0 0) 0x2a7f000 con 0x2fe2280 -3821> 2012-10-11 13:43:51.238359 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1741, time: 2012-10-11 13:43:50.494301, event: header_read, request: pg_log(2.3d epoch 8 query_epoch 8) v3 -3820> 2012-10-11 13:43:51.238370 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1741, time: 2012-10-11 13:43:50.494312, event: throttled, request: pg_log(2.3d epoch 8 query_epoch 8) v3 -3819> 2012-10-11 13:43:51.238380 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1741, time: 2012-10-11 13:43:50.494325, event: all_read, request: pg_log(2.3d epoch 8 query_epoch 8) v3 -3818> 2012-10-11 13:43:51.238390 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1741, time: 2012-10-11 13:43:51.238358, event: dispatched, request: pg_log(2.3d epoch 8 query_epoch 8) v3 -3817> 2012-10-11 13:43:51.238401 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1741, time: 2012-10-11 13:43:51.238401, event: waiting_for_osdmap, request: pg_log(2.3d epoch 8 query_epoch 8) v3 -3816> 2012-10-11 13:43:51.238413 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1741, time: 2012-10-11 13:43:51.238413, event: started, request: pg_log(2.3d epoch 8 query_epoch 8) v3 -3815> 2012-10-11 13:43:51.238427 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1741, time: 2012-10-11 13:43:51.238427, event: done, request: pg_log(2.3d epoch 8 query_epoch 8) v3 -3814> 2012-10-11 13:43:51.238439 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 107484) -3813> 2012-10-11 13:43:51.238447 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1033 ==== pg_query(0.3c epoch 8) v2 ==== 109+0+0 (1993100807 0 0) 0x1f921c0 con 0x2fe2140 -3812> 2012-10-11 13:43:51.238462 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1742, time: 2012-10-11 13:43:49.975777, event: header_read, request: pg_query(0.3c epoch 8) v2 -3811> 2012-10-11 13:43:51.238472 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1742, time: 2012-10-11 13:43:49.975779, event: throttled, request: pg_query(0.3c epoch 8) v2 -3810> 2012-10-11 13:43:51.238482 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1742, time: 2012-10-11 13:43:49.975783, event: all_read, request: pg_query(0.3c epoch 8) v2 -3809> 2012-10-11 13:43:51.238492 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1742, time: 2012-10-11 13:43:51.238460, event: dispatched, request: pg_query(0.3c epoch 8) v2 -3808> 2012-10-11 13:43:51.238503 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1742, time: 2012-10-11 13:43:51.238503, event: waiting_for_osdmap, request: pg_query(0.3c epoch 8) v2 -3807> 2012-10-11 13:43:51.238514 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1742, time: 2012-10-11 13:43:51.238514, event: started, request: pg_query(0.3c epoch 8) v2 -3806> 2012-10-11 13:43:51.238530 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1742, time: 2012-10-11 13:43:51.238529, event: done, request: pg_query(0.3c epoch 8) v2 -3805> 2012-10-11 13:43:51.238542 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 107375) -3804> 2012-10-11 13:43:51.238550 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 689 ==== pg_log(0.3f epoch 8 query_epoch 8) v3 ==== 507+0+0 (3360902907 0 0) 0x2c27a00 con 0x2fe2280 -3803> 2012-10-11 13:43:51.238565 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1743, time: 2012-10-11 13:43:50.497227, event: header_read, request: pg_log(0.3f epoch 8 query_epoch 8) v3 -3802> 2012-10-11 13:43:51.238575 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1743, time: 2012-10-11 13:43:50.497236, event: throttled, request: pg_log(0.3f epoch 8 query_epoch 8) v3 -3801> 2012-10-11 13:43:51.238586 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1743, time: 2012-10-11 13:43:50.497260, event: all_read, request: pg_log(0.3f epoch 8 query_epoch 8) v3 -3800> 2012-10-11 13:43:51.238596 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1743, time: 2012-10-11 13:43:51.238563, event: dispatched, request: pg_log(0.3f epoch 8 query_epoch 8) v3 -3799> 2012-10-11 13:43:51.238607 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1743, time: 2012-10-11 13:43:51.238607, event: waiting_for_osdmap, request: pg_log(0.3f epoch 8 query_epoch 8) v3 -3798> 2012-10-11 13:43:51.238619 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1743, time: 2012-10-11 13:43:51.238619, event: started, request: pg_log(0.3f epoch 8 query_epoch 8) v3 -3797> 2012-10-11 13:43:51.238633 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1743, time: 2012-10-11 13:43:51.238633, event: done, request: pg_log(0.3f epoch 8 query_epoch 8) v3 -3796> 2012-10-11 13:43:51.238645 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 106868) -3795> 2012-10-11 13:43:51.238653 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1034 ==== pg_query(0.38 epoch 8) v2 ==== 109+0+0 (1788573515 0 0) 0x1f92000 con 0x2fe2140 -3794> 2012-10-11 13:43:51.238667 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1744, time: 2012-10-11 13:43:49.975786, event: header_read, request: pg_query(0.38 epoch 8) v2 -3793> 2012-10-11 13:43:51.238678 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1744, time: 2012-10-11 13:43:49.975788, event: throttled, request: pg_query(0.38 epoch 8) v2 -3792> 2012-10-11 13:43:51.238688 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1744, time: 2012-10-11 13:43:49.975792, event: all_read, request: pg_query(0.38 epoch 8) v2 -3791> 2012-10-11 13:43:51.238698 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1744, time: 2012-10-11 13:43:51.238666, event: dispatched, request: pg_query(0.38 epoch 8) v2 -3790> 2012-10-11 13:43:51.238709 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1744, time: 2012-10-11 13:43:51.238709, event: waiting_for_osdmap, request: pg_query(0.38 epoch 8) v2 -3789> 2012-10-11 13:43:51.238720 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1744, time: 2012-10-11 13:43:51.238720, event: started, request: pg_query(0.38 epoch 8) v2 -3788> 2012-10-11 13:43:51.238736 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1744, time: 2012-10-11 13:43:51.238736, event: done, request: pg_query(0.38 epoch 8) v2 -3787> 2012-10-11 13:43:51.238749 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 106759) -3786> 2012-10-11 13:43:51.238757 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 690 ==== pg_log(1.3e epoch 8 query_epoch 8) v3 ==== 507+0+0 (2257284264 0 0) 0x2c27500 con 0x2fe2280 -3785> 2012-10-11 13:43:51.238771 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1745, time: 2012-10-11 13:43:50.503162, event: header_read, request: pg_log(1.3e epoch 8 query_epoch 8) v3 -3784> 2012-10-11 13:43:51.238782 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1745, time: 2012-10-11 13:43:50.503174, event: throttled, request: pg_log(1.3e epoch 8 query_epoch 8) v3 -3783> 2012-10-11 13:43:51.238793 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1745, time: 2012-10-11 13:43:50.503188, event: all_read, request: pg_log(1.3e epoch 8 query_epoch 8) v3 -3782> 2012-10-11 13:43:51.238803 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1745, time: 2012-10-11 13:43:51.238770, event: dispatched, request: pg_log(1.3e epoch 8 query_epoch 8) v3 -3781> 2012-10-11 13:43:51.238815 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1745, time: 2012-10-11 13:43:51.238814, event: waiting_for_osdmap, request: pg_log(1.3e epoch 8 query_epoch 8) v3 -3780> 2012-10-11 13:43:51.238827 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1745, time: 2012-10-11 13:43:51.238827, event: started, request: pg_log(1.3e epoch 8 query_epoch 8) v3 -3779> 2012-10-11 13:43:51.238842 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1745, time: 2012-10-11 13:43:51.238841, event: done, request: pg_log(1.3e epoch 8 query_epoch 8) v3 -3778> 2012-10-11 13:43:51.238854 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 106252) -3777> 2012-10-11 13:43:51.238851 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2497c80 seq 3730 osr(2.c8 0x24684e0)/0x24684e0 start -3776> 2012-10-11 13:43:51.238862 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1035 ==== pg_query(0.33 epoch 8) v2 ==== 109+0+0 (1527469862 0 0) 0x2e62e00 con 0x2fe2140 -3775> 2012-10-11 13:43:51.238877 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1746, time: 2012-10-11 13:43:49.975794, event: header_read, request: pg_query(0.33 epoch 8) v2 -3774> 2012-10-11 13:43:51.238888 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1746, time: 2012-10-11 13:43:49.975797, event: throttled, request: pg_query(0.33 epoch 8) v2 -3773> 2012-10-11 13:43:51.238898 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1746, time: 2012-10-11 13:43:49.975801, event: all_read, request: pg_query(0.33 epoch 8) v2 -3772> 2012-10-11 13:43:51.238908 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1746, time: 2012-10-11 13:43:51.238875, event: dispatched, request: pg_query(0.33 epoch 8) v2 -3771> 2012-10-11 13:43:51.238919 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1746, time: 2012-10-11 13:43:51.238919, event: waiting_for_osdmap, request: pg_query(0.33 epoch 8) v2 -3770> 2012-10-11 13:43:51.238930 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1746, time: 2012-10-11 13:43:51.238930, event: started, request: pg_query(0.33 epoch 8) v2 -3769> 2012-10-11 13:43:51.238946 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1746, time: 2012-10-11 13:43:51.238946, event: done, request: pg_query(0.33 epoch 8) v2 -3768> 2012-10-11 13:43:51.238960 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 106143) -3767> 2012-10-11 13:43:51.238968 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 691 ==== pg_log(0.35 epoch 8 query_epoch 8) v3 ==== 507+0+0 (3738580151 0 0) 0x2c27000 con 0x2fe2280 -3766> 2012-10-11 13:43:51.238983 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1747, time: 2012-10-11 13:43:50.509497, event: header_read, request: pg_log(0.35 epoch 8 query_epoch 8) v3 -3765> 2012-10-11 13:43:51.238994 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1747, time: 2012-10-11 13:43:50.509508, event: throttled, request: pg_log(0.35 epoch 8 query_epoch 8) v3 -3764> 2012-10-11 13:43:51.239004 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1747, time: 2012-10-11 13:43:50.509521, event: all_read, request: pg_log(0.35 epoch 8 query_epoch 8) v3 -3763> 2012-10-11 13:43:51.239014 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1747, time: 2012-10-11 13:43:51.238981, event: dispatched, request: pg_log(0.35 epoch 8 query_epoch 8) v3 -3762> 2012-10-11 13:43:51.239025 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1747, time: 2012-10-11 13:43:51.239025, event: waiting_for_osdmap, request: pg_log(0.35 epoch 8 query_epoch 8) v3 -3761> 2012-10-11 13:43:51.239037 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1747, time: 2012-10-11 13:43:51.239037, event: started, request: pg_log(0.35 epoch 8 query_epoch 8) v3 -3760> 2012-10-11 13:43:51.239051 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1747, time: 2012-10-11 13:43:51.239051, event: done, request: pg_log(0.35 epoch 8 query_epoch 8) v3 -3759> 2012-10-11 13:43:51.239063 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 105636) -3758> 2012-10-11 13:43:51.239072 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1036 ==== pg_query(0.32 epoch 8) v2 ==== 109+0+0 (1545509237 0 0) 0x2e62c40 con 0x2fe2140 -3757> 2012-10-11 13:43:51.239086 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1748, time: 2012-10-11 13:43:49.975804, event: header_read, request: pg_query(0.32 epoch 8) v2 -3756> 2012-10-11 13:43:51.239097 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1748, time: 2012-10-11 13:43:49.975806, event: throttled, request: pg_query(0.32 epoch 8) v2 -3755> 2012-10-11 13:43:51.239107 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1748, time: 2012-10-11 13:43:49.975810, event: all_read, request: pg_query(0.32 epoch 8) v2 -3754> 2012-10-11 13:43:51.239117 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1748, time: 2012-10-11 13:43:51.239084, event: dispatched, request: pg_query(0.32 epoch 8) v2 -3753> 2012-10-11 13:43:51.239128 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1748, time: 2012-10-11 13:43:51.239128, event: waiting_for_osdmap, request: pg_query(0.32 epoch 8) v2 -3752> 2012-10-11 13:43:51.239139 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1748, time: 2012-10-11 13:43:51.239139, event: started, request: pg_query(0.32 epoch 8) v2 -3751> 2012-10-11 13:43:51.239155 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1748, time: 2012-10-11 13:43:51.239155, event: done, request: pg_query(0.32 epoch 8) v2 -3750> 2012-10-11 13:43:51.239168 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 105527) -3749> 2012-10-11 13:43:51.239176 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 692 ==== pg_log(1.78 epoch 8 query_epoch 8) v3 ==== 507+0+0 (3188584253 0 0) 0x2a81a00 con 0x2fe2280 -3748> 2012-10-11 13:43:51.239191 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1749, time: 2012-10-11 13:43:50.512154, event: header_read, request: pg_log(1.78 epoch 8 query_epoch 8) v3 -3747> 2012-10-11 13:43:51.239202 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1749, time: 2012-10-11 13:43:50.512165, event: throttled, request: pg_log(1.78 epoch 8 query_epoch 8) v3 -3746> 2012-10-11 13:43:51.239213 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1749, time: 2012-10-11 13:43:50.512183, event: all_read, request: pg_log(1.78 epoch 8 query_epoch 8) v3 -3745> 2012-10-11 13:43:51.239223 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1749, time: 2012-10-11 13:43:51.239190, event: dispatched, request: pg_log(1.78 epoch 8 query_epoch 8) v3 -3744> 2012-10-11 13:43:51.239233 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1749, time: 2012-10-11 13:43:51.239233, event: waiting_for_osdmap, request: pg_log(1.78 epoch 8 query_epoch 8) v3 -3743> 2012-10-11 13:43:51.239246 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1749, time: 2012-10-11 13:43:51.239246, event: started, request: pg_log(1.78 epoch 8 query_epoch 8) v3 -3742> 2012-10-11 13:43:51.239260 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1749, time: 2012-10-11 13:43:51.239260, event: done, request: pg_log(1.78 epoch 8 query_epoch 8) v3 -3741> 2012-10-11 13:43:51.239272 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 105020) -3740> 2012-10-11 13:43:51.239281 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1037 ==== pg_query(0.2f epoch 8) v2 ==== 109+0+0 (246348226 0 0) 0x2e62a80 con 0x2fe2140 -3739> 2012-10-11 13:43:51.239295 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1750, time: 2012-10-11 13:43:49.975813, event: header_read, request: pg_query(0.2f epoch 8) v2 -3738> 2012-10-11 13:43:51.239306 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1750, time: 2012-10-11 13:43:49.975815, event: throttled, request: pg_query(0.2f epoch 8) v2 -3737> 2012-10-11 13:43:51.239317 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1750, time: 2012-10-11 13:43:49.975819, event: all_read, request: pg_query(0.2f epoch 8) v2 -3736> 2012-10-11 13:43:51.239327 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1750, time: 2012-10-11 13:43:51.239294, event: dispatched, request: pg_query(0.2f epoch 8) v2 -3735> 2012-10-11 13:43:51.239338 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1750, time: 2012-10-11 13:43:51.239337, event: waiting_for_osdmap, request: pg_query(0.2f epoch 8) v2 -3734> 2012-10-11 13:43:51.239349 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1750, time: 2012-10-11 13:43:51.239349, event: started, request: pg_query(0.2f epoch 8) v2 -3733> 2012-10-11 13:43:51.239365 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1750, time: 2012-10-11 13:43:51.239365, event: done, request: pg_query(0.2f epoch 8) v2 -3732> 2012-10-11 13:43:51.239377 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 104911) -3731> 2012-10-11 13:43:51.239386 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 693 ==== pg_log(0.79 epoch 8 query_epoch 8) v3 ==== 507+0+0 (260722599 0 0) 0x2a81500 con 0x2fe2280 -3730> 2012-10-11 13:43:51.239401 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1751, time: 2012-10-11 13:43:50.512685, event: header_read, request: pg_log(0.79 epoch 8 query_epoch 8) v3 -3729> 2012-10-11 13:43:51.239412 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1751, time: 2012-10-11 13:43:50.512695, event: throttled, request: pg_log(0.79 epoch 8 query_epoch 8) v3 -3728> 2012-10-11 13:43:51.239422 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1751, time: 2012-10-11 13:43:50.512707, event: all_read, request: pg_log(0.79 epoch 8 query_epoch 8) v3 -3727> 2012-10-11 13:43:51.239432 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1751, time: 2012-10-11 13:43:51.239399, event: dispatched, request: pg_log(0.79 epoch 8 query_epoch 8) v3 -3726> 2012-10-11 13:43:51.239443 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1751, time: 2012-10-11 13:43:51.239443, event: waiting_for_osdmap, request: pg_log(0.79 epoch 8 query_epoch 8) v3 -3725> 2012-10-11 13:43:51.239455 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1751, time: 2012-10-11 13:43:51.239455, event: started, request: pg_log(0.79 epoch 8 query_epoch 8) v3 -3724> 2012-10-11 13:43:51.239469 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1751, time: 2012-10-11 13:43:51.239469, event: done, request: pg_log(0.79 epoch 8 query_epoch 8) v3 -3723> 2012-10-11 13:43:51.239481 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 104404) -3722> 2012-10-11 13:43:51.239490 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1038 ==== pg_query(0.2c epoch 8) v2 ==== 109+0+0 (126921527 0 0) 0x2e628c0 con 0x2fe2140 -3721> 2012-10-11 13:43:51.239504 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1752, time: 2012-10-11 13:43:49.975821, event: header_read, request: pg_query(0.2c epoch 8) v2 -3720> 2012-10-11 13:43:51.239515 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1752, time: 2012-10-11 13:43:49.975823, event: throttled, request: pg_query(0.2c epoch 8) v2 -3719> 2012-10-11 13:43:51.239525 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1752, time: 2012-10-11 13:43:49.975843, event: all_read, request: pg_query(0.2c epoch 8) v2 -3718> 2012-10-11 13:43:51.239535 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1752, time: 2012-10-11 13:43:51.239503, event: dispatched, request: pg_query(0.2c epoch 8) v2 -3717> 2012-10-11 13:43:51.239546 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1752, time: 2012-10-11 13:43:51.239546, event: waiting_for_osdmap, request: pg_query(0.2c epoch 8) v2 -3726> 2012-10-11 13:43:51.239557 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1752, time: 2012-10-11 13:43:51.239557, event: started, request: pg_query(0.2c epoch 8) v2 -3725> 2012-10-11 13:43:51.239573 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1752, time: 2012-10-11 13:43:51.239573, event: done, request: pg_query(0.2c epoch 8) v2 -3724> 2012-10-11 13:43:51.239586 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 104295) -3723> 2012-10-11 13:43:51.239597 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 694 ==== pg_log(1.34 epoch 8 query_epoch 8) v3 ==== 507+0+0 (3263908003 0 0) 0x2a81000 con 0x2fe2280 -3722> 2012-10-11 13:43:51.239612 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1753, time: 2012-10-11 13:43:50.515131, event: header_read, request: pg_log(1.34 epoch 8 query_epoch 8) v3 -3721> 2012-10-11 13:43:51.239623 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1753, time: 2012-10-11 13:43:50.515143, event: throttled, request: pg_log(1.34 epoch 8 query_epoch 8) v3 -3720> 2012-10-11 13:43:51.239634 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1753, time: 2012-10-11 13:43:50.515155, event: all_read, request: pg_log(1.34 epoch 8 query_epoch 8) v3 -3719> 2012-10-11 13:43:51.239644 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1753, time: 2012-10-11 13:43:51.239611, event: dispatched, request: pg_log(1.34 epoch 8 query_epoch 8) v3 -3718> 2012-10-11 13:43:51.239655 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1753, time: 2012-10-11 13:43:51.239655, event: waiting_for_osdmap, request: pg_log(1.34 epoch 8 query_epoch 8) v3 -3717> 2012-10-11 13:43:51.239667 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1753, time: 2012-10-11 13:43:51.239667, event: started, request: pg_log(1.34 epoch 8 query_epoch 8) v3 -3716> 2012-10-11 13:43:51.239681 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1753, time: 2012-10-11 13:43:51.239681, event: done, request: pg_log(1.34 epoch 8 query_epoch 8) v3 -3715> 2012-10-11 13:43:51.239694 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 103788) -3714> 2012-10-11 13:43:51.239694 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2497c30 seq 3731 osr(0.c9 0x24689f0)/0x24689f0 start -3713> 2012-10-11 13:43:51.239704 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1039 ==== pg_query(0.24 epoch 8) v2 ==== 109+0+0 (3799741207 0 0) 0x20b0380 con 0x2fe2140 -3712> 2012-10-11 13:43:51.239718 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1754, time: 2012-10-11 13:43:49.990219, event: header_read, request: pg_query(0.24 epoch 8) v2 -3711> 2012-10-11 13:43:51.239729 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1754, time: 2012-10-11 13:43:49.990230, event: throttled, request: pg_query(0.24 epoch 8) v2 -3710> 2012-10-11 13:43:51.239739 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1754, time: 2012-10-11 13:43:49.990238, event: all_read, request: pg_query(0.24 epoch 8) v2 -3709> 2012-10-11 13:43:51.239749 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1754, time: 2012-10-11 13:43:51.239716, event: dispatched, request: pg_query(0.24 epoch 8) v2 -3708> 2012-10-11 13:43:51.239760 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1754, time: 2012-10-11 13:43:51.239760, event: waiting_for_osdmap, request: pg_query(0.24 epoch 8) v2 -3707> 2012-10-11 13:43:51.239771 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1754, time: 2012-10-11 13:43:51.239771, event: started, request: pg_query(0.24 epoch 8) v2 -3706> 2012-10-11 13:43:51.239787 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1754, time: 2012-10-11 13:43:51.239787, event: done, request: pg_query(0.24 epoch 8) v2 -3705> 2012-10-11 13:43:51.239800 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 109 (0xb7c748 -> 103679) -3704> 2012-10-11 13:43:51.239808 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 695 ==== pg_log(2.77 epoch 8 query_epoch 8) v3 ==== 507+0+0 (1043432797 0 0) 0x1f1aa00 con 0x2fe2280 -3703> 2012-10-11 13:43:51.239823 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1755, time: 2012-10-11 13:43:50.518491, event: header_read, request: pg_log(2.77 epoch 8 query_epoch 8) v3 -3702> 2012-10-11 13:43:51.239834 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1755, time: 2012-10-11 13:43:50.518501, event: throttled, request: pg_log(2.77 epoch 8 query_epoch 8) v3 -3701> 2012-10-11 13:43:51.239844 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1755, time: 2012-10-11 13:43:50.518515, event: all_read, request: pg_log(2.77 epoch 8 query_epoch 8) v3 -3700> 2012-10-11 13:43:51.239854 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1755, time: 2012-10-11 13:43:51.239821, event: dispatched, request: pg_log(2.77 epoch 8 query_epoch 8) v3 -3699> 2012-10-11 13:43:51.239865 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1755, time: 2012-10-11 13:43:51.239865, event: waiting_for_osdmap, request: pg_log(2.77 epoch 8 query_epoch 8) v3 -3698> 2012-10-11 13:43:51.239877 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1755, time: 2012-10-11 13:43:51.239877, event: started, request: pg_log(2.77 epoch 8 query_epoch 8) v3 -3697> 2012-10-11 13:43:51.239891 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1755, time: 2012-10-11 13:43:51.239891, event: done, request: pg_log(2.77 epoch 8 query_epoch 8) v3 -3696> 2012-10-11 13:43:51.239903 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 103172) -3695> 2012-10-11 13:43:51.239912 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1040 ==== osd pg remove(epoch 8; pg1.88; ) v1 ==== 25+0+0 (353018067 0 0) 0x20b08c0 con 0x2fe2140 -3694> 2012-10-11 13:43:51.239926 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1756, time: 2012-10-11 13:43:50.467607, event: header_read, request: osd pg remove(epoch 8; pg1.88; ) v1 -3693> 2012-10-11 13:43:51.239937 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1756, time: 2012-10-11 13:43:50.467624, event: throttled, request: osd pg remove(epoch 8; pg1.88; ) v1 -3692> 2012-10-11 13:43:51.239947 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1756, time: 2012-10-11 13:43:50.467635, event: all_read, request: osd pg remove(epoch 8; pg1.88; ) v1 -3691> 2012-10-11 13:43:51.239958 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1756, time: 2012-10-11 13:43:51.239924, event: dispatched, request: osd pg remove(epoch 8; pg1.88; ) v1 -3690> 2012-10-11 13:43:51.239968 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1756, time: 2012-10-11 13:43:51.239968, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg1.88; ) v1 -3689> 2012-10-11 13:43:51.239980 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1756, time: 2012-10-11 13:43:51.239980, event: started, request: osd pg remove(epoch 8; pg1.88; ) v1 -3688> 2012-10-11 13:43:51.239990 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.88 -3687> 2012-10-11 13:43:51.240012 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.88 0x2adba20)/0x2adba20 -3686> 2012-10-11 13:43:51.240022 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3685> 2012-10-11 13:43:51.240029 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3684> 2012-10-11 13:43:51.240036 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4227 0x2a06900 -3683> 2012-10-11 13:43:51.240046 7f440532f700 5 journal submit_entry seq 4227 len 205 (0x2a693f0) -3682> 2012-10-11 13:43:51.240055 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3681> 2012-10-11 13:43:51.240062 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3680> 2012-10-11 13:43:51.240095 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1756, time: 2012-10-11 13:43:51.240095, event: done, request: osd pg remove(epoch 8; pg1.88; ) v1 -3679> 2012-10-11 13:43:51.240112 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 103147) -3678> 2012-10-11 13:43:51.240121 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 696 ==== pg_log(2.2c epoch 8 query_epoch 8) v3 ==== 507+0+0 (1025806049 0 0) 0x1f1a500 con 0x2fe2280 -3677> 2012-10-11 13:43:51.240137 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1757, time: 2012-10-11 13:43:50.521684, event: header_read, request: pg_log(2.2c epoch 8 query_epoch 8) v3 -3676> 2012-10-11 13:43:51.240148 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1757, time: 2012-10-11 13:43:50.521696, event: throttled, request: pg_log(2.2c epoch 8 query_epoch 8) v3 -3675> 2012-10-11 13:43:51.240161 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1757, time: 2012-10-11 13:43:50.521712, event: all_read, request: pg_log(2.2c epoch 8 query_epoch 8) v3 -3674> 2012-10-11 13:43:51.240171 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1757, time: 2012-10-11 13:43:51.240135, event: dispatched, request: pg_log(2.2c epoch 8 query_epoch 8) v3 -3673> 2012-10-11 13:43:51.240182 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1757, time: 2012-10-11 13:43:51.240182, event: waiting_for_osdmap, request: pg_log(2.2c epoch 8 query_epoch 8) v3 -3672> 2012-10-11 13:43:51.240195 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1757, time: 2012-10-11 13:43:51.240195, event: started, request: pg_log(2.2c epoch 8 query_epoch 8) v3 -3671> 2012-10-11 13:43:51.240210 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1757, time: 2012-10-11 13:43:51.240210, event: done, request: pg_log(2.2c epoch 8 query_epoch 8) v3 -3670> 2012-10-11 13:43:51.240222 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 102640) -3669> 2012-10-11 13:43:51.240230 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1041 ==== osd pg remove(epoch 8; pg0.40; ) v1 ==== 25+0+0 (2336027809 0 0) 0x28d1000 con 0x2fe2140 -3668> 2012-10-11 13:43:51.240245 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1758, time: 2012-10-11 13:43:50.467644, event: header_read, request: osd pg remove(epoch 8; pg0.40; ) v1 -3667> 2012-10-11 13:43:51.240256 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1758, time: 2012-10-11 13:43:50.467648, event: throttled, request: osd pg remove(epoch 8; pg0.40; ) v1 -3666> 2012-10-11 13:43:51.240267 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1758, time: 2012-10-11 13:43:50.467669, event: all_read, request: osd pg remove(epoch 8; pg0.40; ) v1 -3665> 2012-10-11 13:43:51.240277 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1758, time: 2012-10-11 13:43:51.240243, event: dispatched, request: osd pg remove(epoch 8; pg0.40; ) v1 -3664> 2012-10-11 13:43:51.240288 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1758, time: 2012-10-11 13:43:51.240288, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.40; ) v1 -3663> 2012-10-11 13:43:51.240300 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1758, time: 2012-10-11 13:43:51.240300, event: started, request: osd pg remove(epoch 8; pg0.40; ) v1 -3662> 2012-10-11 13:43:51.240310 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.40 -3661> 2012-10-11 13:43:51.240330 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.40 0x1d71e80)/0x1d71e80 -3660> 2012-10-11 13:43:51.240340 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3659> 2012-10-11 13:43:51.240347 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3658> 2012-10-11 13:43:51.240354 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4228 0x2a06120 -3657> 2012-10-11 13:43:51.240363 7f440532f700 5 journal submit_entry seq 4228 len 205 (0x2d19810) -3656> 2012-10-11 13:43:51.240372 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3655> 2012-10-11 13:43:51.240378 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3654> 2012-10-11 13:43:51.240408 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1758, time: 2012-10-11 13:43:51.240408, event: done, request: osd pg remove(epoch 8; pg0.40; ) v1 -3653> 2012-10-11 13:43:51.240425 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 102615) -3652> 2012-10-11 13:43:51.240433 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 697 ==== pg_log(2.33 epoch 8 query_epoch 8) v3 ==== 507+0+0 (4025762130 0 0) 0x1f1a000 con 0x2fe2280 -3651> 2012-10-11 13:43:51.240451 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1759, time: 2012-10-11 13:43:50.523356, event: header_read, request: pg_log(2.33 epoch 8 query_epoch 8) v3 -3650> 2012-10-11 13:43:51.240462 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1759, time: 2012-10-11 13:43:50.523367, event: throttled, request: pg_log(2.33 epoch 8 query_epoch 8) v3 -3649> 2012-10-11 13:43:51.240472 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1759, time: 2012-10-11 13:43:50.523380, event: all_read, request: pg_log(2.33 epoch 8 query_epoch 8) v3 -3648> 2012-10-11 13:43:51.240483 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1759, time: 2012-10-11 13:43:51.240449, event: dispatched, request: pg_log(2.33 epoch 8 query_epoch 8) v3 -3647> 2012-10-11 13:43:51.240487 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1759, time: 2012-10-11 13:43:51.240487, event: waiting_for_osdmap, request: pg_log(2.33 epoch 8 query_epoch 8) v3 -3646> 2012-10-11 13:43:51.240493 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1759, time: 2012-10-11 13:43:51.240493, event: started, request: pg_log(2.33 epoch 8 query_epoch 8) v3 -3645> 2012-10-11 13:43:51.240501 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1759, time: 2012-10-11 13:43:51.240501, event: done, request: pg_log(2.33 epoch 8 query_epoch 8) v3 -3644> 2012-10-11 13:43:51.240507 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 102108) -3643> 2012-10-11 13:43:51.240509 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1042 ==== osd pg remove(epoch 8; pg1.84; ) v1 ==== 25+0+0 (1982604900 0 0) 0x24af1c0 con 0x2fe2140 -3642> 2012-10-11 13:43:51.240516 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1760, time: 2012-10-11 13:43:50.467678, event: header_read, request: osd pg remove(epoch 8; pg1.84; ) v1 -3641> 2012-10-11 13:43:51.240520 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1760, time: 2012-10-11 13:43:50.467683, event: throttled, request: osd pg remove(epoch 8; pg1.84; ) v1 -3640> 2012-10-11 13:43:51.240524 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1760, time: 2012-10-11 13:43:50.467690, event: all_read, request: osd pg remove(epoch 8; pg1.84; ) v1 -3639> 2012-10-11 13:43:51.240528 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1760, time: 2012-10-11 13:43:51.240515, event: dispatched, request: osd pg remove(epoch 8; pg1.84; ) v1 -3638> 2012-10-11 13:43:51.240531 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1760, time: 2012-10-11 13:43:51.240531, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg1.84; ) v1 -3637> 2012-10-11 13:43:51.240536 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1760, time: 2012-10-11 13:43:51.240536, event: started, request: osd pg remove(epoch 8; pg1.84; ) v1 -3636> 2012-10-11 13:43:51.240540 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.84 -3635> 2012-10-11 13:43:51.240552 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.84 0x2adbae0)/0x2adbae0 -3634> 2012-10-11 13:43:51.240555 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3633> 2012-10-11 13:43:51.240556 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3632> 2012-10-11 13:43:51.240557 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4229 0x3250d80 -3631> 2012-10-11 13:43:51.240560 7f440532f700 5 journal submit_entry seq 4229 len 205 (0x20ad0c0) -3630> 2012-10-11 13:43:51.240561 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3629> 2012-10-11 13:43:51.240563 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3628> 2012-10-11 13:43:51.240583 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1760, time: 2012-10-11 13:43:51.240583, event: done, request: osd pg remove(epoch 8; pg1.84; ) v1 -3627> 2012-10-11 13:43:51.240592 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 102083) -3626> 2012-10-11 13:43:51.240594 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 698 ==== pg_log(0.2e epoch 8 query_epoch 8) v3 ==== 507+0+0 (2189329299 0 0) 0x2d51a00 con 0x2fe2280 -3625> 2012-10-11 13:43:51.240602 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1761, time: 2012-10-11 13:43:50.523926, event: header_read, request: pg_log(0.2e epoch 8 query_epoch 8) v3 -3624> 2012-10-11 13:43:51.240606 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1761, time: 2012-10-11 13:43:50.523934, event: throttled, request: pg_log(0.2e epoch 8 query_epoch 8) v3 -3623> 2012-10-11 13:43:51.240610 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1761, time: 2012-10-11 13:43:50.523948, event: all_read, request: pg_log(0.2e epoch 8 query_epoch 8) v3 -3622> 2012-10-11 13:43:51.240613 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1761, time: 2012-10-11 13:43:51.240601, event: dispatched, request: pg_log(0.2e epoch 8 query_epoch 8) v3 -3621> 2012-10-11 13:43:51.240617 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1761, time: 2012-10-11 13:43:51.240617, event: waiting_for_osdmap, request: pg_log(0.2e epoch 8 query_epoch 8) v3 -3620> 2012-10-11 13:43:51.240622 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1761, time: 2012-10-11 13:43:51.240622, event: started, request: pg_log(0.2e epoch 8 query_epoch 8) v3 -3619> 2012-10-11 13:43:51.240630 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1761, time: 2012-10-11 13:43:51.240629, event: done, request: pg_log(0.2e epoch 8 query_epoch 8) v3 -3618> 2012-10-11 13:43:51.240635 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 101576) -3617> 2012-10-11 13:43:51.240637 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1043 ==== osd pg remove(epoch 8; pg1.85; ) v1 ==== 25+0+0 (1058036547 0 0) 0x2389e00 con 0x2fe2140 -3616> 2012-10-11 13:43:51.240643 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1762, time: 2012-10-11 13:43:50.467697, event: header_read, request: osd pg remove(epoch 8; pg1.85; ) v1 -3615> 2012-10-11 13:43:51.240647 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1762, time: 2012-10-11 13:43:50.467701, event: throttled, request: osd pg remove(epoch 8; pg1.85; ) v1 -3614> 2012-10-11 13:43:51.240651 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1762, time: 2012-10-11 13:43:50.467707, event: all_read, request: osd pg remove(epoch 8; pg1.85; ) v1 -3613> 2012-10-11 13:43:51.240655 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1762, time: 2012-10-11 13:43:51.240643, event: dispatched, request: osd pg remove(epoch 8; pg1.85; ) v1 -3612> 2012-10-11 13:43:51.240658 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1762, time: 2012-10-11 13:43:51.240658, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg1.85; ) v1 -3611> 2012-10-11 13:43:51.240663 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1762, time: 2012-10-11 13:43:51.240663, event: started, request: osd pg remove(epoch 8; pg1.85; ) v1 -3610> 2012-10-11 13:43:51.240666 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.85 -3609> 2012-10-11 13:43:51.240678 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.85 0x2adbab0)/0x2adbab0 -3608> 2012-10-11 13:43:51.240681 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3607> 2012-10-11 13:43:51.240682 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3606> 2012-10-11 13:43:51.240683 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4230 0x3250090 -3605> 2012-10-11 13:43:51.240685 7f440532f700 5 journal submit_entry seq 4230 len 205 (0x2d19390) -3604> 2012-10-11 13:43:51.240687 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3603> 2012-10-11 13:43:51.240688 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3602> 2012-10-11 13:43:51.240707 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1762, time: 2012-10-11 13:43:51.240707, event: done, request: osd pg remove(epoch 8; pg1.85; ) v1 -3601> 2012-10-11 13:43:51.240716 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 101551) -3600> 2012-10-11 13:43:51.240718 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 699 ==== pg_log(0.2d epoch 8 query_epoch 8) v3 ==== 507+0+0 (4187469932 0 0) 0x2d51500 con 0x2fe2280 -3599> 2012-10-11 13:43:51.240726 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1763, time: 2012-10-11 13:43:50.526248, event: header_read, request: pg_log(0.2d epoch 8 query_epoch 8) v3 -3598> 2012-10-11 13:43:51.240733 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1763, time: 2012-10-11 13:43:50.526258, event: throttled, request: pg_log(0.2d epoch 8 query_epoch 8) v3 -3597> 2012-10-11 13:43:51.240737 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1763, time: 2012-10-11 13:43:50.526271, event: all_read, request: pg_log(0.2d epoch 8 query_epoch 8) v3 -3596> 2012-10-11 13:43:51.240740 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1763, time: 2012-10-11 13:43:51.240725, event: dispatched, request: pg_log(0.2d epoch 8 query_epoch 8) v3 -3595> 2012-10-11 13:43:51.240744 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1763, time: 2012-10-11 13:43:51.240744, event: waiting_for_osdmap, request: pg_log(0.2d epoch 8 query_epoch 8) v3 -3594> 2012-10-11 13:43:51.240749 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1763, time: 2012-10-11 13:43:51.240749, event: started, request: pg_log(0.2d epoch 8 query_epoch 8) v3 -3593> 2012-10-11 13:43:51.240756 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1763, time: 2012-10-11 13:43:51.240756, event: done, request: pg_log(0.2d epoch 8 query_epoch 8) v3 -3592> 2012-10-11 13:43:51.240762 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 101044) -3591> 2012-10-11 13:43:51.240764 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1044 ==== osd pg remove(epoch 8; pg0.3c; ) v1 ==== 25+0+0 (2070729993 0 0) 0x2e62700 con 0x2fe2140 -3590> 2012-10-11 13:43:51.240771 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1764, time: 2012-10-11 13:43:50.467714, event: header_read, request: osd pg remove(epoch 8; pg0.3c; ) v1 -3589> 2012-10-11 13:43:51.240775 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1764, time: 2012-10-11 13:43:50.467718, event: throttled, request: osd pg remove(epoch 8; pg0.3c; ) v1 -3588> 2012-10-11 13:43:51.240779 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1764, time: 2012-10-11 13:43:50.467724, event: all_read, request: osd pg remove(epoch 8; pg0.3c; ) v1 -3587> 2012-10-11 13:43:51.240783 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1764, time: 2012-10-11 13:43:51.240770, event: dispatched, request: osd pg remove(epoch 8; pg0.3c; ) v1 -3586> 2012-10-11 13:43:51.240786 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1764, time: 2012-10-11 13:43:51.240786, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.3c; ) v1 -3585> 2012-10-11 13:43:51.240791 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1764, time: 2012-10-11 13:43:51.240791, event: started, request: osd pg remove(epoch 8; pg0.3c; ) v1 -3584> 2012-10-11 13:43:51.240795 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.3c -3583> 2012-10-11 13:43:51.240806 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.3c 0x1d71cd0)/0x1d71cd0 -3582> 2012-10-11 13:43:51.240808 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 285694 > 104857600 -3581> 2012-10-11 13:43:51.240470 7f4408335700 5 filestore(/data/osd.0) _do_op 0x31a43c0 seq 3732 osr(1.c8 0x2e38620)/0x2e38620 start -3580> 2012-10-11 13:43:51.241565 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x31a4e10 seq 3733 osr(1.c9 0x2e389f0)/0x2e389f0 start -3579> 2012-10-11 13:43:51.241580 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3578> 2012-10-11 13:43:51.242269 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3577> 2012-10-11 13:43:51.242271 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4231 0x32505a0 -3576> 2012-10-11 13:43:51.242275 7f440532f700 5 journal submit_entry seq 4231 len 205 (0x2d191b0) -3575> 2012-10-11 13:43:51.242277 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3574> 2012-10-11 13:43:51.242278 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3573> 2012-10-11 13:43:51.242307 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1764, time: 2012-10-11 13:43:51.242307, event: done, request: osd pg remove(epoch 8; pg0.3c; ) v1 -3572> 2012-10-11 13:43:51.242319 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 101019) -3571> 2012-10-11 13:43:51.242321 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 700 ==== pg_log(1.2c epoch 8 query_epoch 8) v3 ==== 507+0+0 (4148129895 0 0) 0x2d51000 con 0x2fe2280 -3570> 2012-10-11 13:43:51.242331 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1765, time: 2012-10-11 13:43:50.530673, event: header_read, request: pg_log(1.2c epoch 8 query_epoch 8) v3 -3569> 2012-10-11 13:43:51.242335 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1765, time: 2012-10-11 13:43:50.530684, event: throttled, request: pg_log(1.2c epoch 8 query_epoch 8) v3 -3568> 2012-10-11 13:43:51.242339 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1765, time: 2012-10-11 13:43:50.530698, event: all_read, request: pg_log(1.2c epoch 8 query_epoch 8) v3 -3567> 2012-10-11 13:43:51.242342 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1765, time: 2012-10-11 13:43:51.242330, event: dispatched, request: pg_log(1.2c epoch 8 query_epoch 8) v3 -3566> 2012-10-11 13:43:51.242346 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1765, time: 2012-10-11 13:43:51.242346, event: waiting_for_osdmap, request: pg_log(1.2c epoch 8 query_epoch 8) v3 -3565> 2012-10-11 13:43:51.242352 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1765, time: 2012-10-11 13:43:51.242352, event: started, request: pg_log(1.2c epoch 8 query_epoch 8) v3 -3564> 2012-10-11 13:43:51.242361 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1765, time: 2012-10-11 13:43:51.242361, event: done, request: pg_log(1.2c epoch 8 query_epoch 8) v3 -3563> 2012-10-11 13:43:51.242367 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 100512) -3562> 2012-10-11 13:43:51.242369 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1045 ==== osd pg remove(epoch 8; pg0.38; ) v1 ==== 25+0+0 (1517377380 0 0) 0x2e62540 con 0x2fe2140 -3561> 2012-10-11 13:43:51.242375 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1766, time: 2012-10-11 13:43:50.467730, event: header_read, request: osd pg remove(epoch 8; pg0.38; ) v1 -3560> 2012-10-11 13:43:51.242380 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1766, time: 2012-10-11 13:43:50.467734, event: throttled, request: osd pg remove(epoch 8; pg0.38; ) v1 -3559> 2012-10-11 13:43:51.242383 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1766, time: 2012-10-11 13:43:50.467741, event: all_read, request: osd pg remove(epoch 8; pg0.38; ) v1 -3558> 2012-10-11 13:43:51.242387 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1766, time: 2012-10-11 13:43:51.242375, event: dispatched, request: osd pg remove(epoch 8; pg0.38; ) v1 -3557> 2012-10-11 13:43:51.242391 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1766, time: 2012-10-11 13:43:51.242391, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.38; ) v1 -3556> 2012-10-11 13:43:51.242395 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1766, time: 2012-10-11 13:43:51.242395, event: started, request: osd pg remove(epoch 8; pg0.38; ) v1 -3555> 2012-10-11 13:43:51.242399 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.38 -3554> 2012-10-11 13:43:51.242413 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.38 0x1d71d90)/0x1d71d90 -3553> 2012-10-11 13:43:51.242416 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3552> 2012-10-11 13:43:51.242417 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3551> 2012-10-11 13:43:51.242418 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4232 0x31cbe10 -3550> 2012-10-11 13:43:51.242421 7f440532f700 5 journal submit_entry seq 4232 len 205 (0x204dd80) -3549> 2012-10-11 13:43:51.242422 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3548> 2012-10-11 13:43:51.242423 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3547> 2012-10-11 13:43:51.242442 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1766, time: 2012-10-11 13:43:51.242442, event: done, request: osd pg remove(epoch 8; pg0.38; ) v1 -3546> 2012-10-11 13:43:51.242450 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 100487) -3545> 2012-10-11 13:43:51.242453 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 701 ==== pg_log(0.70 epoch 8 query_epoch 8) v3 ==== 507+0+0 (1804474111 0 0) 0x2e9aa00 con 0x2fe2280 -3544> 2012-10-11 13:43:51.242461 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1767, time: 2012-10-11 13:43:50.530754, event: header_read, request: pg_log(0.70 epoch 8 query_epoch 8) v3 -3543> 2012-10-11 13:43:51.242465 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1767, time: 2012-10-11 13:43:50.530761, event: throttled, request: pg_log(0.70 epoch 8 query_epoch 8) v3 -3542> 2012-10-11 13:43:51.242468 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1767, time: 2012-10-11 13:43:50.530774, event: all_read, request: pg_log(0.70 epoch 8 query_epoch 8) v3 -3541> 2012-10-11 13:43:51.242472 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1767, time: 2012-10-11 13:43:51.242460, event: dispatched, request: pg_log(0.70 epoch 8 query_epoch 8) v3 -3540> 2012-10-11 13:43:51.242475 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1767, time: 2012-10-11 13:43:51.242475, event: waiting_for_osdmap, request: pg_log(0.70 epoch 8 query_epoch 8) v3 -3539> 2012-10-11 13:43:51.242481 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1767, time: 2012-10-11 13:43:51.242481, event: started, request: pg_log(0.70 epoch 8 query_epoch 8) v3 -3538> 2012-10-11 13:43:51.242488 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1767, time: 2012-10-11 13:43:51.242488, event: done, request: pg_log(0.70 epoch 8 query_epoch 8) v3 -3537> 2012-10-11 13:43:51.242493 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 99980) -3536> 2012-10-11 13:43:51.242495 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1046 ==== osd pg remove(epoch 8; pg0.33; ) v1 ==== 25+0+0 (3272529111 0 0) 0x2e62380 con 0x2fe2140 -3535> 2012-10-11 13:43:51.242502 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1768, time: 2012-10-11 13:43:50.467747, event: header_read, request: osd pg remove(epoch 8; pg0.33; ) v1 -3534> 2012-10-11 13:43:51.242506 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1768, time: 2012-10-11 13:43:50.467751, event: throttled, request: osd pg remove(epoch 8; pg0.33; ) v1 -3533> 2012-10-11 13:43:51.242510 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1768, time: 2012-10-11 13:43:50.467757, event: all_read, request: osd pg remove(epoch 8; pg0.33; ) v1 -3532> 2012-10-11 13:43:51.242515 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1768, time: 2012-10-11 13:43:51.242501, event: dispatched, request: osd pg remove(epoch 8; pg0.33; ) v1 -3531> 2012-10-11 13:43:51.242519 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1768, time: 2012-10-11 13:43:51.242519, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.33; ) v1 -3530> 2012-10-11 13:43:51.242524 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1768, time: 2012-10-11 13:43:51.242524, event: started, request: osd pg remove(epoch 8; pg0.33; ) v1 -3529> 2012-10-11 13:43:51.242527 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.33 -3528> 2012-10-11 13:43:51.242539 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.33 0x1d71c30)/0x1d71c30 -3527> 2012-10-11 13:43:51.242541 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 284258 > 104857600 -3526> 2012-10-11 13:43:51.243327 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x27c7fa0 seq 3735 osr(1.c4 0x2e386e0)/0x2e386e0 start -3525> 2012-10-11 13:43:51.244097 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x27c7780 seq 3736 osr(2.c7 0x24684a0)/0x24684a0 start -3524> 2012-10-11 13:43:51.244861 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x27c79b0 seq 3737 osr(0.4 0x1d71310)/0x1d71310 start -3523> 2012-10-11 13:43:51.253364 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3522> 2012-10-11 13:43:51.253372 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3521> 2012-10-11 13:43:51.253374 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4233 0x2cda090 -3520> 2012-10-11 13:43:51.253380 7f440532f700 5 journal submit_entry seq 4233 len 205 (0x204da50) -3519> 2012-10-11 13:43:51.253382 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3518> 2012-10-11 13:43:51.253384 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3517> 2012-10-11 13:43:51.253441 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1768, time: 2012-10-11 13:43:51.253440, event: done, request: osd pg remove(epoch 8; pg0.33; ) v1 -3516> 2012-10-11 13:43:51.253456 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 99955) -3515> 2012-10-11 13:43:51.253460 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 702 ==== pg_log(1.2d epoch 8 query_epoch 8) v3 ==== 507+0+0 (1779448812 0 0) 0x2e9a500 con 0x2fe2280 -3514> 2012-10-11 13:43:51.253472 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1769, time: 2012-10-11 13:43:50.531643, event: header_read, request: pg_log(1.2d epoch 8 query_epoch 8) v3 -3513> 2012-10-11 13:43:51.253476 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1769, time: 2012-10-11 13:43:50.531651, event: throttled, request: pg_log(1.2d epoch 8 query_epoch 8) v3 -3512> 2012-10-11 13:43:51.253480 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1769, time: 2012-10-11 13:43:50.531663, event: all_read, request: pg_log(1.2d epoch 8 query_epoch 8) v3 -3511> 2012-10-11 13:43:51.253484 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1769, time: 2012-10-11 13:43:51.253471, event: dispatched, request: pg_log(1.2d epoch 8 query_epoch 8) v3 -3510> 2012-10-11 13:43:51.253488 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1769, time: 2012-10-11 13:43:51.253488, event: waiting_for_osdmap, request: pg_log(1.2d epoch 8 query_epoch 8) v3 -3509> 2012-10-11 13:43:51.253495 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1769, time: 2012-10-11 13:43:51.253495, event: started, request: pg_log(1.2d epoch 8 query_epoch 8) v3 -3508> 2012-10-11 13:43:51.253504 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1769, time: 2012-10-11 13:43:51.253504, event: done, request: pg_log(1.2d epoch 8 query_epoch 8) v3 -3507> 2012-10-11 13:43:51.253510 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 99448) -3506> 2012-10-11 13:43:51.253512 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1047 ==== osd pg remove(epoch 8; pg0.32; ) v1 ==== 25+0+0 (2318576112 0 0) 0x2e621c0 con 0x2fe2140 -3505> 2012-10-11 13:43:51.253519 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1770, time: 2012-10-11 13:43:50.467764, event: header_read, request: osd pg remove(epoch 8; pg0.32; ) v1 -3504> 2012-10-11 13:43:51.253523 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1770, time: 2012-10-11 13:43:50.467767, event: throttled, request: osd pg remove(epoch 8; pg0.32; ) v1 -3503> 2012-10-11 13:43:51.253527 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1770, time: 2012-10-11 13:43:50.467773, event: all_read, request: osd pg remove(epoch 8; pg0.32; ) v1 -3502> 2012-10-11 13:43:51.253530 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1770, time: 2012-10-11 13:43:51.253518, event: dispatched, request: osd pg remove(epoch 8; pg0.32; ) v1 -3501> 2012-10-11 13:43:51.253534 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1770, time: 2012-10-11 13:43:51.253534, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.32; ) v1 -3500> 2012-10-11 13:43:51.253539 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1770, time: 2012-10-11 13:43:51.253539, event: started, request: osd pg remove(epoch 8; pg0.32; ) v1 -3499> 2012-10-11 13:43:51.253543 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.32 -3498> 2012-10-11 13:43:51.253561 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.32 0x1d71c60)/0x1d71c60 -3497> 2012-10-11 13:43:51.253569 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3496> 2012-10-11 13:43:51.253570 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3495> 2012-10-11 13:43:51.253571 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4234 0x2e552d0 -3494> 2012-10-11 13:43:51.253573 7f440532f700 5 journal submit_entry seq 4234 len 205 (0x1feecc0) -3493> 2012-10-11 13:43:51.253575 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3492> 2012-10-11 13:43:51.253576 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3491> 2012-10-11 13:43:51.253602 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1770, time: 2012-10-11 13:43:51.253602, event: done, request: osd pg remove(epoch 8; pg0.32; ) v1 -3490> 2012-10-11 13:43:51.253611 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 99423) -3489> 2012-10-11 13:43:51.253613 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 703 ==== pg_log(1.6f epoch 8 query_epoch 8) v3 ==== 507+0+0 (3215077874 0 0) 0x2e9a000 con 0x2fe2280 -3488> 2012-10-11 13:43:51.253624 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1771, time: 2012-10-11 13:43:50.533168, event: header_read, request: pg_log(1.6f epoch 8 query_epoch 8) v3 -3487> 2012-10-11 13:43:51.253628 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1771, time: 2012-10-11 13:43:50.533177, event: throttled, request: pg_log(1.6f epoch 8 query_epoch 8) v3 -3486> 2012-10-11 13:43:51.253631 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1771, time: 2012-10-11 13:43:50.533190, event: all_read, request: pg_log(1.6f epoch 8 query_epoch 8) v3 -3485> 2012-10-11 13:43:51.253635 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1771, time: 2012-10-11 13:43:51.253623, event: dispatched, request: pg_log(1.6f epoch 8 query_epoch 8) v3 -3484> 2012-10-11 13:43:51.253639 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1771, time: 2012-10-11 13:43:51.253639, event: waiting_for_osdmap, request: pg_log(1.6f epoch 8 query_epoch 8) v3 -3483> 2012-10-11 13:43:51.253644 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1771, time: 2012-10-11 13:43:51.253644, event: started, request: pg_log(1.6f epoch 8 query_epoch 8) v3 -3482> 2012-10-11 13:43:51.253652 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1771, time: 2012-10-11 13:43:51.253652, event: done, request: pg_log(1.6f epoch 8 query_epoch 8) v3 -3481> 2012-10-11 13:43:51.253657 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 98916) -3480> 2012-10-11 13:43:51.253659 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1048 ==== osd pg remove(epoch 8; pg0.2f; ) v1 ==== 25+0+0 (610163668 0 0) 0x2e62000 con 0x2fe2140 -3479> 2012-10-11 13:43:51.253666 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1772, time: 2012-10-11 13:43:50.467780, event: header_read, request: osd pg remove(epoch 8; pg0.2f; ) v1 -3478> 2012-10-11 13:43:51.253670 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1772, time: 2012-10-11 13:43:50.467784, event: throttled, request: osd pg remove(epoch 8; pg0.2f; ) v1 -3477> 2012-10-11 13:43:51.253674 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1772, time: 2012-10-11 13:43:50.467790, event: all_read, request: osd pg remove(epoch 8; pg0.2f; ) v1 -3476> 2012-10-11 13:43:51.253677 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1772, time: 2012-10-11 13:43:51.253665, event: dispatched, request: osd pg remove(epoch 8; pg0.2f; ) v1 -3475> 2012-10-11 13:43:51.253681 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1772, time: 2012-10-11 13:43:51.253681, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.2f; ) v1 -3474> 2012-10-11 13:43:51.253686 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1772, time: 2012-10-11 13:43:51.253686, event: started, request: osd pg remove(epoch 8; pg0.2f; ) v1 -3473> 2012-10-11 13:43:51.253689 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.2f -3472> 2012-10-11 13:43:51.253701 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.2f 0x1d71ac0)/0x1d71ac0 -3471> 2012-10-11 13:43:51.253704 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3470> 2012-10-11 13:43:51.253705 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3469> 2012-10-11 13:43:51.253706 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4235 0x1e41bd0 -3468> 2012-10-11 13:43:51.253708 7f440532f700 5 journal submit_entry seq 4235 len 205 (0x1feee70) -3467> 2012-10-11 13:43:51.253710 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3466> 2012-10-11 13:43:51.253711 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3465> 2012-10-11 13:43:51.253733 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1772, time: 2012-10-11 13:43:51.253733, event: done, request: osd pg remove(epoch 8; pg0.2f; ) v1 -3464> 2012-10-11 13:43:51.253741 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98891) -3463> 2012-10-11 13:43:51.253744 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 704 ==== pg_log(2.28 epoch 8 query_epoch 8) v3 ==== 507+0+0 (1619894742 0 0) 0x29e5a00 con 0x2fe2280 -3462> 2012-10-11 13:43:51.253752 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1773, time: 2012-10-11 13:43:50.535018, event: header_read, request: pg_log(2.28 epoch 8 query_epoch 8) v3 -3461> 2012-10-11 13:43:51.253756 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1773, time: 2012-10-11 13:43:50.535026, event: throttled, request: pg_log(2.28 epoch 8 query_epoch 8) v3 -3460> 2012-10-11 13:43:51.253759 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1773, time: 2012-10-11 13:43:50.535039, event: all_read, request: pg_log(2.28 epoch 8 query_epoch 8) v3 -3459> 2012-10-11 13:43:51.253763 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1773, time: 2012-10-11 13:43:51.253751, event: dispatched, request: pg_log(2.28 epoch 8 query_epoch 8) v3 -3458> 2012-10-11 13:43:51.253767 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1773, time: 2012-10-11 13:43:51.253767, event: waiting_for_osdmap, request: pg_log(2.28 epoch 8 query_epoch 8) v3 -3457> 2012-10-11 13:43:51.253772 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1773, time: 2012-10-11 13:43:51.253772, event: started, request: pg_log(2.28 epoch 8 query_epoch 8) v3 -3456> 2012-10-11 13:43:51.253780 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1773, time: 2012-10-11 13:43:51.253780, event: done, request: pg_log(2.28 epoch 8 query_epoch 8) v3 -3455> 2012-10-11 13:43:51.253785 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 98384) -3454> 2012-10-11 13:43:51.253787 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1049 ==== osd pg remove(epoch 8; pg0.2c; ) v1 ==== 25+0+0 (4279950525 0 0) 0x20a0e00 con 0x2fe2140 -3453> 2012-10-11 13:43:51.253794 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1774, time: 2012-10-11 13:43:50.467796, event: header_read, request: osd pg remove(epoch 8; pg0.2c; ) v1 -3452> 2012-10-11 13:43:51.253798 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1774, time: 2012-10-11 13:43:50.467800, event: throttled, request: osd pg remove(epoch 8; pg0.2c; ) v1 -3451> 2012-10-11 13:43:51.253802 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1774, time: 2012-10-11 13:43:50.467810, event: all_read, request: osd pg remove(epoch 8; pg0.2c; ) v1 -3450> 2012-10-11 13:43:51.253806 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1774, time: 2012-10-11 13:43:51.253793, event: dispatched, request: osd pg remove(epoch 8; pg0.2c; ) v1 -3449> 2012-10-11 13:43:51.253810 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1774, time: 2012-10-11 13:43:51.253810, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.2c; ) v1 -3448> 2012-10-11 13:43:51.253814 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1774, time: 2012-10-11 13:43:51.253814, event: started, request: osd pg remove(epoch 8; pg0.2c; ) v1 -3447> 2012-10-11 13:43:51.253818 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.2c -3446> 2012-10-11 13:43:51.253829 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.2c 0x1d71b50)/0x1d71b50 -3445> 2012-10-11 13:43:51.253832 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 282095 > 104857600 -3444> 2012-10-11 13:43:51.242244 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27c7910 seq 3734 osr(0.c5 0x24686b0)/0x24686b0 start -3443> 2012-10-11 13:43:51.256806 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x22c2a00 seq 3738 osr(0.c4 0x24686e0)/0x24686e0 start -3442> 2012-10-11 13:43:51.257708 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x22c2690 seq 3739 osr(1.3 0x27a1310)/0x27a1310 start -3441> 2012-10-11 13:43:51.258531 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1fae9b0 seq 3740 osr(0.2 0x1d712c0)/0x1d712c0 start -3440> 2012-10-11 13:43:51.258889 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3439> 2012-10-11 13:43:51.258897 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3438> 2012-10-11 13:43:51.258899 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4236 0x2e55c60 -3437> 2012-10-11 13:43:51.258905 7f440532f700 5 journal submit_entry seq 4236 len 205 (0x1fee990) -3436> 2012-10-11 13:43:51.258907 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3435> 2012-10-11 13:43:51.258910 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3434> 2012-10-11 13:43:51.258964 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1774, time: 2012-10-11 13:43:51.258964, event: done, request: osd pg remove(epoch 8; pg0.2c; ) v1 -3433> 2012-10-11 13:43:51.258985 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 98359) -3432> 2012-10-11 13:43:51.258989 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 705 ==== pg_log(0.2a epoch 8 query_epoch 8) v3 ==== 507+0+0 (4232963449 0 0) 0x29e5500 con 0x2fe2280 -3431> 2012-10-11 13:43:51.259001 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1775, time: 2012-10-11 13:43:50.536157, event: header_read, request: pg_log(0.2a epoch 8 query_epoch 8) v3 -3430> 2012-10-11 13:43:51.259005 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1775, time: 2012-10-11 13:43:50.536165, event: throttled, request: pg_log(0.2a epoch 8 query_epoch 8) v3 -3429> 2012-10-11 13:43:51.259009 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1775, time: 2012-10-11 13:43:50.536180, event: all_read, request: pg_log(0.2a epoch 8 query_epoch 8) v3 -3428> 2012-10-11 13:43:51.259013 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1775, time: 2012-10-11 13:43:51.258999, event: dispatched, request: pg_log(0.2a epoch 8 query_epoch 8) v3 -3427> 2012-10-11 13:43:51.259017 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1775, time: 2012-10-11 13:43:51.259017, event: waiting_for_osdmap, request: pg_log(0.2a epoch 8 query_epoch 8) v3 -3426> 2012-10-11 13:43:51.259023 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1775, time: 2012-10-11 13:43:51.259023, event: started, request: pg_log(0.2a epoch 8 query_epoch 8) v3 -3425> 2012-10-11 13:43:51.259032 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1775, time: 2012-10-11 13:43:51.259032, event: done, request: pg_log(0.2a epoch 8 query_epoch 8) v3 -3424> 2012-10-11 13:43:51.259038 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 97852) -3423> 2012-10-11 13:43:51.259040 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1050 ==== osd pg remove(epoch 8; pg0.24; ) v1 ==== 25+0+0 (3173111911 0 0) 0x20a0c40 con 0x2fe2140 -3422> 2012-10-11 13:43:51.259047 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1776, time: 2012-10-11 13:43:50.467817, event: header_read, request: osd pg remove(epoch 8; pg0.24; ) v1 -3421> 2012-10-11 13:43:51.259052 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1776, time: 2012-10-11 13:43:50.467821, event: throttled, request: osd pg remove(epoch 8; pg0.24; ) v1 -3420> 2012-10-11 13:43:51.259055 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1776, time: 2012-10-11 13:43:50.467846, event: all_read, request: osd pg remove(epoch 8; pg0.24; ) v1 -3419> 2012-10-11 13:43:51.259061 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1776, time: 2012-10-11 13:43:51.259047, event: dispatched, request: osd pg remove(epoch 8; pg0.24; ) v1 -3418> 2012-10-11 13:43:51.259065 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1776, time: 2012-10-11 13:43:51.259065, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.24; ) v1 -3417> 2012-10-11 13:43:51.259070 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1776, time: 2012-10-11 13:43:51.259070, event: started, request: osd pg remove(epoch 8; pg0.24; ) v1 -3416> 2012-10-11 13:43:51.259075 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.24 -3415> 2012-10-11 13:43:51.259092 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.24 0x1d718e0)/0x1d718e0 -3414> 2012-10-11 13:43:51.259096 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -3413> 2012-10-11 13:43:51.259097 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -3412> 2012-10-11 13:43:51.259098 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4237 0x2e55b40 -3411> 2012-10-11 13:43:51.259101 7f440532f700 5 journal submit_entry seq 4237 len 205 (0x1fee2a0) -3410> 2012-10-11 13:43:51.259103 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -3409> 2012-10-11 13:43:51.259104 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -3408> 2012-10-11 13:43:51.259132 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1776, time: 2012-10-11 13:43:51.259131, event: done, request: osd pg remove(epoch 8; pg0.24; ) v1 -3407> 2012-10-11 13:43:51.259142 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 97827) -3406> 2012-10-11 13:43:51.259145 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 706 ==== pg_log(2.2b epoch 8 query_epoch 8) v3 ==== 507+0+0 (3139095494 0 0) 0x29e5000 con 0x2fe2280 -3405> 2012-10-11 13:43:51.259154 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1777, time: 2012-10-11 13:43:50.537312, event: header_read, request: pg_log(2.2b epoch 8 query_epoch 8) v3 -3404> 2012-10-11 13:43:51.259158 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1777, time: 2012-10-11 13:43:50.537320, event: throttled, request: pg_log(2.2b epoch 8 query_epoch 8) v3 -3403> 2012-10-11 13:43:51.259161 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1777, time: 2012-10-11 13:43:50.537333, event: all_read, request: pg_log(2.2b epoch 8 query_epoch 8) v3 -3402> 2012-10-11 13:43:51.259165 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1777, time: 2012-10-11 13:43:51.259153, event: dispatched, request: pg_log(2.2b epoch 8 query_epoch 8) v3 -3401> 2012-10-11 13:43:51.259169 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1777, time: 2012-10-11 13:43:51.259169, event: waiting_for_osdmap, request: pg_log(2.2b epoch 8 query_epoch 8) v3 -3400> 2012-10-11 13:43:51.259174 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1777, time: 2012-10-11 13:43:51.259174, event: started, request: pg_log(2.2b epoch 8 query_epoch 8) v3 -3399> 2012-10-11 13:43:51.259182 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1777, time: 2012-10-11 13:43:51.259182, event: done, request: pg_log(2.2b epoch 8 query_epoch 8) v3 -3398> 2012-10-11 13:43:51.259188 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 97320) -3397> 2012-10-11 13:43:51.259192 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1051 ==== pg_info(1 pgs e8:1.95(1)) v3 ==== 506+0+0 (4165161235 0 0) 0x2eb41c0 con 0x2fe2140 -3396> 2012-10-11 13:43:51.259201 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1778, time: 2012-10-11 13:43:50.701785, event: header_read, request: pg_info(1 pgs e8:1.95(1)) v3 -3395> 2012-10-11 13:43:51.259207 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1778, time: 2012-10-11 13:43:50.701792, event: throttled, request: pg_info(1 pgs e8:1.95(1)) v3 -3394> 2012-10-11 13:43:51.259211 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1778, time: 2012-10-11 13:43:50.701808, event: all_read, request: pg_info(1 pgs e8:1.95(1)) v3 -3393> 2012-10-11 13:43:51.259216 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1778, time: 2012-10-11 13:43:51.259200, event: dispatched, request: pg_info(1 pgs e8:1.95(1)) v3 -3392> 2012-10-11 13:43:51.259220 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1778, time: 2012-10-11 13:43:51.259220, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.95(1)) v3 -3391> 2012-10-11 13:43:51.259225 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1778, time: 2012-10-11 13:43:51.259225, event: started, request: pg_info(1 pgs e8:1.95(1)) v3 -3390> 2012-10-11 13:43:51.259239 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1778, time: 2012-10-11 13:43:51.259239, event: done, request: pg_info(1 pgs e8:1.95(1)) v3 -3389> 2012-10-11 13:43:51.259246 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 506 (0xb7c748 -> 96814) -3388> 2012-10-11 13:43:51.259249 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 707 ==== pg_log(1.29 epoch 8 query_epoch 8) v3 ==== 507+0+0 (573841480 0 0) 0x321ea00 con 0x2fe2280 -3387> 2012-10-11 13:43:51.259255 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1779, time: 2012-10-11 13:43:50.540930, event: header_read, request: pg_log(1.29 epoch 8 query_epoch 8) v3 -3386> 2012-10-11 13:43:51.259259 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1779, time: 2012-10-11 13:43:50.540940, event: throttled, request: pg_log(1.29 epoch 8 query_epoch 8) v3 -3385> 2012-10-11 13:43:51.259263 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1779, time: 2012-10-11 13:43:50.540955, event: all_read, request: pg_log(1.29 epoch 8 query_epoch 8) v3 -3384> 2012-10-11 13:43:51.259267 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1779, time: 2012-10-11 13:43:51.259255, event: dispatched, request: pg_log(1.29 epoch 8 query_epoch 8) v3 -3383> 2012-10-11 13:43:51.259270 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1779, time: 2012-10-11 13:43:51.259270, event: waiting_for_osdmap, request: pg_log(1.29 epoch 8 query_epoch 8) v3 -3382> 2012-10-11 13:43:51.259276 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1779, time: 2012-10-11 13:43:51.259275, event: started, request: pg_log(1.29 epoch 8 query_epoch 8) v3 -3381> 2012-10-11 13:43:51.259282 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1779, time: 2012-10-11 13:43:51.259282, event: done, request: pg_log(1.29 epoch 8 query_epoch 8) v3 -3380> 2012-10-11 13:43:51.259287 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 96307) -3379> 2012-10-11 13:43:51.259289 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1052 ==== pg_info(1 pgs e8:2.fe) v3 ==== 471+0+0 (2564653273 0 0) 0x28d1380 con 0x2fe2140 -3378> 2012-10-11 13:43:51.259296 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1780, time: 2012-10-11 13:43:50.703749, event: header_read, request: pg_info(1 pgs e8:2.fe) v3 -3377> 2012-10-11 13:43:51.259300 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1780, time: 2012-10-11 13:43:50.703756, event: throttled, request: pg_info(1 pgs e8:2.fe) v3 -3376> 2012-10-11 13:43:51.259305 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1780, time: 2012-10-11 13:43:50.703784, event: all_read, request: pg_info(1 pgs e8:2.fe) v3 -3375> 2012-10-11 13:43:51.259309 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1780, time: 2012-10-11 13:43:51.259295, event: dispatched, request: pg_info(1 pgs e8:2.fe) v3 -3374> 2012-10-11 13:43:51.259313 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1780, time: 2012-10-11 13:43:51.259313, event: waiting_for_osdmap, request: pg_info(1 pgs e8:2.fe) v3 -3373> 2012-10-11 13:43:51.259317 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1780, time: 2012-10-11 13:43:51.259317, event: started, request: pg_info(1 pgs e8:2.fe) v3 -3372> 2012-10-11 13:43:51.259328 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1780, time: 2012-10-11 13:43:51.259328, event: done, request: pg_info(1 pgs e8:2.fe) v3 -3371> 2012-10-11 13:43:51.259337 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 95836) -3370> 2012-10-11 13:43:51.259339 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 708 ==== pg_log(2.6e epoch 8 query_epoch 8) v3 ==== 507+0+0 (2275001515 0 0) 0x321e500 con 0x2fe2280 -3369> 2012-10-11 13:43:51.259346 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1781, time: 2012-10-11 13:43:50.611450, event: header_read, request: pg_log(2.6e epoch 8 query_epoch 8) v3 -3368> 2012-10-11 13:43:51.259350 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1781, time: 2012-10-11 13:43:50.611472, event: throttled, request: pg_log(2.6e epoch 8 query_epoch 8) v3 -3367> 2012-10-11 13:43:51.259354 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1781, time: 2012-10-11 13:43:50.611498, event: all_read, request: pg_log(2.6e epoch 8 query_epoch 8) v3 -3366> 2012-10-11 13:43:51.259358 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1781, time: 2012-10-11 13:43:51.259346, event: dispatched, request: pg_log(2.6e epoch 8 query_epoch 8) v3 -3365> 2012-10-11 13:43:51.259362 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1781, time: 2012-10-11 13:43:51.259362, event: waiting_for_osdmap, request: pg_log(2.6e epoch 8 query_epoch 8) v3 -3364> 2012-10-11 13:43:51.259367 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1781, time: 2012-10-11 13:43:51.259367, event: started, request: pg_log(2.6e epoch 8 query_epoch 8) v3 -3363> 2012-10-11 13:43:51.259374 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1781, time: 2012-10-11 13:43:51.259373, event: done, request: pg_log(2.6e epoch 8 query_epoch 8) v3 -3362> 2012-10-11 13:43:51.259379 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 95329) -3361> 2012-10-11 13:43:51.259381 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1053 ==== pg_info(1 pgs e8:0.1e) v3 ==== 471+0+0 (3628488159 0 0) 0x24af700 con 0x2fe2140 -3360> 2012-10-11 13:43:51.259388 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1782, time: 2012-10-11 13:43:50.824896, event: header_read, request: pg_info(1 pgs e8:0.1e) v3 -3359> 2012-10-11 13:43:51.259391 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1782, time: 2012-10-11 13:43:50.824912, event: throttled, request: pg_info(1 pgs e8:0.1e) v3 -3358> 2012-10-11 13:43:51.259395 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1782, time: 2012-10-11 13:43:50.824931, event: all_read, request: pg_info(1 pgs e8:0.1e) v3 -3357> 2012-10-11 13:43:51.259399 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1782, time: 2012-10-11 13:43:51.259387, event: dispatched, request: pg_info(1 pgs e8:0.1e) v3 -3356> 2012-10-11 13:43:51.259403 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1782, time: 2012-10-11 13:43:51.259403, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.1e) v3 -3355> 2012-10-11 13:43:51.259407 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1782, time: 2012-10-11 13:43:51.259407, event: started, request: pg_info(1 pgs e8:0.1e) v3 -3354> 2012-10-11 13:43:51.259417 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1782, time: 2012-10-11 13:43:51.259417, event: done, request: pg_info(1 pgs e8:0.1e) v3 -3353> 2012-10-11 13:43:51.259423 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 94858) -3352> 2012-10-11 13:43:51.259425 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 709 ==== pg_log(2.25 epoch 8 query_epoch 8) v3 ==== 507+0+0 (1843554232 0 0) 0x321e000 con 0x2fe2280 -3351> 2012-10-11 13:43:51.259432 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1783, time: 2012-10-11 13:43:50.613234, event: header_read, request: pg_log(2.25 epoch 8 query_epoch 8) v3 -3350> 2012-10-11 13:43:51.259436 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1783, time: 2012-10-11 13:43:50.613260, event: throttled, request: pg_log(2.25 epoch 8 query_epoch 8) v3 -3349> 2012-10-11 13:43:51.259439 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1783, time: 2012-10-11 13:43:50.613281, event: all_read, request: pg_log(2.25 epoch 8 query_epoch 8) v3 -3348> 2012-10-11 13:43:51.259443 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1783, time: 2012-10-11 13:43:51.259431, event: dispatched, request: pg_log(2.25 epoch 8 query_epoch 8) v3 -3347> 2012-10-11 13:43:51.259447 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1783, time: 2012-10-11 13:43:51.259447, event: waiting_for_osdmap, request: pg_log(2.25 epoch 8 query_epoch 8) v3 -3346> 2012-10-11 13:43:51.259452 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1783, time: 2012-10-11 13:43:51.259452, event: started, request: pg_log(2.25 epoch 8 query_epoch 8) v3 -3345> 2012-10-11 13:43:51.259459 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1783, time: 2012-10-11 13:43:51.259459, event: done, request: pg_log(2.25 epoch 8 query_epoch 8) v3 -3344> 2012-10-11 13:43:51.259464 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 94351) -3343> 2012-10-11 13:43:51.259466 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1054 ==== pg_info(1 pgs e8:0.23) v3 ==== 471+0+0 (947090929 0 0) 0x3043a80 con 0x2fe2140 -3342> 2012-10-11 13:43:51.259473 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1784, time: 2012-10-11 13:43:50.824939, event: header_read, request: pg_info(1 pgs e8:0.23) v3 -3341> 2012-10-11 13:43:51.259477 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1784, time: 2012-10-11 13:43:50.824942, event: throttled, request: pg_info(1 pgs e8:0.23) v3 -3340> 2012-10-11 13:43:51.259480 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1784, time: 2012-10-11 13:43:50.824951, event: all_read, request: pg_info(1 pgs e8:0.23) v3 -3339> 2012-10-11 13:43:51.259484 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1784, time: 2012-10-11 13:43:51.259472, event: dispatched, request: pg_info(1 pgs e8:0.23) v3 -3338> 2012-10-11 13:43:51.259488 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1784, time: 2012-10-11 13:43:51.259488, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.23) v3 -3337> 2012-10-11 13:43:51.259492 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1784, time: 2012-10-11 13:43:51.259492, event: started, request: pg_info(1 pgs e8:0.23) v3 -3336> 2012-10-11 13:43:51.259502 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1784, time: 2012-10-11 13:43:51.259502, event: done, request: pg_info(1 pgs e8:0.23) v3 -3335> 2012-10-11 13:43:51.259508 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 93880) -3334> 2012-10-11 13:43:51.259510 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 710 ==== pg_log(0.27 epoch 8 query_epoch 8) v3 ==== 507+0+0 (2095304126 0 0) 0x29e3a00 con 0x2fe2280 -3333> 2012-10-11 13:43:51.259519 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1785, time: 2012-10-11 13:43:50.614967, event: header_read, request: pg_log(0.27 epoch 8 query_epoch 8) v3 -3332> 2012-10-11 13:43:51.259523 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1785, time: 2012-10-11 13:43:50.614982, event: throttled, request: pg_log(0.27 epoch 8 query_epoch 8) v3 -3331> 2012-10-11 13:43:51.259527 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1785, time: 2012-10-11 13:43:50.615004, event: all_read, request: pg_log(0.27 epoch 8 query_epoch 8) v3 -3330> 2012-10-11 13:43:51.259530 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1785, time: 2012-10-11 13:43:51.259516, event: dispatched, request: pg_log(0.27 epoch 8 query_epoch 8) v3 -3329> 2012-10-11 13:43:51.259534 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1785, time: 2012-10-11 13:43:51.259534, event: waiting_for_osdmap, request: pg_log(0.27 epoch 8 query_epoch 8) v3 -3328> 2012-10-11 13:43:51.259539 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1785, time: 2012-10-11 13:43:51.259539, event: started, request: pg_log(0.27 epoch 8 query_epoch 8) v3 -3327> 2012-10-11 13:43:51.259546 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1785, time: 2012-10-11 13:43:51.259546, event: done, request: pg_log(0.27 epoch 8 query_epoch 8) v3 -3326> 2012-10-11 13:43:51.259551 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 93373) -3325> 2012-10-11 13:43:51.259553 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1055 ==== pg_info(1 pgs e8:0.25) v3 ==== 471+0+0 (1489867022 0 0) 0x30438c0 con 0x2fe2140 -3324> 2012-10-11 13:43:51.259560 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1786, time: 2012-10-11 13:43:50.824954, event: header_read, request: pg_info(1 pgs e8:0.25) v3 -3323> 2012-10-11 13:43:51.259564 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1786, time: 2012-10-11 13:43:50.824956, event: throttled, request: pg_info(1 pgs e8:0.25) v3 -3322> 2012-10-11 13:43:51.259567 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1786, time: 2012-10-11 13:43:50.824967, event: all_read, request: pg_info(1 pgs e8:0.25) v3 -3321> 2012-10-11 13:43:51.259571 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1786, time: 2012-10-11 13:43:51.259559, event: dispatched, request: pg_info(1 pgs e8:0.25) v3 -3320> 2012-10-11 13:43:51.259570 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3418230 seq 3741 osr(2.0 0x3176330)/0x3176330 start -3319> 2012-10-11 13:43:51.259575 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1786, time: 2012-10-11 13:43:51.259575, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.25) v3 -3318> 2012-10-11 13:43:51.259579 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1786, time: 2012-10-11 13:43:51.259579, event: started, request: pg_info(1 pgs e8:0.25) v3 -3317> 2012-10-11 13:43:51.259590 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1786, time: 2012-10-11 13:43:51.259590, event: done, request: pg_info(1 pgs e8:0.25) v3 -3316> 2012-10-11 13:43:51.259596 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 92902) -3315> 2012-10-11 13:43:51.259598 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 711 ==== pg_log(1.26 epoch 8 query_epoch 8) v3 ==== 507+0+0 (1437453226 0 0) 0x29e3500 con 0x2fe2280 -3314> 2012-10-11 13:43:51.259605 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1787, time: 2012-10-11 13:43:50.617406, event: header_read, request: pg_log(1.26 epoch 8 query_epoch 8) v3 -3313> 2012-10-11 13:43:51.259609 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1787, time: 2012-10-11 13:43:50.617415, event: throttled, request: pg_log(1.26 epoch 8 query_epoch 8) v3 -3312> 2012-10-11 13:43:51.259612 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1787, time: 2012-10-11 13:43:50.617428, event: all_read, request: pg_log(1.26 epoch 8 query_epoch 8) v3 -3311> 2012-10-11 13:43:51.259616 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1787, time: 2012-10-11 13:43:51.259604, event: dispatched, request: pg_log(1.26 epoch 8 query_epoch 8) v3 -3310> 2012-10-11 13:43:51.259619 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1787, time: 2012-10-11 13:43:51.259619, event: waiting_for_osdmap, request: pg_log(1.26 epoch 8 query_epoch 8) v3 -3309> 2012-10-11 13:43:51.259624 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1787, time: 2012-10-11 13:43:51.259624, event: started, request: pg_log(1.26 epoch 8 query_epoch 8) v3 -3308> 2012-10-11 13:43:51.259631 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1787, time: 2012-10-11 13:43:51.259631, event: done, request: pg_log(1.26 epoch 8 query_epoch 8) v3 -3307> 2012-10-11 13:43:51.259636 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 92395) -3306> 2012-10-11 13:43:51.259638 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1056 ==== pg_info(1 pgs e8:1.1d) v3 ==== 471+0+0 (2303388011 0 0) 0x309a540 con 0x2fe2140 -3305> 2012-10-11 13:43:51.259645 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1788, time: 2012-10-11 13:43:50.824969, event: header_read, request: pg_info(1 pgs e8:1.1d) v3 -3304> 2012-10-11 13:43:51.259648 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1788, time: 2012-10-11 13:43:50.824972, event: throttled, request: pg_info(1 pgs e8:1.1d) v3 -3303> 2012-10-11 13:43:51.259652 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1788, time: 2012-10-11 13:43:50.824979, event: all_read, request: pg_info(1 pgs e8:1.1d) v3 -3302> 2012-10-11 13:43:51.259656 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1788, time: 2012-10-11 13:43:51.259644, event: dispatched, request: pg_info(1 pgs e8:1.1d) v3 -3301> 2012-10-11 13:43:51.259659 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1788, time: 2012-10-11 13:43:51.259659, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.1d) v3 -3300> 2012-10-11 13:43:51.259665 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1788, time: 2012-10-11 13:43:51.259665, event: started, request: pg_info(1 pgs e8:1.1d) v3 -3299> 2012-10-11 13:43:51.259676 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1788, time: 2012-10-11 13:43:51.259676, event: done, request: pg_info(1 pgs e8:1.1d) v3 -3298> 2012-10-11 13:43:51.259682 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 91924) -3297> 2012-10-11 13:43:51.259684 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 712 ==== pg_log(0.69 epoch 8 query_epoch 8) v3 ==== 507+0+0 (3950768946 0 0) 0x29e3000 con 0x2fe2280 -3296> 2012-10-11 13:43:51.259691 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1789, time: 2012-10-11 13:43:50.619639, event: header_read, request: pg_log(0.69 epoch 8 query_epoch 8) v3 -3295> 2012-10-11 13:43:51.259695 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1789, time: 2012-10-11 13:43:50.619650, event: throttled, request: pg_log(0.69 epoch 8 query_epoch 8) v3 -3294> 2012-10-11 13:43:51.259699 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1789, time: 2012-10-11 13:43:50.619663, event: all_read, request: pg_log(0.69 epoch 8 query_epoch 8) v3 -3293> 2012-10-11 13:43:51.259702 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1789, time: 2012-10-11 13:43:51.259690, event: dispatched, request: pg_log(0.69 epoch 8 query_epoch 8) v3 -3292> 2012-10-11 13:43:51.259706 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1789, time: 2012-10-11 13:43:51.259706, event: waiting_for_osdmap, request: pg_log(0.69 epoch 8 query_epoch 8) v3 -3291> 2012-10-11 13:43:51.259711 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1789, time: 2012-10-11 13:43:51.259711, event: started, request: pg_log(0.69 epoch 8 query_epoch 8) v3 -3290> 2012-10-11 13:43:51.259717 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1789, time: 2012-10-11 13:43:51.259717, event: done, request: pg_log(0.69 epoch 8 query_epoch 8) v3 -3289> 2012-10-11 13:43:51.259723 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 91417) -3288> 2012-10-11 13:43:51.259725 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1057 ==== pg_info(1 pgs e8:1.22) v3 ==== 471+0+0 (2968495231 0 0) 0x227be00 con 0x2fe2140 -3287> 2012-10-11 13:43:51.259731 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1790, time: 2012-10-11 13:43:50.824982, event: header_read, request: pg_info(1 pgs e8:1.22) v3 -3286> 2012-10-11 13:43:51.259735 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1790, time: 2012-10-11 13:43:50.824984, event: throttled, request: pg_info(1 pgs e8:1.22) v3 -3285> 2012-10-11 13:43:51.259739 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1790, time: 2012-10-11 13:43:50.824991, event: all_read, request: pg_info(1 pgs e8:1.22) v3 -3284> 2012-10-11 13:43:51.259742 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1790, time: 2012-10-11 13:43:51.259730, event: dispatched, request: pg_info(1 pgs e8:1.22) v3 -3283> 2012-10-11 13:43:51.259746 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1790, time: 2012-10-11 13:43:51.259746, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.22) v3 -3282> 2012-10-11 13:43:51.259750 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1790, time: 2012-10-11 13:43:51.259750, event: started, request: pg_info(1 pgs e8:1.22) v3 -3281> 2012-10-11 13:43:51.259760 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1790, time: 2012-10-11 13:43:51.259760, event: done, request: pg_info(1 pgs e8:1.22) v3 -3280> 2012-10-11 13:43:51.259765 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 90946) -3279> 2012-10-11 13:43:51.259767 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 713 ==== pg_log(2.67 epoch 8 query_epoch 8) v3 ==== 507+0+0 (1600689430 0 0) 0x2b56a00 con 0x2fe2280 -3278> 2012-10-11 13:43:51.259774 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1791, time: 2012-10-11 13:43:50.620171, event: header_read, request: pg_log(2.67 epoch 8 query_epoch 8) v3 -3277> 2012-10-11 13:43:51.259778 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1791, time: 2012-10-11 13:43:50.620180, event: throttled, request: pg_log(2.67 epoch 8 query_epoch 8) v3 -3276> 2012-10-11 13:43:51.259781 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1791, time: 2012-10-11 13:43:50.620195, event: all_read, request: pg_log(2.67 epoch 8 query_epoch 8) v3 -3275> 2012-10-11 13:43:51.259785 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1791, time: 2012-10-11 13:43:51.259773, event: dispatched, request: pg_log(2.67 epoch 8 query_epoch 8) v3 -3274> 2012-10-11 13:43:51.259788 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1791, time: 2012-10-11 13:43:51.259788, event: waiting_for_osdmap, request: pg_log(2.67 epoch 8 query_epoch 8) v3 -3273> 2012-10-11 13:43:51.259793 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1791, time: 2012-10-11 13:43:51.259793, event: started, request: pg_log(2.67 epoch 8 query_epoch 8) v3 -3272> 2012-10-11 13:43:51.259800 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1791, time: 2012-10-11 13:43:51.259800, event: done, request: pg_log(2.67 epoch 8 query_epoch 8) v3 -3271> 2012-10-11 13:43:51.259805 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 90439) -3270> 2012-10-11 13:43:51.259807 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1058 ==== pg_info(1 pgs e8:0.2b) v3 ==== 471+0+0 (3600663868 0 0) 0x232be00 con 0x2fe2140 -3269> 2012-10-11 13:43:51.259813 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1792, time: 2012-10-11 13:43:50.824994, event: header_read, request: pg_info(1 pgs e8:0.2b) v3 -3268> 2012-10-11 13:43:51.259820 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1792, time: 2012-10-11 13:43:50.824996, event: throttled, request: pg_info(1 pgs e8:0.2b) v3 -3267> 2012-10-11 13:43:51.259823 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1792, time: 2012-10-11 13:43:50.825005, event: all_read, request: pg_info(1 pgs e8:0.2b) v3 -3266> 2012-10-11 13:43:51.259827 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1792, time: 2012-10-11 13:43:51.259813, event: dispatched, request: pg_info(1 pgs e8:0.2b) v3 -3265> 2012-10-11 13:43:51.259830 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1792, time: 2012-10-11 13:43:51.259830, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.2b) v3 -3264> 2012-10-11 13:43:51.259835 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1792, time: 2012-10-11 13:43:51.259834, event: started, request: pg_info(1 pgs e8:0.2b) v3 -3263> 2012-10-11 13:43:51.259845 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1792, time: 2012-10-11 13:43:51.259845, event: done, request: pg_info(1 pgs e8:0.2b) v3 -3262> 2012-10-11 13:43:51.259853 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 89968) -3261> 2012-10-11 13:43:51.259855 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 714 ==== pg_log(1.68 epoch 8 query_epoch 8) v3 ==== 507+0+0 (4180207909 0 0) 0x2b56500 con 0x2fe2280 -3260> 2012-10-11 13:43:51.259861 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1793, time: 2012-10-11 13:43:50.623407, event: header_read, request: pg_log(1.68 epoch 8 query_epoch 8) v3 -3259> 2012-10-11 13:43:51.259865 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1793, time: 2012-10-11 13:43:50.623419, event: throttled, request: pg_log(1.68 epoch 8 query_epoch 8) v3 -3258> 2012-10-11 13:43:51.259869 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1793, time: 2012-10-11 13:43:50.623432, event: all_read, request: pg_log(1.68 epoch 8 query_epoch 8) v3 -3257> 2012-10-11 13:43:51.259872 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1793, time: 2012-10-11 13:43:51.259861, event: dispatched, request: pg_log(1.68 epoch 8 query_epoch 8) v3 -3256> 2012-10-11 13:43:51.259876 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1793, time: 2012-10-11 13:43:51.259876, event: waiting_for_osdmap, request: pg_log(1.68 epoch 8 query_epoch 8) v3 -3255> 2012-10-11 13:43:51.259881 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1793, time: 2012-10-11 13:43:51.259881, event: started, request: pg_log(1.68 epoch 8 query_epoch 8) v3 -3254> 2012-10-11 13:43:51.259888 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1793, time: 2012-10-11 13:43:51.259887, event: done, request: pg_log(1.68 epoch 8 query_epoch 8) v3 -3253> 2012-10-11 13:43:51.259893 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 89461) -3252> 2012-10-11 13:43:51.259895 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1059 ==== pg_info(1 pgs e8:0.30) v3 ==== 471+0+0 (3287305108 0 0) 0x2b87540 con 0x2fe2140 -3251> 2012-10-11 13:43:51.259901 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1794, time: 2012-10-11 13:43:50.825008, event: header_read, request: pg_info(1 pgs e8:0.30) v3 -3250> 2012-10-11 13:43:51.259905 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1794, time: 2012-10-11 13:43:50.825010, event: throttled, request: pg_info(1 pgs e8:0.30) v3 -3249> 2012-10-11 13:43:51.259909 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1794, time: 2012-10-11 13:43:50.825018, event: all_read, request: pg_info(1 pgs e8:0.30) v3 -3248> 2012-10-11 13:43:51.259912 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1794, time: 2012-10-11 13:43:51.259901, event: dispatched, request: pg_info(1 pgs e8:0.30) v3 -3247> 2012-10-11 13:43:51.259916 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1794, time: 2012-10-11 13:43:51.259916, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.30) v3 -3246> 2012-10-11 13:43:51.259920 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1794, time: 2012-10-11 13:43:51.259920, event: started, request: pg_info(1 pgs e8:0.30) v3 -3245> 2012-10-11 13:43:51.259930 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1794, time: 2012-10-11 13:43:51.259930, event: done, request: pg_info(1 pgs e8:0.30) v3 -3244> 2012-10-11 13:43:51.259935 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 88990) -3243> 2012-10-11 13:43:51.259937 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 715 ==== pg_log(2.60 epoch 8 query_epoch 8) v3 ==== 507+0+0 (3615173722 0 0) 0x2b56000 con 0x2fe2280 -3242> 2012-10-11 13:43:51.259944 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1795, time: 2012-10-11 13:43:50.624576, event: header_read, request: pg_log(2.60 epoch 8 query_epoch 8) v3 -3241> 2012-10-11 13:43:51.259948 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1795, time: 2012-10-11 13:43:50.624586, event: throttled, request: pg_log(2.60 epoch 8 query_epoch 8) v3 -3240> 2012-10-11 13:43:51.259951 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1795, time: 2012-10-11 13:43:50.624598, event: all_read, request: pg_log(2.60 epoch 8 query_epoch 8) v3 -3239> 2012-10-11 13:43:51.259955 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1795, time: 2012-10-11 13:43:51.259943, event: dispatched, request: pg_log(2.60 epoch 8 query_epoch 8) v3 -3238> 2012-10-11 13:43:51.259959 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1795, time: 2012-10-11 13:43:51.259959, event: waiting_for_osdmap, request: pg_log(2.60 epoch 8 query_epoch 8) v3 -3237> 2012-10-11 13:43:51.259964 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1795, time: 2012-10-11 13:43:51.259964, event: started, request: pg_log(2.60 epoch 8 query_epoch 8) v3 -3236> 2012-10-11 13:43:51.259975 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1795, time: 2012-10-11 13:43:51.259975, event: done, request: pg_log(2.60 epoch 8 query_epoch 8) v3 -3235> 2012-10-11 13:43:51.259980 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 88483) -3234> 2012-10-11 13:43:51.259982 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1060 ==== pg_info(1 pgs e8:1.24) v3 ==== 471+0+0 (2887198333 0 0) 0x2eb4540 con 0x2fe2140 -3233> 2012-10-11 13:43:51.259989 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1796, time: 2012-10-11 13:43:50.825020, event: header_read, request: pg_info(1 pgs e8:1.24) v3 -3232> 2012-10-11 13:43:51.259993 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1796, time: 2012-10-11 13:43:50.825023, event: throttled, request: pg_info(1 pgs e8:1.24) v3 -3231> 2012-10-11 13:43:51.259996 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1796, time: 2012-10-11 13:43:50.825030, event: all_read, request: pg_info(1 pgs e8:1.24) v3 -3230> 2012-10-11 13:43:51.260000 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1796, time: 2012-10-11 13:43:51.259988, event: dispatched, request: pg_info(1 pgs e8:1.24) v3 -3229> 2012-10-11 13:43:51.260004 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1796, time: 2012-10-11 13:43:51.260004, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.24) v3 -3228> 2012-10-11 13:43:51.260008 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1796, time: 2012-10-11 13:43:51.260008, event: started, request: pg_info(1 pgs e8:1.24) v3 -3227> 2012-10-11 13:43:51.260017 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1796, time: 2012-10-11 13:43:51.260017, event: done, request: pg_info(1 pgs e8:1.24) v3 -3226> 2012-10-11 13:43:51.260023 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 88012) -3225> 2012-10-11 13:43:51.260025 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 716 ==== pg_log(0.62 epoch 8 query_epoch 8) v3 ==== 507+0+0 (2295481547 0 0) 0x282ca00 con 0x2fe2280 -3224> 2012-10-11 13:43:51.260031 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1797, time: 2012-10-11 13:43:50.625986, event: header_read, request: pg_log(0.62 epoch 8 query_epoch 8) v3 -3223> 2012-10-11 13:43:51.260035 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1797, time: 2012-10-11 13:43:50.625995, event: throttled, request: pg_log(0.62 epoch 8 query_epoch 8) v3 -3222> 2012-10-11 13:43:51.260039 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1797, time: 2012-10-11 13:43:50.626009, event: all_read, request: pg_log(0.62 epoch 8 query_epoch 8) v3 -3221> 2012-10-11 13:43:51.260043 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1797, time: 2012-10-11 13:43:51.260031, event: dispatched, request: pg_log(0.62 epoch 8 query_epoch 8) v3 -3220> 2012-10-11 13:43:51.260046 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1797, time: 2012-10-11 13:43:51.260046, event: waiting_for_osdmap, request: pg_log(0.62 epoch 8 query_epoch 8) v3 -3219> 2012-10-11 13:43:51.260051 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1797, time: 2012-10-11 13:43:51.260051, event: started, request: pg_log(0.62 epoch 8 query_epoch 8) v3 -3218> 2012-10-11 13:43:51.260058 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1797, time: 2012-10-11 13:43:51.260058, event: done, request: pg_log(0.62 epoch 8 query_epoch 8) v3 -3217> 2012-10-11 13:43:51.260063 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 87505) -3216> 2012-10-11 13:43:51.260065 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1061 ==== pg_info(1 pgs e8:2.1c) v3 ==== 471+0+0 (2452812313 0 0) 0x2eb48c0 con 0x2fe2140 -3215> 2012-10-11 13:43:51.260072 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1798, time: 2012-10-11 13:43:50.825033, event: header_read, request: pg_info(1 pgs e8:2.1c) v3 -3214> 2012-10-11 13:43:51.260076 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1798, time: 2012-10-11 13:43:50.825035, event: throttled, request: pg_info(1 pgs e8:2.1c) v3 -3213> 2012-10-11 13:43:51.260079 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1798, time: 2012-10-11 13:43:50.825042, event: all_read, request: pg_info(1 pgs e8:2.1c) v3 -3212> 2012-10-11 13:43:51.260083 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1798, time: 2012-10-11 13:43:51.260071, event: dispatched, request: pg_info(1 pgs e8:2.1c) v3 -3211> 2012-10-11 13:43:51.260086 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1798, time: 2012-10-11 13:43:51.260086, event: waiting_for_osdmap, request: pg_info(1 pgs e8:2.1c) v3 -3210> 2012-10-11 13:43:51.260090 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1798, time: 2012-10-11 13:43:51.260090, event: started, request: pg_info(1 pgs e8:2.1c) v3 -3209> 2012-10-11 13:43:51.260100 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1798, time: 2012-10-11 13:43:51.260100, event: done, request: pg_info(1 pgs e8:2.1c) v3 -3208> 2012-10-11 13:43:51.260105 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 87034) -3207> 2012-10-11 13:43:51.260107 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 717 ==== pg_log(1.61 epoch 8 query_epoch 8) v3 ==== 507+0+0 (279381886 0 0) 0x282c500 con 0x2fe2280 -3206> 2012-10-11 13:43:51.260114 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1799, time: 2012-10-11 13:43:50.627079, event: header_read, request: pg_log(1.61 epoch 8 query_epoch 8) v3 -3205> 2012-10-11 13:43:51.260118 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1799, time: 2012-10-11 13:43:50.627088, event: throttled, request: pg_log(1.61 epoch 8 query_epoch 8) v3 -3204> 2012-10-11 13:43:51.260125 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1799, time: 2012-10-11 13:43:50.627100, event: all_read, request: pg_log(1.61 epoch 8 query_epoch 8) v3 -3203> 2012-10-11 13:43:51.260129 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1799, time: 2012-10-11 13:43:51.260114, event: dispatched, request: pg_log(1.61 epoch 8 query_epoch 8) v3 -3202> 2012-10-11 13:43:51.260132 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1799, time: 2012-10-11 13:43:51.260132, event: waiting_for_osdmap, request: pg_log(1.61 epoch 8 query_epoch 8) v3 -3201> 2012-10-11 13:43:51.260137 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1799, time: 2012-10-11 13:43:51.260137, event: started, request: pg_log(1.61 epoch 8 query_epoch 8) v3 -3200> 2012-10-11 13:43:51.260144 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1799, time: 2012-10-11 13:43:51.260144, event: done, request: pg_log(1.61 epoch 8 query_epoch 8) v3 -3199> 2012-10-11 13:43:51.260149 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 86527) -3198> 2012-10-11 13:43:51.260151 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1062 ==== pg_info(1 pgs e8:2.21) v3 ==== 471+0+0 (2576355629 0 0) 0x2eb4c40 con 0x2fe2140 -3197> 2012-10-11 13:43:51.260157 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1800, time: 2012-10-11 13:43:50.825045, event: header_read, request: pg_info(1 pgs e8:2.21) v3 -3196> 2012-10-11 13:43:51.260161 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1800, time: 2012-10-11 13:43:50.825047, event: throttled, request: pg_info(1 pgs e8:2.21) v3 -3195> 2012-10-11 13:43:51.260165 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1800, time: 2012-10-11 13:43:50.825056, event: all_read, request: pg_info(1 pgs e8:2.21) v3 -3194> 2012-10-11 13:43:51.260168 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1800, time: 2012-10-11 13:43:51.260157, event: dispatched, request: pg_info(1 pgs e8:2.21) v3 -3193> 2012-10-11 13:43:51.260172 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1800, time: 2012-10-11 13:43:51.260172, event: waiting_for_osdmap, request: pg_info(1 pgs e8:2.21) v3 -3192> 2012-10-11 13:43:51.260177 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1800, time: 2012-10-11 13:43:51.260177, event: started, request: pg_info(1 pgs e8:2.21) v3 -3191> 2012-10-11 13:43:51.260186 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1800, time: 2012-10-11 13:43:51.260186, event: done, request: pg_info(1 pgs e8:2.21) v3 -3190> 2012-10-11 13:43:51.260193 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 86056) -3189> 2012-10-11 13:43:51.260195 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 718 ==== pg_log(2.1d epoch 8 query_epoch 8) v3 ==== 507+0+0 (100067864 0 0) 0x282c000 con 0x2fe2280 -3188> 2012-10-11 13:43:51.260202 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1801, time: 2012-10-11 13:43:50.631273, event: header_read, request: pg_log(2.1d epoch 8 query_epoch 8) v3 -3187> 2012-10-11 13:43:51.260206 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1801, time: 2012-10-11 13:43:50.631283, event: throttled, request: pg_log(2.1d epoch 8 query_epoch 8) v3 -3186> 2012-10-11 13:43:51.260210 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1801, time: 2012-10-11 13:43:50.631296, event: all_read, request: pg_log(2.1d epoch 8 query_epoch 8) v3 -3185> 2012-10-11 13:43:51.260213 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1801, time: 2012-10-11 13:43:51.260201, event: dispatched, request: pg_log(2.1d epoch 8 query_epoch 8) v3 -3184> 2012-10-11 13:43:51.260217 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1801, time: 2012-10-11 13:43:51.260217, event: waiting_for_osdmap, request: pg_log(2.1d epoch 8 query_epoch 8) v3 -3183> 2012-10-11 13:43:51.260222 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1801, time: 2012-10-11 13:43:51.260221, event: started, request: pg_log(2.1d epoch 8 query_epoch 8) v3 -3182> 2012-10-11 13:43:51.260228 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1801, time: 2012-10-11 13:43:51.260228, event: done, request: pg_log(2.1d epoch 8 query_epoch 8) v3 -3181> 2012-10-11 13:43:51.260233 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 85549) -3180> 2012-10-11 13:43:51.260235 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1063 ==== pg_info(1 pgs e8:2.23) v3 ==== 471+0+0 (1266242004 0 0) 0x3216000 con 0x2fe2140 -3179> 2012-10-11 13:43:51.260242 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1802, time: 2012-10-11 13:43:50.825059, event: header_read, request: pg_info(1 pgs e8:2.23) v3 -3178> 2012-10-11 13:43:51.260246 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1802, time: 2012-10-11 13:43:50.825061, event: throttled, request: pg_info(1 pgs e8:2.23) v3 -3177> 2012-10-11 13:43:51.260249 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1802, time: 2012-10-11 13:43:50.825068, event: all_read, request: pg_info(1 pgs e8:2.23) v3 -3176> 2012-10-11 13:43:51.260253 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1802, time: 2012-10-11 13:43:51.260241, event: dispatched, request: pg_info(1 pgs e8:2.23) v3 -3175> 2012-10-11 13:43:51.260257 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1802, time: 2012-10-11 13:43:51.260257, event: waiting_for_osdmap, request: pg_info(1 pgs e8:2.23) v3 -3174> 2012-10-11 13:43:51.260261 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1802, time: 2012-10-11 13:43:51.260261, event: started, request: pg_info(1 pgs e8:2.23) v3 -3182> 2012-10-11 13:43:51.260270 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1802, time: 2012-10-11 13:43:51.260270, event: done, request: pg_info(1 pgs e8:2.23) v3 -3181> 2012-10-11 13:43:51.260280 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 85078) -3180> 2012-10-11 13:43:51.260282 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 719 ==== pg_log(0.1f epoch 8 query_epoch 8) v3 ==== 507+0+0 (2982145618 0 0) 0x2a0aa00 con 0x2fe2280 -3179> 2012-10-11 13:43:51.260289 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1803, time: 2012-10-11 13:43:50.632580, event: header_read, request: pg_log(0.1f epoch 8 query_epoch 8) v3 -3178> 2012-10-11 13:43:51.260293 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1803, time: 2012-10-11 13:43:50.632590, event: throttled, request: pg_log(0.1f epoch 8 query_epoch 8) v3 -3177> 2012-10-11 13:43:51.260296 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1803, time: 2012-10-11 13:43:50.632607, event: all_read, request: pg_log(0.1f epoch 8 query_epoch 8) v3 -3176> 2012-10-11 13:43:51.260300 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1803, time: 2012-10-11 13:43:51.260288, event: dispatched, request: pg_log(0.1f epoch 8 query_epoch 8) v3 -3175> 2012-10-11 13:43:51.260304 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1803, time: 2012-10-11 13:43:51.260304, event: waiting_for_osdmap, request: pg_log(0.1f epoch 8 query_epoch 8) v3 -3174> 2012-10-11 13:43:51.260308 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1803, time: 2012-10-11 13:43:51.260308, event: started, request: pg_log(0.1f epoch 8 query_epoch 8) v3 -3173> 2012-10-11 13:43:51.260315 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1803, time: 2012-10-11 13:43:51.260315, event: done, request: pg_log(0.1f epoch 8 query_epoch 8) v3 -3172> 2012-10-11 13:43:51.260320 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 84571) -3171> 2012-10-11 13:43:51.260322 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1064 ==== pg_info(1 pgs e8:0.7d) v3 ==== 471+0+0 (2585336606 0 0) 0x28c9e00 con 0x2fe2140 -3170> 2012-10-11 13:43:51.260329 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1804, time: 2012-10-11 13:43:50.825071, event: header_read, request: pg_info(1 pgs e8:0.7d) v3 -3169> 2012-10-11 13:43:51.260333 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1804, time: 2012-10-11 13:43:50.825073, event: throttled, request: pg_info(1 pgs e8:0.7d) v3 -3168> 2012-10-11 13:43:51.260337 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1804, time: 2012-10-11 13:43:50.825080, event: all_read, request: pg_info(1 pgs e8:0.7d) v3 -3167> 2012-10-11 13:43:51.260340 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1804, time: 2012-10-11 13:43:51.260328, event: dispatched, request: pg_info(1 pgs e8:0.7d) v3 -3166> 2012-10-11 13:43:51.260344 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1804, time: 2012-10-11 13:43:51.260344, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.7d) v3 -3165> 2012-10-11 13:43:51.260348 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1804, time: 2012-10-11 13:43:51.260348, event: started, request: pg_info(1 pgs e8:0.7d) v3 -3164> 2012-10-11 13:43:51.260358 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1804, time: 2012-10-11 13:43:51.260358, event: done, request: pg_info(1 pgs e8:0.7d) v3 -3163> 2012-10-11 13:43:51.260364 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 84100) -3162> 2012-10-11 13:43:51.260366 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 720 ==== pg_log(1.1e epoch 8 query_epoch 8) v3 ==== 507+0+0 (1006039418 0 0) 0x2a0a500 con 0x2fe2280 -3161> 2012-10-11 13:43:51.260373 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1805, time: 2012-10-11 13:43:50.633945, event: header_read, request: pg_log(1.1e epoch 8 query_epoch 8) v3 -3160> 2012-10-11 13:43:51.260377 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1805, time: 2012-10-11 13:43:50.633956, event: throttled, request: pg_log(1.1e epoch 8 query_epoch 8) v3 -3159> 2012-10-11 13:43:51.260381 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1805, time: 2012-10-11 13:43:50.633968, event: all_read, request: pg_log(1.1e epoch 8 query_epoch 8) v3 -3158> 2012-10-11 13:43:51.260384 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1805, time: 2012-10-11 13:43:51.260372, event: dispatched, request: pg_log(1.1e epoch 8 query_epoch 8) v3 -3157> 2012-10-11 13:43:51.260388 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1805, time: 2012-10-11 13:43:51.260388, event: waiting_for_osdmap, request: pg_log(1.1e epoch 8 query_epoch 8) v3 -3156> 2012-10-11 13:43:51.260393 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1805, time: 2012-10-11 13:43:51.260392, event: started, request: pg_log(1.1e epoch 8 query_epoch 8) v3 -3155> 2012-10-11 13:43:51.260399 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1805, time: 2012-10-11 13:43:51.260399, event: done, request: pg_log(1.1e epoch 8 query_epoch 8) v3 -3154> 2012-10-11 13:43:51.260404 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 83593) -3153> 2012-10-11 13:43:51.260406 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1065 ==== pg_info(1 pgs e8:0.39) v3 ==== 471+0+0 (2768255951 0 0) 0x2461e00 con 0x2fe2140 -3152> 2012-10-11 13:43:51.260413 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1806, time: 2012-10-11 13:43:50.825083, event: header_read, request: pg_info(1 pgs e8:0.39) v3 -3151> 2012-10-11 13:43:51.260417 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1806, time: 2012-10-11 13:43:50.825085, event: throttled, request: pg_info(1 pgs e8:0.39) v3 -3150> 2012-10-11 13:43:51.260420 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1806, time: 2012-10-11 13:43:50.825092, event: all_read, request: pg_info(1 pgs e8:0.39) v3 -3149> 2012-10-11 13:43:51.260421 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x27a71e0 seq 3742 osr(0.ad 0x2468330)/0x2468330 start -3148> 2012-10-11 13:43:51.260428 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1806, time: 2012-10-11 13:43:51.260412, event: dispatched, request: pg_info(1 pgs e8:0.39) v3 -3147> 2012-10-11 13:43:51.260432 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1806, time: 2012-10-11 13:43:51.260432, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.39) v3 -3146> 2012-10-11 13:43:51.260436 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1806, time: 2012-10-11 13:43:51.260436, event: started, request: pg_info(1 pgs e8:0.39) v3 -3145> 2012-10-11 13:43:51.260446 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1806, time: 2012-10-11 13:43:51.260446, event: done, request: pg_info(1 pgs e8:0.39) v3 -3144> 2012-10-11 13:43:51.260452 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 83122) -3143> 2012-10-11 13:43:51.260454 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 721 ==== pg_log(0.1c epoch 8 query_epoch 8) v3 ==== 507+0+0 (3805939092 0 0) 0x2a0a000 con 0x2fe2280 -3142> 2012-10-11 13:43:51.260461 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1807, time: 2012-10-11 13:43:50.640028, event: header_read, request: pg_log(0.1c epoch 8 query_epoch 8) v3 -3141> 2012-10-11 13:43:51.260465 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1807, time: 2012-10-11 13:43:50.640039, event: throttled, request: pg_log(0.1c epoch 8 query_epoch 8) v3 -3140> 2012-10-11 13:43:51.260468 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1807, time: 2012-10-11 13:43:50.640051, event: all_read, request: pg_log(0.1c epoch 8 query_epoch 8) v3 -3139> 2012-10-11 13:43:51.260472 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1807, time: 2012-10-11 13:43:51.260460, event: dispatched, request: pg_log(0.1c epoch 8 query_epoch 8) v3 -3138> 2012-10-11 13:43:51.260476 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1807, time: 2012-10-11 13:43:51.260476, event: waiting_for_osdmap, request: pg_log(0.1c epoch 8 query_epoch 8) v3 -3137> 2012-10-11 13:43:51.260480 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1807, time: 2012-10-11 13:43:51.260480, event: started, request: pg_log(0.1c epoch 8 query_epoch 8) v3 -3136> 2012-10-11 13:43:51.260487 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1807, time: 2012-10-11 13:43:51.260487, event: done, request: pg_log(0.1c epoch 8 query_epoch 8) v3 -3135> 2012-10-11 13:43:51.260492 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 82615) -3134> 2012-10-11 13:43:51.260494 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1066 ==== pg_info(1 pgs e8:0.3e) v3 ==== 471+0+0 (2756833912 0 0) 0x20a0a80 con 0x2fe2140 -3133> 2012-10-11 13:43:51.260501 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1808, time: 2012-10-11 13:43:50.825095, event: header_read, request: pg_info(1 pgs e8:0.3e) v3 -3132> 2012-10-11 13:43:51.260505 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1808, time: 2012-10-11 13:43:50.825097, event: throttled, request: pg_info(1 pgs e8:0.3e) v3 -3131> 2012-10-11 13:43:51.260508 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1808, time: 2012-10-11 13:43:50.825104, event: all_read, request: pg_info(1 pgs e8:0.3e) v3 -3130> 2012-10-11 13:43:51.260512 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1808, time: 2012-10-11 13:43:51.260500, event: dispatched, request: pg_info(1 pgs e8:0.3e) v3 -3129> 2012-10-11 13:43:51.260516 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1808, time: 2012-10-11 13:43:51.260516, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.3e) v3 -3128> 2012-10-11 13:43:51.260520 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1808, time: 2012-10-11 13:43:51.260520, event: started, request: pg_info(1 pgs e8:0.3e) v3 -3127> 2012-10-11 13:43:51.260530 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1808, time: 2012-10-11 13:43:51.260530, event: done, request: pg_info(1 pgs e8:0.3e) v3 -3126> 2012-10-11 13:43:51.260536 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 82144) -3125> 2012-10-11 13:43:51.260538 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 722 ==== pg_log(2.18 epoch 8 query_epoch 8) v3 ==== 507+0+0 (1653251064 0 0) 0x2dc2a00 con 0x2fe2280 -3124> 2012-10-11 13:43:51.260545 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1809, time: 2012-10-11 13:43:50.641489, event: header_read, request: pg_log(2.18 epoch 8 query_epoch 8) v3 -3123> 2012-10-11 13:43:51.260548 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1809, time: 2012-10-11 13:43:50.641499, event: throttled, request: pg_log(2.18 epoch 8 query_epoch 8) v3 -3122> 2012-10-11 13:43:51.260552 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1809, time: 2012-10-11 13:43:50.641513, event: all_read, request: pg_log(2.18 epoch 8 query_epoch 8) v3 -3121> 2012-10-11 13:43:51.260556 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1809, time: 2012-10-11 13:43:51.260544, event: dispatched, request: pg_log(2.18 epoch 8 query_epoch 8) v3 -3120> 2012-10-11 13:43:51.260560 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1809, time: 2012-10-11 13:43:51.260559, event: waiting_for_osdmap, request: pg_log(2.18 epoch 8 query_epoch 8) v3 -3119> 2012-10-11 13:43:51.260565 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1809, time: 2012-10-11 13:43:51.260565, event: started, request: pg_log(2.18 epoch 8 query_epoch 8) v3 -3118> 2012-10-11 13:43:51.260571 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1809, time: 2012-10-11 13:43:51.260571, event: done, request: pg_log(2.18 epoch 8 query_epoch 8) v3 -3117> 2012-10-11 13:43:51.260577 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 81637) -3116> 2012-10-11 13:43:51.260579 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1067 ==== pg_info(1 pgs e8:0.42) v3 ==== 471+0+0 (1452864259 0 0) 0x20a08c0 con 0x2fe2140 -3115> 2012-10-11 13:43:51.260589 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1810, time: 2012-10-11 13:43:50.825107, event: header_read, request: pg_info(1 pgs e8:0.42) v3 -3114> 2012-10-11 13:43:51.260593 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1810, time: 2012-10-11 13:43:50.825109, event: throttled, request: pg_info(1 pgs e8:0.42) v3 -3113> 2012-10-11 13:43:51.260596 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1810, time: 2012-10-11 13:43:50.825116, event: all_read, request: pg_info(1 pgs e8:0.42) v3 -3112> 2012-10-11 13:43:51.260600 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1810, time: 2012-10-11 13:43:51.260588, event: dispatched, request: pg_info(1 pgs e8:0.42) v3 -3111> 2012-10-11 13:43:51.260604 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1810, time: 2012-10-11 13:43:51.260603, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.42) v3 -3110> 2012-10-11 13:43:51.260608 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1810, time: 2012-10-11 13:43:51.260608, event: started, request: pg_info(1 pgs e8:0.42) v3 -3109> 2012-10-11 13:43:51.260618 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1810, time: 2012-10-11 13:43:51.260617, event: done, request: pg_info(1 pgs e8:0.42) v3 -3108> 2012-10-11 13:43:51.260623 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 81166) -3107> 2012-10-11 13:43:51.260625 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 723 ==== pg_log(0.1a epoch 8 query_epoch 8) v3 ==== 507+0+0 (1920412652 0 0) 0x2dc2500 con 0x2fe2280 -3106> 2012-10-11 13:43:51.260632 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1811, time: 2012-10-11 13:43:50.642851, event: header_read, request: pg_log(0.1a epoch 8 query_epoch 8) v3 -3105> 2012-10-11 13:43:51.260636 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1811, time: 2012-10-11 13:43:50.642860, event: throttled, request: pg_log(0.1a epoch 8 query_epoch 8) v3 -3104> 2012-10-11 13:43:51.260640 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1811, time: 2012-10-11 13:43:50.642872, event: all_read, request: pg_log(0.1a epoch 8 query_epoch 8) v3 -3103> 2012-10-11 13:43:51.260643 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1811, time: 2012-10-11 13:43:51.260632, event: dispatched, request: pg_log(0.1a epoch 8 query_epoch 8) v3 -3102> 2012-10-11 13:43:51.260647 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1811, time: 2012-10-11 13:43:51.260647, event: waiting_for_osdmap, request: pg_log(0.1a epoch 8 query_epoch 8) v3 -3101> 2012-10-11 13:43:51.260652 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1811, time: 2012-10-11 13:43:51.260652, event: started, request: pg_log(0.1a epoch 8 query_epoch 8) v3 -3100> 2012-10-11 13:43:51.260659 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1811, time: 2012-10-11 13:43:51.260659, event: done, request: pg_log(0.1a epoch 8 query_epoch 8) v3 -3099> 2012-10-11 13:43:51.260664 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 80659) -3098> 2012-10-11 13:43:51.260666 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1068 ==== pg_info(1 pgs e8:0.44) v3 ==== 471+0+0 (3866785626 0 0) 0x20a0700 con 0x2fe2140 -3097> 2012-10-11 13:43:51.260673 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1812, time: 2012-10-11 13:43:50.825118, event: header_read, request: pg_info(1 pgs e8:0.44) v3 -3096> 2012-10-11 13:43:51.260677 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1812, time: 2012-10-11 13:43:50.825120, event: throttled, request: pg_info(1 pgs e8:0.44) v3 -3095> 2012-10-11 13:43:51.260680 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1812, time: 2012-10-11 13:43:50.825127, event: all_read, request: pg_info(1 pgs e8:0.44) v3 -3094> 2012-10-11 13:43:51.260684 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1812, time: 2012-10-11 13:43:51.260672, event: dispatched, request: pg_info(1 pgs e8:0.44) v3 -3093> 2012-10-11 13:43:51.260687 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1812, time: 2012-10-11 13:43:51.260687, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.44) v3 -3092> 2012-10-11 13:43:51.260692 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1812, time: 2012-10-11 13:43:51.260692, event: started, request: pg_info(1 pgs e8:0.44) v3 -3091> 2012-10-11 13:43:51.260701 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1812, time: 2012-10-11 13:43:51.260701, event: done, request: pg_info(1 pgs e8:0.44) v3 -3090> 2012-10-11 13:43:51.260706 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 80188) -3089> 2012-10-11 13:43:51.260708 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 724 ==== pg_log(1.1b epoch 8 query_epoch 8) v3 ==== 507+0+0 (2943005035 0 0) 0x2dc2000 con 0x2fe2280 -3088> 2012-10-11 13:43:51.260715 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1813, time: 2012-10-11 13:43:50.644189, event: header_read, request: pg_log(1.1b epoch 8 query_epoch 8) v3 -3087> 2012-10-11 13:43:51.260719 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1813, time: 2012-10-11 13:43:50.644198, event: throttled, request: pg_log(1.1b epoch 8 query_epoch 8) v3 -3086> 2012-10-11 13:43:51.260722 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1813, time: 2012-10-11 13:43:50.644210, event: all_read, request: pg_log(1.1b epoch 8 query_epoch 8) v3 -3085> 2012-10-11 13:43:51.260726 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1813, time: 2012-10-11 13:43:51.260714, event: dispatched, request: pg_log(1.1b epoch 8 query_epoch 8) v3 -3084> 2012-10-11 13:43:51.260736 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1813, time: 2012-10-11 13:43:51.260736, event: waiting_for_osdmap, request: pg_log(1.1b epoch 8 query_epoch 8) v3 -3083> 2012-10-11 13:43:51.260741 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1813, time: 2012-10-11 13:43:51.260741, event: started, request: pg_log(1.1b epoch 8 query_epoch 8) v3 -3082> 2012-10-11 13:43:51.260748 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1813, time: 2012-10-11 13:43:51.260748, event: done, request: pg_log(1.1b epoch 8 query_epoch 8) v3 -3081> 2012-10-11 13:43:51.260753 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 79681) -3080> 2012-10-11 13:43:51.260755 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1069 ==== pg_info(1 pgs e8:0.4a) v3 ==== 471+0+0 (457406026 0 0) 0x20a0540 con 0x2fe2140 -3079> 2012-10-11 13:43:51.260762 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1814, time: 2012-10-11 13:43:50.825130, event: header_read, request: pg_info(1 pgs e8:0.4a) v3 -3078> 2012-10-11 13:43:51.260766 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1814, time: 2012-10-11 13:43:50.825132, event: throttled, request: pg_info(1 pgs e8:0.4a) v3 -3077> 2012-10-11 13:43:51.260769 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1814, time: 2012-10-11 13:43:50.825139, event: all_read, request: pg_info(1 pgs e8:0.4a) v3 -3076> 2012-10-11 13:43:51.260772 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1814, time: 2012-10-11 13:43:51.260761, event: dispatched, request: pg_info(1 pgs e8:0.4a) v3 -3075> 2012-10-11 13:43:51.260776 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1814, time: 2012-10-11 13:43:51.260776, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.4a) v3 -3074> 2012-10-11 13:43:51.260780 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1814, time: 2012-10-11 13:43:51.260780, event: started, request: pg_info(1 pgs e8:0.4a) v3 -3073> 2012-10-11 13:43:51.260790 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1814, time: 2012-10-11 13:43:51.260790, event: done, request: pg_info(1 pgs e8:0.4a) v3 -3072> 2012-10-11 13:43:51.260795 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 79210) -3071> 2012-10-11 13:43:51.260797 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 725 ==== pg_log(2.1a epoch 8 query_epoch 8) v3 ==== 507+0+0 (2645012951 0 0) 0x20bca00 con 0x2fe2280 -3070> 2012-10-11 13:43:51.260804 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1815, time: 2012-10-11 13:43:50.645487, event: header_read, request: pg_log(2.1a epoch 8 query_epoch 8) v3 -3069> 2012-10-11 13:43:51.260808 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1815, time: 2012-10-11 13:43:50.645497, event: throttled, request: pg_log(2.1a epoch 8 query_epoch 8) v3 -3068> 2012-10-11 13:43:51.260812 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1815, time: 2012-10-11 13:43:50.645510, event: all_read, request: pg_log(2.1a epoch 8 query_epoch 8) v3 -3067> 2012-10-11 13:43:51.260815 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1815, time: 2012-10-11 13:43:51.260803, event: dispatched, request: pg_log(2.1a epoch 8 query_epoch 8) v3 -3066> 2012-10-11 13:43:51.260819 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1815, time: 2012-10-11 13:43:51.260819, event: waiting_for_osdmap, request: pg_log(2.1a epoch 8 query_epoch 8) v3 -3065> 2012-10-11 13:43:51.260824 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1815, time: 2012-10-11 13:43:51.260824, event: started, request: pg_log(2.1a epoch 8 query_epoch 8) v3 -3064> 2012-10-11 13:43:51.260830 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1815, time: 2012-10-11 13:43:51.260830, event: done, request: pg_log(2.1a epoch 8 query_epoch 8) v3 -3063> 2012-10-11 13:43:51.260835 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 78703) -3062> 2012-10-11 13:43:51.260837 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1070 ==== pg_info(1 pgs e8:0.4f) v3 ==== 471+0+0 (3462918858 0 0) 0x20a0380 con 0x2fe2140 -3061> 2012-10-11 13:43:51.260844 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1816, time: 2012-10-11 13:43:50.825142, event: header_read, request: pg_info(1 pgs e8:0.4f) v3 -3060> 2012-10-11 13:43:51.260848 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1816, time: 2012-10-11 13:43:50.825144, event: throttled, request: pg_info(1 pgs e8:0.4f) v3 -3059> 2012-10-11 13:43:51.260851 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1816, time: 2012-10-11 13:43:50.825151, event: all_read, request: pg_info(1 pgs e8:0.4f) v3 -3058> 2012-10-11 13:43:51.260855 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1816, time: 2012-10-11 13:43:51.260843, event: dispatched, request: pg_info(1 pgs e8:0.4f) v3 -3057> 2012-10-11 13:43:51.260858 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1816, time: 2012-10-11 13:43:51.260858, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.4f) v3 -3056> 2012-10-11 13:43:51.260862 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1816, time: 2012-10-11 13:43:51.260862, event: started, request: pg_info(1 pgs e8:0.4f) v3 -3055> 2012-10-11 13:43:51.260873 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1816, time: 2012-10-11 13:43:51.260873, event: done, request: pg_info(1 pgs e8:0.4f) v3 -3054> 2012-10-11 13:43:51.260878 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 78232) -3053> 2012-10-11 13:43:51.260880 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 726 ==== pg_log(1.19 epoch 8 query_epoch 8) v3 ==== 507+0+0 (3395552632 0 0) 0x20bc500 con 0x2fe2280 -3052> 2012-10-11 13:43:51.260892 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1817, time: 2012-10-11 13:43:50.647512, event: header_read, request: pg_log(1.19 epoch 8 query_epoch 8) v3 -3051> 2012-10-11 13:43:51.260896 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1817, time: 2012-10-11 13:43:50.647522, event: throttled, request: pg_log(1.19 epoch 8 query_epoch 8) v3 -3050> 2012-10-11 13:43:51.260899 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1817, time: 2012-10-11 13:43:50.647535, event: all_read, request: pg_log(1.19 epoch 8 query_epoch 8) v3 -3049> 2012-10-11 13:43:51.260903 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1817, time: 2012-10-11 13:43:51.260888, event: dispatched, request: pg_log(1.19 epoch 8 query_epoch 8) v3 -3048> 2012-10-11 13:43:51.260906 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1817, time: 2012-10-11 13:43:51.260906, event: waiting_for_osdmap, request: pg_log(1.19 epoch 8 query_epoch 8) v3 -3047> 2012-10-11 13:43:51.260911 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1817, time: 2012-10-11 13:43:51.260911, event: started, request: pg_log(1.19 epoch 8 query_epoch 8) v3 -3046> 2012-10-11 13:43:51.260922 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1817, time: 2012-10-11 13:43:51.260921, event: done, request: pg_log(1.19 epoch 8 query_epoch 8) v3 -3045> 2012-10-11 13:43:51.260927 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 77725) -3044> 2012-10-11 13:43:51.260929 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1071 ==== pg_info(1 pgs e8:1.2a) v3 ==== 471+0+0 (3032060608 0 0) 0x20a01c0 con 0x2fe2140 -3043> 2012-10-11 13:43:51.260936 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1818, time: 2012-10-11 13:43:50.825154, event: header_read, request: pg_info(1 pgs e8:1.2a) v3 -3042> 2012-10-11 13:43:51.260940 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1818, time: 2012-10-11 13:43:50.825156, event: throttled, request: pg_info(1 pgs e8:1.2a) v3 -3041> 2012-10-11 13:43:51.260943 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1818, time: 2012-10-11 13:43:50.825163, event: all_read, request: pg_info(1 pgs e8:1.2a) v3 -3040> 2012-10-11 13:43:51.260947 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1818, time: 2012-10-11 13:43:51.260935, event: dispatched, request: pg_info(1 pgs e8:1.2a) v3 -3039> 2012-10-11 13:43:51.260951 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1818, time: 2012-10-11 13:43:51.260951, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.2a) v3 -3038> 2012-10-11 13:43:51.260955 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1818, time: 2012-10-11 13:43:51.260955, event: started, request: pg_info(1 pgs e8:1.2a) v3 -3037> 2012-10-11 13:43:51.260964 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1818, time: 2012-10-11 13:43:51.260964, event: done, request: pg_info(1 pgs e8:1.2a) v3 -3036> 2012-10-11 13:43:51.260970 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 77254) -3035> 2012-10-11 13:43:51.260972 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 727 ==== pg_log(2.11 epoch 8 query_epoch 8) v3 ==== 507+0+0 (4289901712 0 0) 0x20bc000 con 0x2fe2280 -3034> 2012-10-11 13:43:51.260979 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1819, time: 2012-10-11 13:43:50.653684, event: header_read, request: pg_log(2.11 epoch 8 query_epoch 8) v3 -3033> 2012-10-11 13:43:51.260983 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1819, time: 2012-10-11 13:43:50.653694, event: throttled, request: pg_log(2.11 epoch 8 query_epoch 8) v3 -3032> 2012-10-11 13:43:51.260987 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1819, time: 2012-10-11 13:43:50.653707, event: all_read, request: pg_log(2.11 epoch 8 query_epoch 8) v3 -3031> 2012-10-11 13:43:51.260990 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1819, time: 2012-10-11 13:43:51.260979, event: dispatched, request: pg_log(2.11 epoch 8 query_epoch 8) v3 -3030> 2012-10-11 13:43:51.260994 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1819, time: 2012-10-11 13:43:51.260994, event: waiting_for_osdmap, request: pg_log(2.11 epoch 8 query_epoch 8) v3 -3029> 2012-10-11 13:43:51.260999 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1819, time: 2012-10-11 13:43:51.260999, event: started, request: pg_log(2.11 epoch 8 query_epoch 8) v3 -3028> 2012-10-11 13:43:51.261006 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1819, time: 2012-10-11 13:43:51.261006, event: done, request: pg_log(2.11 epoch 8 query_epoch 8) v3 -3027> 2012-10-11 13:43:51.261011 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 76747) -3026> 2012-10-11 13:43:51.261013 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1072 ==== pg_info(1 pgs e8:1.2f) v3 ==== 471+0+0 (2844872831 0 0) 0x2ca71c0 con 0x2fe2140 -3025> 2012-10-11 13:43:51.261020 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1820, time: 2012-10-11 13:43:50.825166, event: header_read, request: pg_info(1 pgs e8:1.2f) v3 -3024> 2012-10-11 13:43:51.261024 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1820, time: 2012-10-11 13:43:50.825168, event: throttled, request: pg_info(1 pgs e8:1.2f) v3 -3023> 2012-10-11 13:43:51.261028 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1820, time: 2012-10-11 13:43:50.825175, event: all_read, request: pg_info(1 pgs e8:1.2f) v3 -3022> 2012-10-11 13:43:51.261032 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1820, time: 2012-10-11 13:43:51.261019, event: dispatched, request: pg_info(1 pgs e8:1.2f) v3 -3021> 2012-10-11 13:43:51.261036 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1820, time: 2012-10-11 13:43:51.261036, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.2f) v3 -3020> 2012-10-11 13:43:51.261043 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1820, time: 2012-10-11 13:43:51.261043, event: started, request: pg_info(1 pgs e8:1.2f) v3 -3019> 2012-10-11 13:43:51.261054 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1820, time: 2012-10-11 13:43:51.261054, event: done, request: pg_info(1 pgs e8:1.2f) v3 -3018> 2012-10-11 13:43:51.261061 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 76276) -3017> 2012-10-11 13:43:51.261063 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 728 ==== pg_log(0.13 epoch 8 query_epoch 8) v3 ==== 507+0+0 (456464476 0 0) 0x3237a00 con 0x2fe2280 -3016> 2012-10-11 13:43:51.261071 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1821, time: 2012-10-11 13:43:50.655423, event: header_read, request: pg_log(0.13 epoch 8 query_epoch 8) v3 -3015> 2012-10-11 13:43:51.261075 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1821, time: 2012-10-11 13:43:50.655432, event: throttled, request: pg_log(0.13 epoch 8 query_epoch 8) v3 -3014> 2012-10-11 13:43:51.261082 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1821, time: 2012-10-11 13:43:50.655447, event: all_read, request: pg_log(0.13 epoch 8 query_epoch 8) v3 -3013> 2012-10-11 13:43:51.261086 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1821, time: 2012-10-11 13:43:51.261070, event: dispatched, request: pg_log(0.13 epoch 8 query_epoch 8) v3 -3012> 2012-10-11 13:43:51.261091 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1821, time: 2012-10-11 13:43:51.261091, event: waiting_for_osdmap, request: pg_log(0.13 epoch 8 query_epoch 8) v3 -3011> 2012-10-11 13:43:51.261096 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1821, time: 2012-10-11 13:43:51.261096, event: started, request: pg_log(0.13 epoch 8 query_epoch 8) v3 -3010> 2012-10-11 13:43:51.261104 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1821, time: 2012-10-11 13:43:51.261104, event: done, request: pg_log(0.13 epoch 8 query_epoch 8) v3 -3009> 2012-10-11 13:43:51.261110 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 75769) -3008> 2012-10-11 13:43:51.261112 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1073 ==== pg_info(1 pgs e8:1.38) v3 ==== 471+0+0 (366213631 0 0) 0x2ca7380 con 0x2fe2140 -3007> 2012-10-11 13:43:51.261119 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1822, time: 2012-10-11 13:43:50.825178, event: header_read, request: pg_info(1 pgs e8:1.38) v3 -3006> 2012-10-11 13:43:51.261124 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1822, time: 2012-10-11 13:43:50.825180, event: throttled, request: pg_info(1 pgs e8:1.38) v3 -3005> 2012-10-11 13:43:51.261128 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1822, time: 2012-10-11 13:43:50.825187, event: all_read, request: pg_info(1 pgs e8:1.38) v3 -3004> 2012-10-11 13:43:51.261132 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1822, time: 2012-10-11 13:43:51.261118, event: dispatched, request: pg_info(1 pgs e8:1.38) v3 -3003> 2012-10-11 13:43:51.261137 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1822, time: 2012-10-11 13:43:51.261136, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.38) v3 -3002> 2012-10-11 13:43:51.261142 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1822, time: 2012-10-11 13:43:51.261142, event: started, request: pg_info(1 pgs e8:1.38) v3 -3001> 2012-10-11 13:43:51.261152 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1822, time: 2012-10-11 13:43:51.261152, event: done, request: pg_info(1 pgs e8:1.38) v3 -3000> 2012-10-11 13:43:51.261159 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 75298) -2999> 2012-10-11 13:43:51.261161 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 729 ==== pg_log(1.12 epoch 8 query_epoch 8) v3 ==== 507+0+0 (1916700745 0 0) 0x3237500 con 0x2fe2280 -2998> 2012-10-11 13:43:51.261168 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1823, time: 2012-10-11 13:43:50.656709, event: header_read, request: pg_log(1.12 epoch 8 query_epoch 8) v3 -2997> 2012-10-11 13:43:51.261173 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1823, time: 2012-10-11 13:43:50.656719, event: throttled, request: pg_log(1.12 epoch 8 query_epoch 8) v3 -2996> 2012-10-11 13:43:51.261177 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1823, time: 2012-10-11 13:43:50.656731, event: all_read, request: pg_log(1.12 epoch 8 query_epoch 8) v3 -2995> 2012-10-11 13:43:51.261181 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1823, time: 2012-10-11 13:43:51.261167, event: dispatched, request: pg_log(1.12 epoch 8 query_epoch 8) v3 -2994> 2012-10-11 13:43:51.261186 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1823, time: 2012-10-11 13:43:51.261186, event: waiting_for_osdmap, request: pg_log(1.12 epoch 8 query_epoch 8) v3 -2993> 2012-10-11 13:43:51.261191 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1823, time: 2012-10-11 13:43:51.261191, event: started, request: pg_log(1.12 epoch 8 query_epoch 8) v3 -2992> 2012-10-11 13:43:51.261199 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1823, time: 2012-10-11 13:43:51.261199, event: done, request: pg_log(1.12 epoch 8 query_epoch 8) v3 -2991> 2012-10-11 13:43:51.261205 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 507 (0xb7c748 -> 74791) -2990> 2012-10-11 13:43:51.261207 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1074 ==== pg_info(1 pgs e8:1.3d) v3 ==== 471+0+0 (1613744809 0 0) 0x2ca7540 con 0x2fe2140 -2989> 2012-10-11 13:43:51.261215 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1824, time: 2012-10-11 13:43:50.825190, event: header_read, request: pg_info(1 pgs e8:1.3d) v3 -2988> 2012-10-11 13:43:51.261220 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1824, time: 2012-10-11 13:43:50.825192, event: throttled, request: pg_info(1 pgs e8:1.3d) v3 -2987> 2012-10-11 13:43:51.261223 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1824, time: 2012-10-11 13:43:50.825199, event: all_read, request: pg_info(1 pgs e8:1.3d) v3 -2986> 2012-10-11 13:43:51.261227 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1824, time: 2012-10-11 13:43:51.261215, event: dispatched, request: pg_info(1 pgs e8:1.3d) v3 -2985> 2012-10-11 13:43:51.261230 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1824, time: 2012-10-11 13:43:51.261230, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.3d) v3 -2984> 2012-10-11 13:43:51.261235 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1824, time: 2012-10-11 13:43:51.261235, event: started, request: pg_info(1 pgs e8:1.3d) v3 -2983> 2012-10-11 13:43:51.261246 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1824, time: 2012-10-11 13:43:51.261246, event: done, request: pg_info(1 pgs e8:1.3d) v3 -2982> 2012-10-11 13:43:51.261268 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 74320) -2981> 2012-10-11 13:43:51.261271 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 730 ==== pg_notify(0.56,0.57,1.56,2.54,2.55 epoch 8) v4 ==== 2247+0+0 (4004716041 0 0) 0x28c9700 con 0x2fe2280 -2980> 2012-10-11 13:43:51.261280 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1825, time: 2012-10-11 13:43:50.686816, event: header_read, request: pg_notify(0.56,0.57,1.56,2.54,2.55 epoch 8) v4 -2979> 2012-10-11 13:43:51.261285 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1825, time: 2012-10-11 13:43:50.686825, event: throttled, request: pg_notify(0.56,0.57,1.56,2.54,2.55 epoch 8) v4 -2978> 2012-10-11 13:43:51.261289 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1825, time: 2012-10-11 13:43:50.686853, event: all_read, request: pg_notify(0.56,0.57,1.56,2.54,2.55 epoch 8) v4 -2977> 2012-10-11 13:43:51.261293 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1825, time: 2012-10-11 13:43:51.261279, event: dispatched, request: pg_notify(0.56,0.57,1.56,2.54,2.55 epoch 8) v4 -2976> 2012-10-11 13:43:51.261298 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1825, time: 2012-10-11 13:43:51.261298, event: waiting_for_osdmap, request: pg_notify(0.56,0.57,1.56,2.54,2.55 epoch 8) v4 -2975> 2012-10-11 13:43:51.261304 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1825, time: 2012-10-11 13:43:51.261303, event: started, request: pg_notify(0.56,0.57,1.56,2.54,2.55 epoch 8) v4 -2974> 2012-10-11 13:43:51.261340 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1825, time: 2012-10-11 13:43:51.261340, event: done, request: pg_notify(0.56,0.57,1.56,2.54,2.55 epoch 8) v4 -2973> 2012-10-11 13:43:51.261349 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 2247 (0xb7c748 -> 72073) -2972> 2012-10-11 13:43:51.261353 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1075 ==== pg_info(1 pgs e8:1.41) v3 ==== 471+0+0 (182832453 0 0) 0x2ca7700 con 0x2fe2140 -2971> 2012-10-11 13:43:51.261361 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1826, time: 2012-10-11 13:43:50.825201, event: header_read, request: pg_info(1 pgs e8:1.41) v3 -2970> 2012-10-11 13:43:51.261367 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1826, time: 2012-10-11 13:43:50.825204, event: throttled, request: pg_info(1 pgs e8:1.41) v3 -2969> 2012-10-11 13:43:51.261367 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x27a7190 seq 3743 osr(1.ac 0x2e38360)/0x2e38360 start -2968> 2012-10-11 13:43:51.262049 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3418190 seq 3744 osr(0.c2 0x2468740)/0x2468740 start -2967> 2012-10-11 13:43:51.262853 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27a7140 seq 3745 osr(2.af 0x3176de0)/0x3176de0 start -2966> 2012-10-11 13:43:51.261372 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1826, time: 2012-10-11 13:43:50.825211, event: all_read, request: pg_info(1 pgs e8:1.41) v3 -2965> 2012-10-11 13:43:51.262973 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1826, time: 2012-10-11 13:43:51.261360, event: dispatched, request: pg_info(1 pgs e8:1.41) v3 -2964> 2012-10-11 13:43:51.262985 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1826, time: 2012-10-11 13:43:51.262985, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.41) v3 -2963> 2012-10-11 13:43:51.262993 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1826, time: 2012-10-11 13:43:51.262993, event: started, request: pg_info(1 pgs e8:1.41) v3 -2962> 2012-10-11 13:43:51.263008 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1826, time: 2012-10-11 13:43:51.263008, event: done, request: pg_info(1 pgs e8:1.41) v3 -2961> 2012-10-11 13:43:51.263019 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 71602) -2960> 2012-10-11 13:43:51.263024 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 731 ==== pg_info(1 pgs e8:1.7(2)) v3 ==== 549+0+0 (743193904 0 0) 0x24be380 con 0x2fe2280 -2959> 2012-10-11 13:43:51.263053 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1827, time: 2012-10-11 13:43:50.727435, event: header_read, request: pg_info(1 pgs e8:1.7(2)) v3 -2958> 2012-10-11 13:43:51.263060 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1827, time: 2012-10-11 13:43:50.727446, event: throttled, request: pg_info(1 pgs e8:1.7(2)) v3 -2957> 2012-10-11 13:43:51.263065 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1827, time: 2012-10-11 13:43:50.727463, event: all_read, request: pg_info(1 pgs e8:1.7(2)) v3 -2956> 2012-10-11 13:43:51.263070 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1827, time: 2012-10-11 13:43:51.263051, event: dispatched, request: pg_info(1 pgs e8:1.7(2)) v3 -2955> 2012-10-11 13:43:51.263075 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1827, time: 2012-10-11 13:43:51.263074, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.7(2)) v3 -2954> 2012-10-11 13:43:51.263081 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1827, time: 2012-10-11 13:43:51.263081, event: started, request: pg_info(1 pgs e8:1.7(2)) v3 -2953> 2012-10-11 13:43:51.263096 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1827, time: 2012-10-11 13:43:51.263095, event: done, request: pg_info(1 pgs e8:1.7(2)) v3 -2952> 2012-10-11 13:43:51.263105 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 549 (0xb7c748 -> 71053) -2951> 2012-10-11 13:43:51.263109 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1076 ==== pg_info(1 pgs e8:1.43) v3 ==== 471+0+0 (3746349051 0 0) 0x2ca78c0 con 0x2fe2140 -2950> 2012-10-11 13:43:51.263118 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1828, time: 2012-10-11 13:43:50.825213, event: header_read, request: pg_info(1 pgs e8:1.43) v3 -2949> 2012-10-11 13:43:51.263124 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1828, time: 2012-10-11 13:43:50.825215, event: throttled, request: pg_info(1 pgs e8:1.43) v3 -2948> 2012-10-11 13:43:51.263129 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1828, time: 2012-10-11 13:43:50.825222, event: all_read, request: pg_info(1 pgs e8:1.43) v3 -2947> 2012-10-11 13:43:51.263133 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1828, time: 2012-10-11 13:43:51.263117, event: dispatched, request: pg_info(1 pgs e8:1.43) v3 -2946> 2012-10-11 13:43:51.263138 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1828, time: 2012-10-11 13:43:51.263138, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.43) v3 -2945> 2012-10-11 13:43:51.263144 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1828, time: 2012-10-11 13:43:51.263143, event: started, request: pg_info(1 pgs e8:1.43) v3 -2944> 2012-10-11 13:43:51.263156 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1828, time: 2012-10-11 13:43:51.263156, event: done, request: pg_info(1 pgs e8:1.43) v3 -2943> 2012-10-11 13:43:51.263164 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 70582) -2942> 2012-10-11 13:43:51.263168 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 732 ==== pg_info(1 pgs e8:1.f4(2)) v3 ==== 549+0+0 (3782456422 0 0) 0x2b87700 con 0x2fe2280 -2941> 2012-10-11 13:43:51.263177 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1829, time: 2012-10-11 13:43:50.727469, event: header_read, request: pg_info(1 pgs e8:1.f4(2)) v3 -2940> 2012-10-11 13:43:51.263182 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1829, time: 2012-10-11 13:43:50.727473, event: throttled, request: pg_info(1 pgs e8:1.f4(2)) v3 -2939> 2012-10-11 13:43:51.263188 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1829, time: 2012-10-11 13:43:50.727499, event: all_read, request: pg_info(1 pgs e8:1.f4(2)) v3 -2938> 2012-10-11 13:43:51.263193 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1829, time: 2012-10-11 13:43:51.263176, event: dispatched, request: pg_info(1 pgs e8:1.f4(2)) v3 -2937> 2012-10-11 13:43:51.263198 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1829, time: 2012-10-11 13:43:51.263198, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.f4(2)) v3 -2936> 2012-10-11 13:43:51.263204 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1829, time: 2012-10-11 13:43:51.263204, event: started, request: pg_info(1 pgs e8:1.f4(2)) v3 -2935> 2012-10-11 13:43:51.263218 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1829, time: 2012-10-11 13:43:51.263218, event: done, request: pg_info(1 pgs e8:1.f4(2)) v3 -2934> 2012-10-11 13:43:51.263226 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 549 (0xb7c748 -> 70033) -2933> 2012-10-11 13:43:51.263230 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1077 ==== pg_info(1 pgs e8:1.49) v3 ==== 471+0+0 (244435067 0 0) 0x2ca7a80 con 0x2fe2140 -2932> 2012-10-11 13:43:51.263238 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1830, time: 2012-10-11 13:43:50.825225, event: header_read, request: pg_info(1 pgs e8:1.49) v3 -2931> 2012-10-11 13:43:51.263243 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1830, time: 2012-10-11 13:43:50.825227, event: throttled, request: pg_info(1 pgs e8:1.49) v3 -2930> 2012-10-11 13:43:51.263248 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1830, time: 2012-10-11 13:43:50.825234, event: all_read, request: pg_info(1 pgs e8:1.49) v3 -2929> 2012-10-11 13:43:51.263253 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1830, time: 2012-10-11 13:43:51.263237, event: dispatched, request: pg_info(1 pgs e8:1.49) v3 -2928> 2012-10-11 13:43:51.263258 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1830, time: 2012-10-11 13:43:51.263258, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.49) v3 -2927> 2012-10-11 13:43:51.263264 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1830, time: 2012-10-11 13:43:51.263264, event: started, request: pg_info(1 pgs e8:1.49) v3 -2926> 2012-10-11 13:43:51.263275 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1830, time: 2012-10-11 13:43:51.263275, event: done, request: pg_info(1 pgs e8:1.49) v3 -2925> 2012-10-11 13:43:51.263283 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 69562) -2924> 2012-10-11 13:43:51.263286 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 733 ==== osd pg remove(epoch 8; pg1.92; ) v1 ==== 25+0+0 (1094670323 0 0) 0x309a700 con 0x2fe2280 -2923> 2012-10-11 13:43:51.263294 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1831, time: 2012-10-11 13:43:50.871862, event: header_read, request: osd pg remove(epoch 8; pg1.92; ) v1 -2922> 2012-10-11 13:43:51.263300 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1831, time: 2012-10-11 13:43:50.871877, event: throttled, request: osd pg remove(epoch 8; pg1.92; ) v1 -2921> 2012-10-11 13:43:51.263305 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1831, time: 2012-10-11 13:43:50.871887, event: all_read, request: osd pg remove(epoch 8; pg1.92; ) v1 -2920> 2012-10-11 13:43:51.263310 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1831, time: 2012-10-11 13:43:51.263294, event: dispatched, request: osd pg remove(epoch 8; pg1.92; ) v1 -2919> 2012-10-11 13:43:51.263315 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1831, time: 2012-10-11 13:43:51.263315, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg1.92; ) v1 -2918> 2012-10-11 13:43:51.263322 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1831, time: 2012-10-11 13:43:51.263321, event: started, request: osd pg remove(epoch 8; pg1.92; ) v1 -2917> 2012-10-11 13:43:51.263327 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.92 -2916> 2012-10-11 13:43:51.263354 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.92 0x2adbc40)/0x2adbc40 -2915> 2012-10-11 13:43:51.263359 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -2914> 2012-10-11 13:43:51.263361 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -2913> 2012-10-11 13:43:51.263363 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4238 0x2d2dab0 -2912> 2012-10-11 13:43:51.263366 7f440532f700 5 journal submit_entry seq 4238 len 205 (0x2f0e5d0) -2911> 2012-10-11 13:43:51.263370 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -2910> 2012-10-11 13:43:51.263372 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -2909> 2012-10-11 13:43:51.263412 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1831, time: 2012-10-11 13:43:51.263412, event: done, request: osd pg remove(epoch 8; pg1.92; ) v1 -2908> 2012-10-11 13:43:51.263424 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 69537) -2907> 2012-10-11 13:43:51.263428 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1078 ==== pg_info(1 pgs e8:1.4e) v3 ==== 471+0+0 (1830428305 0 0) 0x2ca7c40 con 0x2fe2140 -2906> 2012-10-11 13:43:51.263438 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1832, time: 2012-10-11 13:43:50.937155, event: header_read, request: pg_info(1 pgs e8:1.4e) v3 -2905> 2012-10-11 13:43:51.263444 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1832, time: 2012-10-11 13:43:50.937173, event: throttled, request: pg_info(1 pgs e8:1.4e) v3 -2904> 2012-10-11 13:43:51.263448 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1832, time: 2012-10-11 13:43:50.937191, event: all_read, request: pg_info(1 pgs e8:1.4e) v3 -2903> 2012-10-11 13:43:51.263453 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1832, time: 2012-10-11 13:43:51.263437, event: dispatched, request: pg_info(1 pgs e8:1.4e) v3 -2902> 2012-10-11 13:43:51.263458 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1832, time: 2012-10-11 13:43:51.263458, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.4e) v3 -2901> 2012-10-11 13:43:51.263464 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1832, time: 2012-10-11 13:43:51.263464, event: started, request: pg_info(1 pgs e8:1.4e) v3 -2900> 2012-10-11 13:43:51.263477 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1832, time: 2012-10-11 13:43:51.263477, event: done, request: pg_info(1 pgs e8:1.4e) v3 -2899> 2012-10-11 13:43:51.263489 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 69066) -2898> 2012-10-11 13:43:51.263493 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 734 ==== osd pg remove(epoch 8; pg1.91; ) v1 ==== 25+0+0 (2591805594 0 0) 0x232bc40 con 0x2fe2280 -2897> 2012-10-11 13:43:51.263502 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1833, time: 2012-10-11 13:43:50.871894, event: header_read, request: osd pg remove(epoch 8; pg1.91; ) v1 -2896> 2012-10-11 13:43:51.263507 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1833, time: 2012-10-11 13:43:50.871897, event: throttled, request: osd pg remove(epoch 8; pg1.91; ) v1 -2895> 2012-10-11 13:43:51.263512 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1833, time: 2012-10-11 13:43:50.871900, event: all_read, request: osd pg remove(epoch 8; pg1.91; ) v1 -2894> 2012-10-11 13:43:51.263517 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1833, time: 2012-10-11 13:43:51.263501, event: dispatched, request: osd pg remove(epoch 8; pg1.91; ) v1 -2893> 2012-10-11 13:43:51.263522 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1833, time: 2012-10-11 13:43:51.263522, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg1.91; ) v1 -2892> 2012-10-11 13:43:51.263528 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1833, time: 2012-10-11 13:43:51.263528, event: started, request: osd pg remove(epoch 8; pg1.91; ) v1 -2891> 2012-10-11 13:43:51.263532 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.91 -2890> 2012-10-11 13:43:51.263545 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.91 0x2adbc70)/0x2adbc70 -2889> 2012-10-11 13:43:51.263549 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -2888> 2012-10-11 13:43:51.263551 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -2887> 2012-10-11 13:43:51.263553 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4239 0x2d2da20 -2886> 2012-10-11 13:43:51.263556 7f440532f700 5 journal submit_entry seq 4239 len 205 (0x2d6ce40) -2885> 2012-10-11 13:43:51.263559 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -2884> 2012-10-11 13:43:51.263560 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -2883> 2012-10-11 13:43:51.263584 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1833, time: 2012-10-11 13:43:51.263583, event: done, request: osd pg remove(epoch 8; pg1.91; ) v1 -2882> 2012-10-11 13:43:51.263594 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 69041) -2881> 2012-10-11 13:43:51.263597 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1079 ==== pg_info(1 pgs e8:2.29) v3 ==== 471+0+0 (3995825403 0 0) 0x2ca7e00 con 0x2fe2140 -2880> 2012-10-11 13:43:51.263607 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1834, time: 2012-10-11 13:43:50.937198, event: header_read, request: pg_info(1 pgs e8:2.29) v3 -2879> 2012-10-11 13:43:51.263611 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1834, time: 2012-10-11 13:43:50.937201, event: throttled, request: pg_info(1 pgs e8:2.29) v3 -2878> 2012-10-11 13:43:51.263614 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1834, time: 2012-10-11 13:43:50.937210, event: all_read, request: pg_info(1 pgs e8:2.29) v3 -2877> 2012-10-11 13:43:51.263618 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1834, time: 2012-10-11 13:43:51.263606, event: dispatched, request: pg_info(1 pgs e8:2.29) v3 -2876> 2012-10-11 13:43:51.263623 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1834, time: 2012-10-11 13:43:51.263623, event: waiting_for_osdmap, request: pg_info(1 pgs e8:2.29) v3 -2875> 2012-10-11 13:43:51.263628 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1834, time: 2012-10-11 13:43:51.263628, event: started, request: pg_info(1 pgs e8:2.29) v3 -2874> 2012-10-11 13:43:51.263640 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1834, time: 2012-10-11 13:43:51.263640, event: done, request: pg_info(1 pgs e8:2.29) v3 -2873> 2012-10-11 13:43:51.263649 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 68570) -2872> 2012-10-11 13:43:51.263652 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 735 ==== osd pg remove(epoch 8; pg1.8f; ) v1 ==== 25+0+0 (4015236567 0 0) 0x2eb4000 con 0x2fe2280 -2871> 2012-10-11 13:43:51.263660 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1835, time: 2012-10-11 13:43:50.871903, event: header_read, request: osd pg remove(epoch 8; pg1.8f; ) v1 -2870> 2012-10-11 13:43:51.263665 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1835, time: 2012-10-11 13:43:50.871905, event: throttled, request: osd pg remove(epoch 8; pg1.8f; ) v1 -2869> 2012-10-11 13:43:51.263670 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1835, time: 2012-10-11 13:43:50.871922, event: all_read, request: osd pg remove(epoch 8; pg1.8f; ) v1 -2868> 2012-10-11 13:43:51.263675 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1835, time: 2012-10-11 13:43:51.263659, event: dispatched, request: osd pg remove(epoch 8; pg1.8f; ) v1 -2867> 2012-10-11 13:43:51.263680 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1835, time: 2012-10-11 13:43:51.263680, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg1.8f; ) v1 -2866> 2012-10-11 13:43:51.263686 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1835, time: 2012-10-11 13:43:51.263686, event: started, request: osd pg remove(epoch 8; pg1.8f; ) v1 -2865> 2012-10-11 13:43:51.263691 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.8f -2864> 2012-10-11 13:43:51.263703 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.8f 0x2adbcd0)/0x2adbcd0 -2863> 2012-10-11 13:43:51.263707 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -2862> 2012-10-11 13:43:51.263708 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -2861> 2012-10-11 13:43:51.263709 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4240 0x2d2d990 -2860> 2012-10-11 13:43:51.263713 7f440532f700 5 journal submit_entry seq 4240 len 205 (0x2d6c630) -2859> 2012-10-11 13:43:51.263715 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -2858> 2012-10-11 13:43:51.263717 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -2857> 2012-10-11 13:43:51.263739 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1835, time: 2012-10-11 13:43:51.263738, event: done, request: osd pg remove(epoch 8; pg1.8f; ) v1 -2856> 2012-10-11 13:43:51.263749 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 68545) -2855> 2012-10-11 13:43:51.263752 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1080 ==== pg_info(1 pgs e8:2.2e) v3 ==== 471+0+0 (3620754230 0 0) 0x3099e00 con 0x2fe2140 -2854> 2012-10-11 13:43:51.263762 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1836, time: 2012-10-11 13:43:50.937213, event: header_read, request: pg_info(1 pgs e8:2.2e) v3 -2853> 2012-10-11 13:43:51.263767 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1836, time: 2012-10-11 13:43:50.937215, event: throttled, request: pg_info(1 pgs e8:2.2e) v3 -2852> 2012-10-11 13:43:51.263772 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1836, time: 2012-10-11 13:43:50.937224, event: all_read, request: pg_info(1 pgs e8:2.2e) v3 -2851> 2012-10-11 13:43:51.263776 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1836, time: 2012-10-11 13:43:51.263761, event: dispatched, request: pg_info(1 pgs e8:2.2e) v3 -2850> 2012-10-11 13:43:51.263781 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1836, time: 2012-10-11 13:43:51.263781, event: waiting_for_osdmap, request: pg_info(1 pgs e8:2.2e) v3 -2849> 2012-10-11 13:43:51.263787 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1836, time: 2012-10-11 13:43:51.263787, event: started, request: pg_info(1 pgs e8:2.2e) v3 -2848> 2012-10-11 13:43:51.263799 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1836, time: 2012-10-11 13:43:51.263799, event: done, request: pg_info(1 pgs e8:2.2e) v3 -2847> 2012-10-11 13:43:51.263807 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 68074) -2846> 2012-10-11 13:43:51.263809 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 736 ==== osd pg remove(epoch 8; pg1.87; ) v1 ==== 25+0+0 (2909315341 0 0) 0x2eb4380 con 0x2fe2280 -2845> 2012-10-11 13:43:51.263816 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1837, time: 2012-10-11 13:43:51.016983, event: header_read, request: osd pg remove(epoch 8; pg1.87; ) v1 -2844> 2012-10-11 13:43:51.263822 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1837, time: 2012-10-11 13:43:51.017001, event: throttled, request: osd pg remove(epoch 8; pg1.87; ) v1 -2843> 2012-10-11 13:43:51.263827 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1837, time: 2012-10-11 13:43:51.017011, event: all_read, request: osd pg remove(epoch 8; pg1.87; ) v1 -2842> 2012-10-11 13:43:51.263832 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1837, time: 2012-10-11 13:43:51.263815, event: dispatched, request: osd pg remove(epoch 8; pg1.87; ) v1 -2841> 2012-10-11 13:43:51.263837 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1837, time: 2012-10-11 13:43:51.263837, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg1.87; ) v1 -2840> 2012-10-11 13:43:51.263843 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1837, time: 2012-10-11 13:43:51.263843, event: started, request: osd pg remove(epoch 8; pg1.87; ) v1 -2839> 2012-10-11 13:43:51.263848 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 1.87 -2838> 2012-10-11 13:43:51.263860 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(1.87 0x2adba50)/0x2adba50 -2837> 2012-10-11 13:43:51.263864 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -2836> 2012-10-11 13:43:51.263865 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -2835> 2012-10-11 13:43:51.263867 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4241 0x2d2d900 -2834> 2012-10-11 13:43:51.263870 7f440532f700 5 journal submit_entry seq 4241 len 205 (0x2d6c9f0) -2833> 2012-10-11 13:43:51.263872 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -2832> 2012-10-11 13:43:51.263873 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -2831> 2012-10-11 13:43:51.263894 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1837, time: 2012-10-11 13:43:51.263894, event: done, request: osd pg remove(epoch 8; pg1.87; ) v1 -2830> 2012-10-11 13:43:51.263906 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 68049) -2829> 2012-10-11 13:43:51.263910 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1081 ==== pg_info(1 pgs e8:2.37) v3 ==== 471+0+0 (3183233151 0 0) 0x3009e00 con 0x2fe2140 -2828> 2012-10-11 13:43:51.263919 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1838, time: 2012-10-11 13:43:50.937227, event: header_read, request: pg_info(1 pgs e8:2.37) v3 -2827> 2012-10-11 13:43:51.263924 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1838, time: 2012-10-11 13:43:50.937229, event: throttled, request: pg_info(1 pgs e8:2.37) v3 -2826> 2012-10-11 13:43:51.263929 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1838, time: 2012-10-11 13:43:50.937237, event: all_read, request: pg_info(1 pgs e8:2.37) v3 -2825> 2012-10-11 13:43:51.263934 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1838, time: 2012-10-11 13:43:51.263918, event: dispatched, request: pg_info(1 pgs e8:2.37) v3 -2824> 2012-10-11 13:43:51.263939 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1838, time: 2012-10-11 13:43:51.263939, event: waiting_for_osdmap, request: pg_info(1 pgs e8:2.37) v3 -2823> 2012-10-11 13:43:51.263945 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1838, time: 2012-10-11 13:43:51.263945, event: started, request: pg_info(1 pgs e8:2.37) v3 -2822> 2012-10-11 13:43:51.263958 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1838, time: 2012-10-11 13:43:51.263958, event: done, request: pg_info(1 pgs e8:2.37) v3 -2821> 2012-10-11 13:43:51.263965 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 67578) -2820> 2012-10-11 13:43:51.263969 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 737 ==== osd pg remove(epoch 8; pg0.41; ) v1 ==== 25+0+0 (3254815110 0 0) 0x2eb4700 con 0x2fe2280 -2819> 2012-10-11 13:43:51.263977 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1839, time: 2012-10-11 13:43:51.017017, event: header_read, request: osd pg remove(epoch 8; pg0.41; ) v1 -2818> 2012-10-11 13:43:51.263982 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1839, time: 2012-10-11 13:43:51.017020, event: throttled, request: osd pg remove(epoch 8; pg0.41; ) v1 -2817> 2012-10-11 13:43:51.263987 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1839, time: 2012-10-11 13:43:51.017024, event: all_read, request: osd pg remove(epoch 8; pg0.41; ) v1 -2816> 2012-10-11 13:43:51.263992 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1839, time: 2012-10-11 13:43:51.263976, event: dispatched, request: osd pg remove(epoch 8; pg0.41; ) v1 -2815> 2012-10-11 13:43:51.263997 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1839, time: 2012-10-11 13:43:51.263997, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.41; ) v1 -2814> 2012-10-11 13:43:51.264003 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1839, time: 2012-10-11 13:43:51.264002, event: started, request: osd pg remove(epoch 8; pg0.41; ) v1 -2813> 2012-10-11 13:43:51.264007 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.41 -2812> 2012-10-11 13:43:51.264019 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.41 0x1d71e50)/0x1d71e50 -2811> 2012-10-11 13:43:51.264023 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -2810> 2012-10-11 13:43:51.264025 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -2809> 2012-10-11 13:43:51.264027 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4242 0x2d2d870 -2808> 2012-10-11 13:43:51.264030 7f440532f700 5 journal submit_entry seq 4242 len 205 (0x2d19900) -2807> 2012-10-11 13:43:51.264032 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -2806> 2012-10-11 13:43:51.264034 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -2805> 2012-10-11 13:43:51.264059 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1839, time: 2012-10-11 13:43:51.264059, event: done, request: osd pg remove(epoch 8; pg0.41; ) v1 -2804> 2012-10-11 13:43:51.264069 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 67553) -2803> 2012-10-11 13:43:51.264073 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1082 ==== pg_info(1 pgs e8:0.8f) v3 ==== 471+0+0 (2890377932 0 0) 0x232b000 con 0x2fe2140 -2802> 2012-10-11 13:43:51.264082 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1840, time: 2012-10-11 13:43:50.937240, event: header_read, request: pg_info(1 pgs e8:0.8f) v3 -2801> 2012-10-11 13:43:51.264087 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1840, time: 2012-10-11 13:43:50.937242, event: throttled, request: pg_info(1 pgs e8:0.8f) v3 -2800> 2012-10-11 13:43:51.264092 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1840, time: 2012-10-11 13:43:50.937260, event: all_read, request: pg_info(1 pgs e8:0.8f) v3 -2799> 2012-10-11 13:43:51.264097 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1840, time: 2012-10-11 13:43:51.264081, event: dispatched, request: pg_info(1 pgs e8:0.8f) v3 -2798> 2012-10-11 13:43:51.264102 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1840, time: 2012-10-11 13:43:51.264102, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.8f) v3 -2797> 2012-10-11 13:43:51.264108 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1840, time: 2012-10-11 13:43:51.264108, event: started, request: pg_info(1 pgs e8:0.8f) v3 -2796> 2012-10-11 13:43:51.264120 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1840, time: 2012-10-11 13:43:51.264120, event: done, request: pg_info(1 pgs e8:0.8f) v3 -2795> 2012-10-11 13:43:51.264127 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 67082) -2794> 2012-10-11 13:43:51.264131 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 738 ==== osd pg remove(epoch 8; pg0.34; ) v1 ==== 25+0+0 (962056659 0 0) 0x2eb4a80 con 0x2fe2280 -2793> 2012-10-11 13:43:51.264139 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1841, time: 2012-10-11 13:43:51.017027, event: header_read, request: osd pg remove(epoch 8; pg0.34; ) v1 -2792> 2012-10-11 13:43:51.264145 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1841, time: 2012-10-11 13:43:51.017029, event: throttled, request: osd pg remove(epoch 8; pg0.34; ) v1 -2791> 2012-10-11 13:43:51.264150 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1841, time: 2012-10-11 13:43:51.017033, event: all_read, request: osd pg remove(epoch 8; pg0.34; ) v1 -2790> 2012-10-11 13:43:51.264154 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1841, time: 2012-10-11 13:43:51.264138, event: dispatched, request: osd pg remove(epoch 8; pg0.34; ) v1 -2789> 2012-10-11 13:43:51.264160 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1841, time: 2012-10-11 13:43:51.264159, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.34; ) v1 -2788> 2012-10-11 13:43:51.264165 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1841, time: 2012-10-11 13:43:51.264165, event: started, request: osd pg remove(epoch 8; pg0.34; ) v1 -2787> 2012-10-11 13:43:51.264170 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.34 -2786> 2012-10-11 13:43:51.264182 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.34 0x1d71c00)/0x1d71c00 -2785> 2012-10-11 13:43:51.264186 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -2784> 2012-10-11 13:43:51.264187 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -2783> 2012-10-11 13:43:51.264189 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4243 0x2d2d7e0 -2782> 2012-10-11 13:43:51.264192 7f440532f700 5 journal submit_entry seq 4243 len 205 (0x20adb40) -2781> 2012-10-11 13:43:51.264195 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -2780> 2012-10-11 13:43:51.264196 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -2779> 2012-10-11 13:43:51.264217 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1841, time: 2012-10-11 13:43:51.264216, event: done, request: osd pg remove(epoch 8; pg0.34; ) v1 -2778> 2012-10-11 13:43:51.264226 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 67057) -2777> 2012-10-11 13:43:51.264230 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1083 ==== pg_info(1 pgs e8:0.94) v3 ==== 471+0+0 (3435085108 0 0) 0x232b1c0 con 0x2fe2140 -2776> 2012-10-11 13:43:51.264239 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1842, time: 2012-10-11 13:43:50.937264, event: header_read, request: pg_info(1 pgs e8:0.94) v3 -2775> 2012-10-11 13:43:51.264245 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1842, time: 2012-10-11 13:43:50.937267, event: throttled, request: pg_info(1 pgs e8:0.94) v3 -2774> 2012-10-11 13:43:51.264249 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1842, time: 2012-10-11 13:43:50.937275, event: all_read, request: pg_info(1 pgs e8:0.94) v3 -2773> 2012-10-11 13:43:51.264254 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1842, time: 2012-10-11 13:43:51.264238, event: dispatched, request: pg_info(1 pgs e8:0.94) v3 -2772> 2012-10-11 13:43:51.264259 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1842, time: 2012-10-11 13:43:51.264259, event: waiting_for_osdmap, request: pg_info(1 pgs e8:0.94) v3 -2771> 2012-10-11 13:43:51.264265 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1842, time: 2012-10-11 13:43:51.264265, event: started, request: pg_info(1 pgs e8:0.94) v3 -2770> 2012-10-11 13:43:51.264277 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1842, time: 2012-10-11 13:43:51.264277, event: done, request: pg_info(1 pgs e8:0.94) v3 -2769> 2012-10-11 13:43:51.264284 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 66586) -2768> 2012-10-11 13:43:51.264288 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 739 ==== osd pg remove(epoch 8; pg0.28; ) v1 ==== 25+0+0 (3725024976 0 0) 0x2eb4e00 con 0x2fe2280 -2767> 2012-10-11 13:43:51.264296 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1843, time: 2012-10-11 13:43:51.017035, event: header_read, request: osd pg remove(epoch 8; pg0.28; ) v1 -2766> 2012-10-11 13:43:51.264301 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1843, time: 2012-10-11 13:43:51.017037, event: throttled, request: osd pg remove(epoch 8; pg0.28; ) v1 -2765> 2012-10-11 13:43:51.264306 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1843, time: 2012-10-11 13:43:51.017041, event: all_read, request: osd pg remove(epoch 8; pg0.28; ) v1 -2764> 2012-10-11 13:43:51.264311 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1843, time: 2012-10-11 13:43:51.264295, event: dispatched, request: osd pg remove(epoch 8; pg0.28; ) v1 -2763> 2012-10-11 13:43:51.264316 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1843, time: 2012-10-11 13:43:51.264316, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.28; ) v1 -2762> 2012-10-11 13:43:51.264322 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1843, time: 2012-10-11 13:43:51.264322, event: started, request: osd pg remove(epoch 8; pg0.28; ) v1 -2761> 2012-10-11 13:43:51.264326 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.28 -2760> 2012-10-11 13:43:51.264338 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.28 0x1d71a00)/0x1d71a00 -2759> 2012-10-11 13:43:51.264341 7f440532f700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 276351 > 104857600 -2758> 2012-10-11 13:43:51.271527 7f4408335700 5 filestore(/data/osd.0) _do_op 0x31a4f50 seq 3746 osr(1.c3 0x2e38710)/0x2e38710 start -2757> 2012-10-11 13:43:51.272345 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27a70f0 seq 3747 osr(0.aa 0x24683c0)/0x24683c0 start -2756> 2012-10-11 13:43:51.273133 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27a70a0 seq 3748 osr(2.a8 0x24681f0)/0x24681f0 start -2755> 2012-10-11 13:43:51.273919 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27a7050 seq 3749 osr(2.ab 0x3176ea0)/0x3176ea0 start -2754> 2012-10-11 13:43:51.274695 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27a7000 seq 3750 osr(1.a9 0x2e383f0)/0x2e383f0 start -2753> 2012-10-11 13:43:51.275468 7f4408335700 5 filestore(/data/osd.0) _do_op 0x31a4500 seq 3751 osr(2.c0 0x24686d0)/0x24686d0 start -2752> 2012-10-11 13:43:51.276244 7f4408335700 5 filestore(/data/osd.0) _do_op 0x31a4820 seq 3752 osr(2.c3 0x2468780)/0x2468780 start -2751> 2012-10-11 13:43:51.277023 7f4408335700 5 filestore(/data/osd.0) _do_op 0x31a4640 seq 3753 osr(1.1 0x27a1370)/0x27a1370 start -2750> 2012-10-11 13:43:51.280725 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -2749> 2012-10-11 13:43:51.280733 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -2748> 2012-10-11 13:43:51.280735 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4244 0x2d2d750 -2747> 2012-10-11 13:43:51.280742 7f440532f700 5 journal submit_entry seq 4244 len 205 (0x204d540) -2746> 2012-10-11 13:43:51.280745 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -2745> 2012-10-11 13:43:51.280747 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -2744> 2012-10-11 13:43:51.280818 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1843, time: 2012-10-11 13:43:51.280817, event: done, request: osd pg remove(epoch 8; pg0.28; ) v1 -2743> 2012-10-11 13:43:51.280836 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 66561) -2742> 2012-10-11 13:43:51.280842 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1084 ==== pg_info(1 pgs e8:1.7c) v3 ==== 471+0+0 (2834920426 0 0) 0x28d18c0 con 0x2fe2140 -2741> 2012-10-11 13:43:51.280855 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1844, time: 2012-10-11 13:43:50.937278, event: header_read, request: pg_info(1 pgs e8:1.7c) v3 -2740> 2012-10-11 13:43:51.280861 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1844, time: 2012-10-11 13:43:50.937280, event: throttled, request: pg_info(1 pgs e8:1.7c) v3 -2739> 2012-10-11 13:43:51.280866 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1844, time: 2012-10-11 13:43:50.937292, event: all_read, request: pg_info(1 pgs e8:1.7c) v3 -2738> 2012-10-11 13:43:51.280871 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1844, time: 2012-10-11 13:43:51.280854, event: dispatched, request: pg_info(1 pgs e8:1.7c) v3 -2737> 2012-10-11 13:43:51.280876 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1844, time: 2012-10-11 13:43:51.280876, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.7c) v3 -2736> 2012-10-11 13:43:51.280883 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1844, time: 2012-10-11 13:43:51.280883, event: started, request: pg_info(1 pgs e8:1.7c) v3 -2735> 2012-10-11 13:43:51.280901 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1844, time: 2012-10-11 13:43:51.280901, event: done, request: pg_info(1 pgs e8:1.7c) v3 -2734> 2012-10-11 13:43:51.280909 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 66090) -2733> 2012-10-11 13:43:51.280913 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 740 ==== osd pg remove(epoch 8; pg0.22; ) v1 ==== 25+0+0 (239378500 0 0) 0x28c9540 con 0x2fe2280 -2732> 2012-10-11 13:43:51.280922 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1845, time: 2012-10-11 13:43:51.017043, event: header_read, request: osd pg remove(epoch 8; pg0.22; ) v1 -2731> 2012-10-11 13:43:51.280927 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1845, time: 2012-10-11 13:43:51.017045, event: throttled, request: osd pg remove(epoch 8; pg0.22; ) v1 -2730> 2012-10-11 13:43:51.280932 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1845, time: 2012-10-11 13:43:51.017049, event: all_read, request: osd pg remove(epoch 8; pg0.22; ) v1 -2729> 2012-10-11 13:43:51.280938 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1845, time: 2012-10-11 13:43:51.280921, event: dispatched, request: osd pg remove(epoch 8; pg0.22; ) v1 -2728> 2012-10-11 13:43:51.280943 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1845, time: 2012-10-11 13:43:51.280943, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.22; ) v1 -2727> 2012-10-11 13:43:51.280949 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1845, time: 2012-10-11 13:43:51.280949, event: started, request: osd pg remove(epoch 8; pg0.22; ) v1 -2726> 2012-10-11 13:43:51.280954 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.22 -2725> 2012-10-11 13:43:51.280973 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.22 0x1d71940)/0x1d71940 -2724> 2012-10-11 13:43:51.280978 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -2723> 2012-10-11 13:43:51.280981 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -2722> 2012-10-11 13:43:51.280982 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4245 0x2d2d630 -2721> 2012-10-11 13:43:51.280985 7f440532f700 5 journal submit_entry seq 4245 len 205 (0x1f9c750) -2720> 2012-10-11 13:43:51.280988 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -2719> 2012-10-11 13:43:51.280990 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -2718> 2012-10-11 13:43:51.281017 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1845, time: 2012-10-11 13:43:51.281017, event: done, request: osd pg remove(epoch 8; pg0.22; ) v1 -2717> 2012-10-11 13:43:51.281028 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 66065) -2716> 2012-10-11 13:43:51.281031 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1085 ==== pg_info(1 pgs e8:1.8e) v3 ==== 471+0+0 (3190464288 0 0) 0x28d1a80 con 0x2fe2140 -2715> 2012-10-11 13:43:51.281041 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1846, time: 2012-10-11 13:43:50.937295, event: header_read, request: pg_info(1 pgs e8:1.8e) v3 -2714> 2012-10-11 13:43:51.281046 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1846, time: 2012-10-11 13:43:50.937298, event: throttled, request: pg_info(1 pgs e8:1.8e) v3 -2713> 2012-10-11 13:43:51.281051 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1846, time: 2012-10-11 13:43:50.937305, event: all_read, request: pg_info(1 pgs e8:1.8e) v3 -2712> 2012-10-11 13:43:51.281055 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1846, time: 2012-10-11 13:43:51.281040, event: dispatched, request: pg_info(1 pgs e8:1.8e) v3 -2711> 2012-10-11 13:43:51.281060 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1846, time: 2012-10-11 13:43:51.281060, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.8e) v3 -2710> 2012-10-11 13:43:51.281066 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1846, time: 2012-10-11 13:43:51.281066, event: started, request: pg_info(1 pgs e8:1.8e) v3 -2709> 2012-10-11 13:43:51.281806 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x31a4190 seq 3754 osr(2.2 0x31762d0)/0x31762d0 start -2708> 2012-10-11 13:43:51.282621 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x31a4dc0 seq 3755 osr(1.c1 0x2e38770)/0x2e38770 start -2707> 2012-10-11 13:43:51.283367 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x26a6cd0 seq 3756 osr(1.b9 0x2e384f0)/0x2e384f0 start -2706> 2012-10-11 13:43:51.284123 7f4408335700 5 filestore(/data/osd.0) _do_op 0x31a4c80 seq 3757 osr(2.c2 0x2468420)/0x2468420 start -2705> 2012-10-11 13:43:51.284906 7f4408335700 5 filestore(/data/osd.0) _do_op 0x31a4370 seq 3758 osr(0.be 0x2468400)/0x2468400 start -2704> 2012-10-11 13:43:51.285779 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2574c30 seq 3759 osr(2.bc 0x2468320)/0x2468320 start -2703> 2012-10-11 13:43:51.286587 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2574460 seq 3760 osr(0.bc 0x2468460)/0x2468460 start -2702> 2012-10-11 13:43:51.287383 7f4408335700 5 filestore(/data/osd.0) _do_op 0x25745f0 seq 3761 osr(1.bd 0x2e38430)/0x2e38430 start -2701> 2012-10-11 13:43:51.288179 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3394cd0 seq 3762 osr(1.bb 0x2e38490)/0x2e38490 start -2700> 2012-10-11 13:43:51.288978 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3394320 seq 3763 osr(2.ba 0x2468290)/0x2468290 start -2699> 2012-10-11 13:43:51.291617 7f4408335700 5 filestore(/data/osd.0) _do_op 0x29518c0 seq 3764 osr(0.b1 0x2468270)/0x2468270 start -2698> 2012-10-11 13:43:51.292389 7f4408335700 5 filestore(/data/osd.0) _do_op 0x26a60a0 seq 3765 osr(1.c2 0x2e38740)/0x2e38740 start -2697> 2012-10-11 13:43:51.302106 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (66065 -> 66536) -2696> 2012-10-11 13:43:51.302157 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (66536 -> 67007) -2695> 2012-10-11 13:43:51.302182 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (67007 -> 67478) -2694> 2012-10-11 13:43:51.302206 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (67478 -> 67949) -2693> 2012-10-11 13:43:51.302228 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (67949 -> 68420) -2692> 2012-10-11 13:43:51.302254 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (68420 -> 68891) -2691> 2012-10-11 13:43:51.302277 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (68891 -> 69362) -2690> 2012-10-11 13:43:51.302304 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (69362 -> 69833) -2689> 2012-10-11 13:43:51.302326 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (69833 -> 70304) -2688> 2012-10-11 13:43:51.302348 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (70304 -> 70775) -2687> 2012-10-11 13:43:51.302371 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (70775 -> 71246) -2686> 2012-10-11 13:43:51.302393 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (71246 -> 71717) -2685> 2012-10-11 13:43:51.302419 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (71717 -> 72188) -2684> 2012-10-11 13:43:51.451482 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x26a6190 seq 3766 osr(1.cb 0x2e38990)/0x2e38990 start -2683> 2012-10-11 13:43:51.451625 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.b9 0x2e384f0)/0x2e384f0 -2682> 2012-10-11 13:43:51.451645 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -2681> 2012-10-11 13:43:51.451649 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -2680> 2012-10-11 13:43:51.451651 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4246 0x22ffbd0 -2679> 2012-10-11 13:43:51.451659 7f4401226700 5 journal submit_entry seq 4246 len 64 (0x2f51930) -2678> 2012-10-11 13:43:51.451672 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -2677> 2012-10-11 13:43:51.451675 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -2676> 2012-10-11 13:43:51.491063 7f4408335700 5 filestore(/data/osd.0) _do_op 0x26fc4b0 seq 3767 osr(1.cf 0x2e388d0)/0x2e388d0 start -2675> 2012-10-11 13:43:51.491268 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.c2 0x2e38740)/0x2e38740 -2674> 2012-10-11 13:43:51.491279 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -2673> 2012-10-11 13:43:51.491281 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -2672> 2012-10-11 13:43:51.491283 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4247 0x31c56c0 -2671> 2012-10-11 13:43:51.491290 7f4401226700 5 journal submit_entry seq 4247 len 64 (0x2f518d0) -2670> 2012-10-11 13:43:51.491293 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -2669> 2012-10-11 13:43:51.491296 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -2668> 2012-10-11 13:43:51.536066 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 80 (0xb7c748 -> 394) -2667> 2012-10-11 13:43:51.536128 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 38942 (0xb7c748 -> 219717) -2666> 2012-10-11 13:43:51.536133 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e8bdc0 seq 3774 osr(2.9a 0x2130fb0) 0x2cdad80 -2665> 2012-10-11 13:43:51.536143 7f440a339700 5 journal put_throttle finished 80 ops and 38942 bytes, now 394 ops and 219717 bytes -2664> 2012-10-11 13:43:51.536154 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e8bdc0 seq 3774 osr(2.9a 0x2130fb0) 199 bytes (queue has 482 ops and 257865 bytes) -2663> 2012-10-11 13:43:51.536164 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31d3fa0 seq 3775 osr(2.9c 0x2130d90) 0x3039900 -2662> 2012-10-11 13:43:51.536170 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31d3fa0 seq 3775 osr(2.9c 0x2130d90) 199 bytes (queue has 482 ops and 257865 bytes) -2661> 2012-10-11 13:43:51.536176 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e177d0 seq 3776 osr(0.1e 0x1d71830) 0x311e3f0 -2660> 2012-10-11 13:43:51.536179 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e177d0 seq 3776 osr(0.1e 0x1d71830) 921 bytes (queue has 482 ops and 257865 bytes) -2659> 2012-10-11 13:43:51.536184 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e17870 seq 3777 osr(0.23 0x1d71910) 0x311e2d0 -2658> 2012-10-11 13:43:51.536186 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e17870 seq 3777 osr(0.23 0x1d71910) 921 bytes (queue has 482 ops and 257865 bytes) -2657> 2012-10-11 13:43:51.536189 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236ccd0 seq 3778 osr(2.9e 0x2130e20) 0x3250480 -2656> 2012-10-11 13:43:51.536193 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236ccd0 seq 3778 osr(2.9e 0x2130e20) 199 bytes (queue has 482 ops and 257865 bytes) -2655> 2012-10-11 13:43:51.536197 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23d5320 seq 3779 osr(0.25 0x1d718b0) 0x3157240 -2654> 2012-10-11 13:43:51.536201 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23d5320 seq 3779 osr(0.25 0x1d718b0) 921 bytes (queue has 482 ops and 257865 bytes) -2653> 2012-10-11 13:43:51.536207 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e31e60 seq 3780 osr(2.a1 0x2468000) 0x3250a20 -2652> 2012-10-11 13:43:51.536211 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e31e60 seq 3780 osr(2.a1 0x2468000) 199 bytes (queue has 482 ops and 257865 bytes) -2651> 2012-10-11 13:43:51.536215 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23d5140 seq 3781 osr(1.1d 0x27a1630) 0x31573f0 -2650> 2012-10-11 13:43:51.536219 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23d5140 seq 3781 osr(1.1d 0x27a1630) 1049 bytes (queue has 482 ops and 257865 bytes) -2649> 2012-10-11 13:43:51.536224 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e319b0 seq 3782 osr(2.a2 0x2468070) 0x3250c60 -2648> 2012-10-11 13:43:51.536227 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e319b0 seq 3782 osr(2.a2 0x2468070) 199 bytes (queue has 482 ops and 257865 bytes) -2647> 2012-10-11 13:43:51.536231 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e31820 seq 3783 osr(2.a4 0x24680a0) 0x2a06000 -2646> 2012-10-11 13:43:51.536235 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e31820 seq 3783 osr(2.a4 0x24680a0) 199 bytes (queue has 482 ops and 257865 bytes) -2645> 2012-10-11 13:43:51.536240 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c55910 seq 3784 osr(2.a7 0x24681b0) 0x2a067e0 -2644> 2012-10-11 13:43:51.536243 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c55910 seq 3784 osr(2.a7 0x24681b0) 199 bytes (queue has 482 ops and 257865 bytes) -2643> 2012-10-11 13:43:51.536247 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513c80 seq 3785 osr(1.22 0x27a1940) 0x3157510 -2642> 2012-10-11 13:43:51.536252 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513c80 seq 3785 osr(1.22 0x27a1940) 921 bytes (queue has 482 ops and 257865 bytes) -2641> 2012-10-11 13:43:51.536256 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e64cd0 seq 3786 osr(0.2b 0x1d71270) 0x31c5510 -2640> 2012-10-11 13:43:51.536260 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e64cd0 seq 3786 osr(0.2b 0x1d71270) 921 bytes (queue has 482 ops and 257865 bytes) -2639> 2012-10-11 13:43:51.536262 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c55460 seq 3787 osr(2.a9 0x3176f00) 0x2a06b40 -2638> 2012-10-11 13:43:51.536265 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c55460 seq 3787 osr(2.a9 0x3176f00) 199 bytes (queue has 482 ops and 257865 bytes) -2637> 2012-10-11 13:43:51.536269 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c55140 seq 3788 osr(2.ae 0x3176e10) 0x2a06ea0 -2636> 2012-10-11 13:43:51.536271 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c55140 seq 3788 osr(2.ae 0x3176e10) 199 bytes (queue has 482 ops and 257865 bytes) -2635> 2012-10-11 13:43:51.536278 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22d5c80 seq 3789 osr(2.b2 0x3176d50) 0x1d86c60 -2634> 2012-10-11 13:43:51.536281 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22d5c80 seq 3789 osr(2.b2 0x3176d50) 199 bytes (queue has 482 ops and 257865 bytes) -2633> 2012-10-11 13:43:51.536285 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24ad050 seq 3790 osr(2.b8 0x2468200) 0x308f750 -2632> 2012-10-11 13:43:51.536288 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24ad050 seq 3790 osr(2.b8 0x2468200) 199 bytes (queue has 482 ops and 257865 bytes) -2631> 2012-10-11 13:43:51.536293 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fcdc0 seq 3791 osr(2.c1 0x24686f0) 0x308fab0 -2630> 2012-10-11 13:43:51.536295 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fcdc0 seq 3791 osr(2.c1 0x24686f0) 199 bytes (queue has 482 ops and 257865 bytes) -2629> 2012-10-11 13:43:51.536299 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x259dfa0 seq 3792 osr(2.ca 0x2468bd0) 0x1e41990 -2628> 2012-10-11 13:43:51.536303 7f4409337700 5 filestore(/data/osd.0) queue_op 0x259dfa0 seq 3792 osr(2.ca 0x2468bd0) 199 bytes (queue has 482 ops and 257865 bytes) -2627> 2012-10-11 13:43:51.536306 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e64000 seq 3793 osr(2.ce 0x2468950) 0x1f95b40 -2626> 2012-10-11 13:43:51.536310 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e64000 seq 3793 osr(2.ce 0x2468950) 199 bytes (queue has 482 ops and 257865 bytes) -2625> 2012-10-11 13:43:51.536313 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x259dc30 seq 3794 osr(2.ed 0x2468f50) 0x25f2ea0 -2624> 2012-10-11 13:43:51.536317 7f4409337700 5 filestore(/data/osd.0) queue_op 0x259dc30 seq 3794 osr(2.ed 0x2468f50) 199 bytes (queue has 482 ops and 257865 bytes) -2623> 2012-10-11 13:43:51.536326 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27b6910 seq 3795 osr(2.f8 0x25cf3f0) 0x25f2b40 -2622> 2012-10-11 13:43:51.536331 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27b6910 seq 3795 osr(2.f8 0x25cf3f0) 199 bytes (queue has 482 ops and 257865 bytes) -2621> 2012-10-11 13:43:51.536334 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25dbaf0 seq 3796 osr(2.fc 0x25cf330) 0x31cbab0 -2620> 2012-10-11 13:43:51.536338 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25dbaf0 seq 3796 osr(2.fc 0x25cf330) 199 bytes (queue has 482 ops and 257865 bytes) -2619> 2012-10-11 13:43:51.536342 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27b6b90 seq 3797 osr(2.ff 0x25cf2a0) 0x31cbea0 -2618> 2012-10-11 13:43:51.536345 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27b6b90 seq 3797 osr(2.ff 0x25cf2a0) 199 bytes (queue has 482 ops and 257865 bytes) -2617> 2012-10-11 13:43:51.536350 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3418cd0 seq 3798 osr(0.9c 0x2130f00) 0x31cb240 -2616> 2012-10-11 13:43:51.536354 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3418cd0 seq 3798 osr(0.9c 0x2130f00) 199 bytes (queue has 482 ops and 257865 bytes) -2615> 2012-10-11 13:43:51.536358 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2449910 seq 3799 osr(0.9e 0x2130ea0) 0x2062900 -2614> 2012-10-11 13:43:51.536362 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2449910 seq 3799 osr(0.9e 0x2130ea0) 199 bytes (queue has 482 ops and 257865 bytes) -2613> 2012-10-11 13:43:51.536386 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24495f0 seq 3800 osr(0.a0 0x24681a0) 0x2d17f30 -2612> 2012-10-11 13:43:51.536391 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24495f0 seq 3800 osr(0.a0 0x24681a0) 199 bytes (queue has 482 ops and 257865 bytes) -2611> 2012-10-11 13:43:51.536393 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24492d0 seq 3801 osr(0.a3 0x2468110) 0x2d17900 -2610> 2012-10-11 13:43:51.536396 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24492d0 seq 3801 osr(0.a3 0x2468110) 199 bytes (queue has 482 ops and 257865 bytes) -2609> 2012-10-11 13:43:51.536399 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2449e10 seq 3802 osr(0.a4 0x24680e0) 0x2bd6240 -2608> 2012-10-11 13:43:51.536402 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2449e10 seq 3802 osr(0.a4 0x24680e0) 199 bytes (queue has 482 ops and 257865 bytes) -2607> 2012-10-11 13:43:51.536417 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2449c80 seq 3803 osr(0.a6 0x2468080) 0x2bd6990 -2606> 2012-10-11 13:43:51.536421 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2449c80 seq 3803 osr(0.a6 0x2468080) 199 bytes (queue has 482 ops and 257865 bytes) -2605> 2012-10-11 13:43:51.536425 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24ad960 seq 3804 osr(0.a9 0x24683f0) 0x2f212d0 -2604> 2012-10-11 13:43:51.536428 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24ad960 seq 3804 osr(0.a9 0x24683f0) 199 bytes (queue has 482 ops and 257865 bytes) -2603> 2012-10-11 13:43:51.536432 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24ad4b0 seq 3805 osr(0.ab 0x2468390) 0x2f217e0 -2602> 2012-10-11 13:43:51.536435 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24ad4b0 seq 3805 osr(0.ab 0x2468390) 199 bytes (queue has 482 ops and 257865 bytes) -2601> 2012-10-11 13:43:51.536440 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24ad190 seq 3806 osr(0.b0 0x24682a0) 0x2f21cf0 -2600> 2012-10-11 13:43:51.536442 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24ad190 seq 3806 osr(0.b0 0x24682a0) 199 bytes (queue has 482 ops and 257865 bytes) -2599> 2012-10-11 13:43:51.536446 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25139b0 seq 3807 osr(0.b4 0x24685e0) 0x2a32120 -2598> 2012-10-11 13:43:51.536450 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25139b0 seq 3807 osr(0.b4 0x24685e0) 199 bytes (queue has 482 ops and 257865 bytes) -2597> 2012-10-11 13:43:51.536453 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513370 seq 3808 osr(0.ba 0x24684c0) 0x2a327e0 -2596> 2012-10-11 13:43:51.536456 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513370 seq 3808 osr(0.ba 0x24684c0) 199 bytes (queue has 482 ops and 257865 bytes) -2595> 2012-10-11 13:43:51.536460 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513a00 seq 3809 osr(0.c3 0x2468710) 0x2a26ea0 -2594> 2012-10-11 13:43:51.536463 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513a00 seq 3809 osr(0.c3 0x2468710) 199 bytes (queue has 482 ops and 257865 bytes) -2593> 2012-10-11 13:43:51.536467 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2574be0 seq 3810 osr(0.cc 0x2468960) 0x2e55000 -2592> 2012-10-11 13:43:51.536470 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2574be0 seq 3810 osr(0.cc 0x2468960) 199 bytes (queue has 482 ops and 257865 bytes) -2591> 2012-10-11 13:43:51.536474 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25dbdc0 seq 3811 osr(0.d0 0x24688a0) 0x2e551b0 -2590> 2012-10-11 13:43:51.536478 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25dbdc0 seq 3811 osr(0.d0 0x24688a0) 199 bytes (queue has 482 ops and 257865 bytes) -2589> 2012-10-11 13:43:51.536482 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x263b780 seq 3812 osr(0.ef 0x2468ed0) 0x2e55900 -2588> 2012-10-11 13:43:51.536485 7f4409337700 5 filestore(/data/osd.0) queue_op 0x263b780 seq 3812 osr(0.ef 0x2468ed0) 199 bytes (queue has 482 ops and 257865 bytes) -2587> 2012-10-11 13:43:51.536489 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27616e0 seq 3813 osr(0.fa 0x27a10c0) 0x22b9a20 -2586> 2012-10-11 13:43:51.536493 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27616e0 seq 3813 osr(0.fa 0x27a10c0) 199 bytes (queue has 482 ops and 257865 bytes) -2585> 2012-10-11 13:43:51.536496 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27c75a0 seq 3814 osr(0.fe 0x27a1000) 0x31cb090 -2584> 2012-10-11 13:43:51.536500 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27c75a0 seq 3814 osr(0.fe 0x27a1000) 199 bytes (queue has 482 ops and 257865 bytes) -2583> 2012-10-11 13:43:51.536504 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27c7f50 seq 3815 osr(1.5 0x27a12b0) 0x2ab1d80 -2582> 2012-10-11 13:43:51.536507 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27c7f50 seq 3815 osr(1.5 0x27a12b0) 195 bytes (queue has 482 ops and 257865 bytes) -2581> 2012-10-11 13:43:51.536511 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2828460 seq 3816 osr(1.8 0x27a1220) 0x2e55750 -2580> 2012-10-11 13:43:51.536515 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2828460 seq 3816 osr(1.8 0x27a1220) 195 bytes (queue has 482 ops and 257865 bytes) -2579> 2012-10-11 13:43:51.536519 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a76690 seq 3817 osr(1.24 0x27a18e0) 0x31575a0 -2578> 2012-10-11 13:43:51.536522 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a76690 seq 3817 osr(1.24 0x27a18e0) 921 bytes (queue has 482 ops and 257865 bytes) -2577> 2012-10-11 13:43:51.536526 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2828fa0 seq 3818 osr(1.13 0x27a1410) 0x3039510 -2576> 2012-10-11 13:43:51.536530 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2828fa0 seq 3818 osr(1.13 0x27a1410) 199 bytes (queue has 482 ops and 257865 bytes) -2575> 2012-10-11 13:43:51.536533 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3394aa0 seq 3819 osr(2.1c 0x1d716f0) 0x31577e0 -2574> 2012-10-11 13:43:51.536536 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3394aa0 seq 3819 osr(2.1c 0x1d716f0) 921 bytes (queue has 482 ops and 257865 bytes) -2573> 2012-10-11 13:43:51.536539 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513d70 seq 3820 osr(2.21 0x1d714b0) 0x3157900 -2572> 2012-10-11 13:43:51.536543 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513d70 seq 3820 osr(2.21 0x1d714b0) 921 bytes (queue has 482 ops and 257865 bytes) -2571> 2012-10-11 13:43:51.536547 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x288ae60 seq 3821 osr(0.9 0x1d713e0) 0x3250360 -2570> 2012-10-11 13:43:51.536550 7f4409337700 5 filestore(/data/osd.0) queue_op 0x288ae60 seq 3821 osr(0.9 0x1d713e0) 195 bytes (queue has 482 ops and 257865 bytes) -2569> 2012-10-11 13:43:51.536553 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25138c0 seq 3822 osr(2.23 0x1d717c0) 0x3157ab0 -2568> 2012-10-11 13:43:51.536557 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25138c0 seq 3822 osr(2.23 0x1d717c0) 921 bytes (queue has 482 ops and 257865 bytes) -2567> 2012-10-11 13:43:51.536560 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e64050 seq 3823 osr(0.30 0x1d71a90) 0x2ab1360 -2566> 2012-10-11 13:43:51.536564 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e64050 seq 3823 osr(0.30 0x1d71a90) 921 bytes (queue has 482 ops and 257865 bytes) -2565> 2012-10-11 13:43:51.536567 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e64820 seq 3824 osr(0.39 0x1d71d60) 0x2ab1750 -2564> 2012-10-11 13:43:51.536570 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e64820 seq 3824 osr(0.39 0x1d71d60) 921 bytes (queue has 482 ops and 257865 bytes) -2563> 2012-10-11 13:43:51.536574 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e8b870 seq 3825 osr(0.6 0x1d71380) 0x3250900 -2562> 2012-10-11 13:43:51.536577 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e8b870 seq 3825 osr(0.6 0x1d71380) 195 bytes (queue has 482 ops and 257865 bytes) -2561> 2012-10-11 13:43:51.536581 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e640f0 seq 3826 osr(0.3e 0x1d71ee0) 0x2ab1bd0 -2560> 2012-10-11 13:43:51.536584 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e640f0 seq 3826 osr(0.3e 0x1d71ee0) 921 bytes (queue has 482 ops and 257865 bytes) -2559> 2012-10-11 13:43:51.536590 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e64b90 seq 3827 osr(0.42 0x1d71e20) 0x2ab1f30 -2558> 2012-10-11 13:43:51.536593 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e64b90 seq 3827 osr(0.42 0x1d71e20) 921 bytes (queue has 482 ops and 257865 bytes) -2557> 2012-10-11 13:43:51.536597 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e8b730 seq 3828 osr(1.9f 0x2e381d0) 0x32506c0 -2556> 2012-10-11 13:43:51.536599 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e8b730 seq 3828 osr(1.9f 0x2e381d0) 199 bytes (queue has 482 ops and 257865 bytes) -2555> 2012-10-11 13:43:51.536602 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e64640 seq 3829 osr(0.44 0x1d71ff0) 0x2ab1090 -2554> 2012-10-11 13:43:51.536604 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e64640 seq 3829 osr(0.44 0x1d71ff0) 921 bytes (queue has 482 ops and 257865 bytes) -2553> 2012-10-11 13:43:51.536608 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e64550 seq 3830 osr(0.4a 0x2130120) 0x24b6f30 -2552> 2012-10-11 13:43:51.536611 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e64550 seq 3830 osr(0.4a 0x2130120) 921 bytes (queue has 482 ops and 257865 bytes) -2551> 2012-10-11 13:43:51.536613 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e142d0 seq 3831 osr(1.9d 0x2adbe30) 0x3250ea0 -2550> 2012-10-11 13:43:51.536617 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e142d0 seq 3831 osr(1.9d 0x2adbe30) 199 bytes (queue has 482 ops and 257865 bytes) -2549> 2012-10-11 13:43:51.536621 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e643c0 seq 3832 osr(0.4f 0x2130030) 0x2ab1000 -2548> 2012-10-11 13:43:51.536625 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e643c0 seq 3832 osr(0.4f 0x2130030) 921 bytes (queue has 482 ops and 257865 bytes) -2547> 2012-10-11 13:43:51.536629 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e646e0 seq 3833 osr(1.2a 0x27a1bc0) 0x2ab17e0 -2546> 2012-10-11 13:43:51.536632 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e646e0 seq 3833 osr(1.2a 0x27a1bc0) 921 bytes (queue has 482 ops and 257865 bytes) -2545> 2012-10-11 13:43:51.536638 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e145f0 seq 3834 osr(1.9b 0x2adbe90) 0x2a06240 -2544> 2012-10-11 13:43:51.536642 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e145f0 seq 3834 osr(1.9b 0x2adbe90) 199 bytes (queue has 482 ops and 257865 bytes) -2543> 2012-10-11 13:43:51.536644 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236c190 seq 3835 osr(1.2f 0x27a1ad0) 0x2ab12d0 -2542> 2012-10-11 13:43:51.536648 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236c190 seq 3835 osr(1.2f 0x27a1ad0) 921 bytes (queue has 482 ops and 257865 bytes) -2541> 2012-10-11 13:43:51.536652 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25040a0 seq 3836 osr(1.38 0x27a1d20) 0x2ab13f0 -2540> 2012-10-11 13:43:51.536655 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25040a0 seq 3836 osr(1.38 0x27a1d20) 921 bytes (queue has 482 ops and 257865 bytes) -2539> 2012-10-11 13:43:51.536658 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x20f36e0 seq 3837 osr(1.3d 0x27a1c30) 0x2ab1120 -2538> 2012-10-11 13:43:51.536662 7f4409337700 5 filestore(/data/osd.0) queue_op 0x20f36e0 seq 3837 osr(1.3d 0x27a1c30) 921 bytes (queue has 482 ops and 257865 bytes) -2537> 2012-10-11 13:43:51.536665 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23ff500 seq 3838 osr(1.41 0x27a1f70) 0x2ab1b40 -2536> 2012-10-11 13:43:51.536668 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23ff500 seq 3838 osr(1.41 0x27a1f70) 921 bytes (queue has 482 ops and 257865 bytes) -2535> 2012-10-11 13:43:51.536673 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23ff820 seq 3839 osr(1.43 0x27a1f10) 0x2ab1870 -2534> 2012-10-11 13:43:51.536676 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23ff820 seq 3839 osr(1.43 0x27a1f10) 921 bytes (queue has 482 ops and 257865 bytes) -2533> 2012-10-11 13:43:51.536679 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23ffeb0 seq 3840 osr(1.49 0x2adb1f0) 0x24bc090 -2532> 2012-10-11 13:43:51.536696 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23ffeb0 seq 3840 osr(1.49 0x2adb1f0) 921 bytes (queue has 482 ops and 257865 bytes) -2531> 2012-10-11 13:43:51.536701 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x28effa0 seq 3841 osr(1.4e 0x2adb100) 0x311e900 -2530> 2012-10-11 13:43:51.536704 7f4409337700 5 filestore(/data/osd.0) queue_op 0x28effa0 seq 3841 osr(1.4e 0x2adb100) 921 bytes (queue has 482 ops and 257865 bytes) -2529> 2012-10-11 13:43:51.536707 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e8b6e0 seq 3842 osr(0.9d 0x2130ed0) 0x2357d80 -2528> 2012-10-11 13:43:51.536709 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e8b6e0 seq 3842 osr(0.9d 0x2130ed0) 199 bytes (queue has 482 ops and 257865 bytes) -2527> 2012-10-11 13:43:51.536713 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3240c80 seq 3843 osr(2.29 0x3176630) 0x311ee10 -2526> 2012-10-11 13:43:51.536716 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3240c80 seq 3843 osr(2.29 0x3176630) 921 bytes (queue has 482 ops and 257865 bytes) -2525> 2012-10-11 13:43:51.536719 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2bbe640 seq 3844 osr(2.2e 0x3176540) 0x311e090 -2524> 2012-10-11 13:43:51.536722 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2bbe640 seq 3844 osr(2.2e 0x3176540) 921 bytes (queue has 482 ops and 257865 bytes) -2523> 2012-10-11 13:43:51.536726 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2449730 seq 3845 osr(0.a1 0x2468170) 0x2aa3c60 -2522> 2012-10-11 13:43:51.536728 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2449730 seq 3845 osr(0.a1 0x2468170) 199 bytes (queue has 482 ops and 257865 bytes) -2521> 2012-10-11 13:43:51.536731 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24490f0 seq 3846 osr(0.b3 0x2468210) 0x2bd6750 -2520> 2012-10-11 13:43:51.536735 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24490f0 seq 3846 osr(0.b3 0x2468210) 199 bytes (queue has 482 ops and 257865 bytes) -2519> 2012-10-11 13:43:51.536737 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513730 seq 3847 osr(0.7d 0x2130a50) 0x3157c60 -2518> 2012-10-11 13:43:51.536742 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513730 seq 3847 osr(0.7d 0x2130a50) 921 bytes (queue has 482 ops and 257865 bytes) -2517> 2012-10-11 13:43:51.536772 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25134b0 seq 3848 osr(0.b6 0x2468580) 0x2aa3d80 -2516> 2012-10-11 13:43:51.536778 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25134b0 seq 3848 osr(0.b6 0x2468580) 199 bytes (queue has 482 ops and 257865 bytes) -2515> 2012-10-11 13:43:51.536783 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513410 seq 3849 osr(0.8f 0x2130e30) 0x2e55e10 -2514> 2012-10-11 13:43:51.536785 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513410 seq 3849 osr(0.8f 0x2130e30) 921 bytes (queue has 482 ops and 257865 bytes) -2513> 2012-10-11 13:43:51.536788 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26b1c80 seq 3850 osr(0.94 0x2130d40) 0x301dd80 -2512> 2012-10-11 13:43:51.536791 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26b1c80 seq 3850 osr(0.94 0x2130d40) 921 bytes (queue has 482 ops and 257865 bytes) -2511> 2012-10-11 13:43:51.536794 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513000 seq 3851 osr(0.b7 0x2468550) 0x2bd6360 -2510> 2012-10-11 13:43:51.536796 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513000 seq 3851 osr(0.b7 0x2468550) 199 bytes (queue has 482 ops and 257865 bytes) -2509> 2012-10-11 13:43:51.536799 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e1bfa0 seq 3852 osr(1.7c 0x2adb860) 0x2a32360 -2508> 2012-10-11 13:43:51.536801 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e1bfa0 seq 3852 osr(1.7c 0x2adb860) 1049 bytes (queue has 482 ops and 257865 bytes) -2507> 2012-10-11 13:43:51.536804 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513e60 seq 3853 osr(0.b8 0x2468520) 0x2aa3ea0 -2506> 2012-10-11 13:43:51.536808 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513e60 seq 3853 osr(0.b8 0x2468520) 199 bytes (queue has 482 ops and 257865 bytes) -2505> 2012-10-11 13:43:51.822568 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x26fc460 seq 3768 osr(1.ee 0x2e38f00)/0x2e38f00 start -2504> 2012-10-11 13:43:51.825176 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.cb 0x2e38990)/0x2e38990 -2503> 2012-10-11 13:43:51.825195 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -2502> 2012-10-11 13:43:51.825204 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -2501> 2012-10-11 13:43:51.825206 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4248 0x31c5090 -2500> 2012-10-11 13:43:51.825216 7f4401226700 5 journal submit_entry seq 4248 len 64 (0x2f518a0) -2499> 2012-10-11 13:43:51.825222 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -2498> 2012-10-11 13:43:51.825225 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -2497> 2012-10-11 13:43:51.825905 7f4408335700 5 filestore(/data/osd.0) _do_op 0x26fc370 seq 3769 osr(1.f9 0x31760f0)/0x31760f0 start -2496> 2012-10-11 13:43:51.828101 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.cf 0x2e388d0)/0x2e388d0 -2495> 2012-10-11 13:43:51.828116 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -2494> 2012-10-11 13:43:51.828118 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -2493> 2012-10-11 13:43:51.828120 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4249 0x30391b0 -2492> 2012-10-11 13:43:51.828126 7f4401226700 5 journal submit_entry seq 4249 len 64 (0x2f51810) -2491> 2012-10-11 13:43:51.828131 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -2490> 2012-10-11 13:43:51.828134 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -2489> 2012-10-11 13:43:51.867725 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 80 (0xb7c748 -> 316) -2488> 2012-10-11 13:43:51.867755 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 64576 (0xb7c748 -> 155269) -2487> 2012-10-11 13:43:51.867758 7f440a339700 5 journal put_throttle finished 80 ops and 64576 bytes, now 316 ops and 155269 bytes -2486> 2012-10-11 13:43:51.867769 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513cd0 seq 3854 osr(0.bb 0x2468490) 0x2d17750 -2485> 2012-10-11 13:43:51.867783 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513cd0 seq 3854 osr(0.bb 0x2468490) 199 bytes (queue has 482 ops and 257587 bytes) -2484> 2012-10-11 13:43:51.867793 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x28289b0 seq 3855 osr(1.8e 0x2adbd00) 0x2a32a20 -2483> 2012-10-11 13:43:51.867798 7f4409337700 5 filestore(/data/osd.0) queue_op 0x28289b0 seq 3855 osr(1.8e 0x2adbd00) 1049 bytes (queue has 482 ops and 257587 bytes) -2482> 2012-10-11 13:43:51.867804 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x30601e0 seq 3856 osr(1.93 0x2adbc10) 0x2a32d80 -2481> 2012-10-11 13:43:51.867808 7f4409337700 5 filestore(/data/osd.0) queue_op 0x30601e0 seq 3856 osr(1.93 0x2adbc10) 1050 bytes (queue has 482 ops and 257587 bytes) -2480> 2012-10-11 13:43:51.867814 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2574820 seq 3857 osr(0.cb 0x2468990) 0x2aa32d0 -2479> 2012-10-11 13:43:51.867821 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2574820 seq 3857 osr(0.cb 0x2468990) 199 bytes (queue has 482 ops and 257587 bytes) -2478> 2012-10-11 13:43:51.867825 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3060eb0 seq 3858 osr(2.7b 0x2130880) 0x2a32f30 -2477> 2012-10-11 13:43:51.867828 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3060eb0 seq 3858 osr(2.7b 0x2130880) 921 bytes (queue has 482 ops and 257587 bytes) -2476> 2012-10-11 13:43:51.867837 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25dbf00 seq 3859 osr(0.d1 0x2468870) 0x20627e0 -2475> 2012-10-11 13:43:51.867847 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25dbf00 seq 3859 osr(0.d1 0x2468870) 199 bytes (queue has 482 ops and 257587 bytes) -2474> 2012-10-11 13:43:51.867850 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2045870 seq 3860 osr(2.8d 0x2130b00) 0x2a32240 -2473> 2012-10-11 13:43:51.867854 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2045870 seq 3860 osr(2.8d 0x2130b00) 921 bytes (queue has 482 ops and 257587 bytes) -2472> 2012-10-11 13:43:51.867856 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27658c0 seq 3861 osr(2.92 0x2130c40) 0x2a32750 -2471> 2012-10-11 13:43:51.867860 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27658c0 seq 3861 osr(2.92 0x2130c40) 921 bytes (queue has 482 ops and 257587 bytes) -2470> 2012-10-11 13:43:51.867863 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27650a0 seq 3862 osr(2.97 0x2130ee0) 0x2a32510 -2469> 2012-10-11 13:43:51.867867 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27650a0 seq 3862 osr(2.97 0x2130ee0) 921 bytes (queue has 482 ops and 257587 bytes) -2468> 2012-10-11 13:43:51.867870 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25b09b0 seq 3863 osr(2.24 0x1d717e0) 0x2a32480 -2467> 2012-10-11 13:43:51.867874 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25b09b0 seq 3863 osr(2.24 0x1d717e0) 921 bytes (queue has 482 ops and 257587 bytes) -2466> 2012-10-11 13:43:51.867877 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27655a0 seq 3864 osr(2.13 0x1d715e0) 0x2a32c60 -2465> 2012-10-11 13:43:51.867880 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27655a0 seq 3864 osr(2.13 0x1d715e0) 964 bytes (queue has 482 ops and 257587 bytes) -2464> 2012-10-11 13:43:51.867883 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323820 seq 3865 osr(0.26 0x1d71a60) 0x2f4d3f0 -2463> 2012-10-11 13:43:51.867887 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323820 seq 3865 osr(0.26 0x1d71a60) 921 bytes (queue has 482 ops and 257587 bytes) -2462> 2012-10-11 13:43:51.867890 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323870 seq 3866 osr(1.25 0x27a18b0) 0x2f4d360 -2461> 2012-10-11 13:43:51.867892 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323870 seq 3866 osr(1.25 0x27a18b0) 921 bytes (queue has 482 ops and 257587 bytes) -2460> 2012-10-11 13:43:51.867895 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323690 seq 3867 osr(0.1b 0x1d71710) 0x2f4d240 -2459> 2012-10-11 13:43:51.867898 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323690 seq 3867 osr(0.1b 0x1d71710) 921 bytes (queue has 482 ops and 257587 bytes) -2458> 2012-10-11 13:43:51.867902 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323730 seq 3868 osr(2.19 0x1d71680) 0x2f4d120 -2457> 2012-10-11 13:43:51.867904 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323730 seq 3868 osr(2.19 0x1d71680) 921 bytes (queue has 482 ops and 257587 bytes) -2456> 2012-10-11 13:43:51.867907 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323640 seq 3869 osr(1.1a 0x27a16c0) 0x2f4d000 -2455> 2012-10-11 13:43:51.867909 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323640 seq 3869 osr(1.1a 0x27a16c0) 921 bytes (queue has 482 ops and 257587 bytes) -2454> 2012-10-11 13:43:51.867913 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323960 seq 3870 osr(0.19 0x1d71770) 0x2f4df30 -2453> 2012-10-11 13:43:51.867916 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323960 seq 3870 osr(0.19 0x1d71770) 921 bytes (queue has 482 ops and 257587 bytes) -2452> 2012-10-11 13:43:51.867919 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323a00 seq 3871 osr(1.18 0x27a1720) 0x24b66c0 -2451> 2012-10-11 13:43:51.867922 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323a00 seq 3871 osr(1.18 0x27a1720) 921 bytes (queue has 482 ops and 257587 bytes) -2450> 2012-10-11 13:43:51.867925 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323a50 seq 3872 osr(0.18 0x1d717a0) 0x24b6480 -2449> 2012-10-11 13:43:51.867928 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323a50 seq 3872 osr(0.18 0x1d717a0) 921 bytes (queue has 482 ops and 257587 bytes) -2448> 2012-10-11 13:43:51.867931 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323aa0 seq 3873 osr(2.14 0x3176490) 0x24b65a0 -2447> 2012-10-11 13:43:51.867934 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323aa0 seq 3873 osr(2.14 0x3176490) 921 bytes (queue has 482 ops and 257587 bytes) -2446> 2012-10-11 13:43:51.867937 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323af0 seq 3874 osr(0.16 0x1d71670) 0x24b6b40 -2445> 2012-10-11 13:43:51.867940 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323af0 seq 3874 osr(0.16 0x1d71670) 921 bytes (queue has 482 ops and 257587 bytes) -2444> 2012-10-11 13:43:51.867942 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323b40 seq 3875 osr(1.17 0x27a1750) 0x24b6360 -2443> 2012-10-11 13:43:51.867946 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323b40 seq 3875 osr(1.17 0x27a1750) 921 bytes (queue has 482 ops and 257587 bytes) -2442> 2012-10-11 13:43:51.867949 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323b90 seq 3876 osr(2.17 0x3176400) 0x24b6c60 -2441> 2012-10-11 13:43:51.867952 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323b90 seq 3876 osr(2.17 0x3176400) 921 bytes (queue has 482 ops and 257587 bytes) -2440> 2012-10-11 13:43:51.867955 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323be0 seq 3877 osr(1.15 0x27a17b0) 0x24b6bd0 -2439> 2012-10-11 13:43:51.867958 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323be0 seq 3877 osr(1.15 0x27a17b0) 921 bytes (queue has 482 ops and 257587 bytes) -2438> 2012-10-11 13:43:51.867961 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323c30 seq 3878 osr(2.16 0x3176430) 0x32503f0 -2437> 2012-10-11 13:43:51.867964 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323c30 seq 3878 osr(2.16 0x3176430) 921 bytes (queue has 482 ops and 257587 bytes) -2436> 2012-10-11 13:43:51.867967 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323c80 seq 3879 osr(2.95 0x3176c60) 0x3250750 -2435> 2012-10-11 13:43:51.867970 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323c80 seq 3879 osr(2.95 0x3176c60) 921 bytes (queue has 482 ops and 257587 bytes) -2434> 2012-10-11 13:43:51.867973 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323cd0 seq 3880 osr(1.96 0x2adbf80) 0x3250870 -2433> 2012-10-11 13:43:51.867977 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323cd0 seq 3880 osr(1.96 0x2adbf80) 921 bytes (queue has 482 ops and 257587 bytes) -2432> 2012-10-11 13:43:51.867979 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323d20 seq 3881 osr(0.97 0x2130ff0) 0x3250b40 -2431> 2012-10-11 13:43:51.867983 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323d20 seq 3881 osr(0.97 0x2130ff0) 921 bytes (queue has 482 ops and 257587 bytes) -2430> 2012-10-11 13:43:51.867985 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323d70 seq 3882 osr(2.94 0x3176c90) 0x3250990 -2429> 2012-10-11 13:43:51.867989 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323d70 seq 3882 osr(2.94 0x3176c90) 921 bytes (queue has 482 ops and 257587 bytes) -2428> 2012-10-11 13:43:51.867992 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23d5b40 seq 3883 osr(0.9a 0x2130f60) 0x3250cf0 -2427> 2012-10-11 13:43:51.867995 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23d5b40 seq 3883 osr(0.9a 0x2130f60) 964 bytes (queue has 482 ops and 257587 bytes) -2426> 2012-10-11 13:43:51.867998 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23d5730 seq 3884 osr(0.9f 0x24681d0) 0x32501b0 -2425> 2012-10-11 13:43:51.868002 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23d5730 seq 3884 osr(0.9f 0x24681d0) 964 bytes (queue has 482 ops and 257587 bytes) -2424> 2012-10-11 13:43:51.868004 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23d5690 seq 3885 osr(0.a8 0x2468020) 0x3250630 -2423> 2012-10-11 13:43:51.868008 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23d5690 seq 3885 osr(0.a8 0x2468020) 964 bytes (queue has 482 ops and 257587 bytes) -2422> 2012-10-11 13:43:51.868010 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23d5b90 seq 3886 osr(0.b2 0x2468240) 0x2357ab0 -2421> 2012-10-11 13:43:51.868014 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23d5b90 seq 3886 osr(0.b2 0x2468240) 964 bytes (queue has 482 ops and 257587 bytes) -2420> 2012-10-11 13:43:51.868017 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1f3f550 seq 3887 osr(0.b5 0x24685b0) 0x2357510 -2419> 2012-10-11 13:43:51.868020 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1f3f550 seq 3887 osr(0.b5 0x24685b0) 964 bytes (queue has 482 ops and 257587 bytes) -2418> 2012-10-11 13:43:51.868023 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1f3f230 seq 3888 osr(0.c1 0x2468770) 0x2357cf0 -2417> 2012-10-11 13:43:51.868026 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1f3f230 seq 3888 osr(0.c1 0x2468770) 964 bytes (queue has 482 ops and 257587 bytes) -2416> 2012-10-11 13:43:51.868028 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e17050 seq 3889 osr(0.da 0x2468ac0) 0x2357bd0 -2415> 2012-10-11 13:43:51.868031 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e17050 seq 3889 osr(0.da 0x2468ac0) 964 bytes (queue has 482 ops and 257587 bytes) -2414> 2012-10-11 13:43:51.868034 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e186e0 seq 3890 osr(0.db 0x2468a90) 0x23577e0 -2413> 2012-10-11 13:43:51.868036 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e186e0 seq 3890 osr(0.db 0x2468a90) 964 bytes (queue has 482 ops and 257587 bytes) -2412> 2012-10-11 13:43:51.868042 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x28ef460 seq 3891 osr(1.9e 0x2adbe00) 0x2357900 -2411> 2012-10-11 13:43:51.868045 7f4409337700 5 filestore(/data/osd.0) queue_op 0x28ef460 seq 3891 osr(1.9e 0x2adbe00) 964 bytes (queue has 482 ops and 257587 bytes) -2410> 2012-10-11 13:43:51.868047 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e19820 seq 3892 osr(1.a7 0x2e38050) 0x23573f0 -2409> 2012-10-11 13:43:51.868049 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e19820 seq 3892 osr(1.a7 0x2e38050) 1095 bytes (queue has 482 ops and 257587 bytes) -2408> 2012-10-11 13:43:51.868052 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e19320 seq 3893 osr(1.b1 0x2e38270) 0x23572d0 -2407> 2012-10-11 13:43:51.868054 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e19320 seq 3893 osr(1.b1 0x2e38270) 964 bytes (queue has 482 ops and 257587 bytes) -2406> 2012-10-11 13:43:51.868057 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e1a7d0 seq 3894 osr(1.b4 0x2e385e0) 0x2357360 -2405> 2012-10-11 13:43:51.868060 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e1a7d0 seq 3894 osr(1.b4 0x2e385e0) 964 bytes (queue has 482 ops and 257587 bytes) -2404> 2012-10-11 13:43:51.868062 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21ff500 seq 3895 osr(1.c0 0x2e387a0) 0x301d090 -2403> 2012-10-11 13:43:51.868065 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21ff500 seq 3895 osr(1.c0 0x2e387a0) 964 bytes (queue has 482 ops and 257587 bytes) -2402> 2012-10-11 13:43:51.868070 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2bbe7d0 seq 3896 osr(2.37 0x31766a0) 0x31c5240 -2401> 2012-10-11 13:43:51.868072 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2bbe7d0 seq 3896 osr(2.37 0x31766a0) 921 bytes (queue has 482 ops and 257587 bytes) -2400> 2012-10-11 13:43:51.868074 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x263b5a0 seq 3897 osr(0.d2 0x2468840) 0x2aa3630 -2399> 2012-10-11 13:43:51.868077 7f4409337700 5 filestore(/data/osd.0) queue_op 0x263b5a0 seq 3897 osr(0.d2 0x2468840) 199 bytes (queue has 482 ops and 257587 bytes) -2398> 2012-10-11 13:43:51.868079 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fe140 seq 3898 osr(1.d9 0x2e38af0) 0x301d510 -2397> 2012-10-11 13:43:51.868082 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fe140 seq 3898 osr(1.d9 0x2e38af0) 964 bytes (queue has 482 ops and 257587 bytes) -2396> 2012-10-11 13:43:51.868084 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2bbe050 seq 3899 osr(2.3c 0x1d71c20) 0x31c51b0 -2395> 2012-10-11 13:43:51.868086 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2bbe050 seq 3899 osr(2.3c 0x1d71c20) 921 bytes (queue has 482 ops and 257587 bytes) -2394> 2012-10-11 13:43:51.868089 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x288ad20 seq 3900 osr(2.98 0x2130f20) 0x22b9120 -2393> 2012-10-11 13:43:51.868091 7f4409337700 5 filestore(/data/osd.0) queue_op 0x288ad20 seq 3900 osr(2.98 0x2130f20) 964 bytes (queue has 482 ops and 257587 bytes) -2392> 2012-10-11 13:43:51.868093 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21ff690 seq 3901 osr(2.40 0x1d71e70) 0x31c53f0 -2391> 2012-10-11 13:43:51.868096 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21ff690 seq 3901 osr(2.40 0x1d71e70) 921 bytes (queue has 482 ops and 257587 bytes) -2390> 2012-10-11 13:43:51.868098 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x263b410 seq 3902 osr(0.de 0x2468a00) 0x22ff000 -2389> 2012-10-11 13:43:51.868100 7f4409337700 5 filestore(/data/osd.0) queue_op 0x263b410 seq 3902 osr(0.de 0x2468a00) 199 bytes (queue has 482 ops and 257587 bytes) -2388> 2012-10-11 13:43:51.868103 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a17690 seq 3903 osr(2.9d 0x2130d50) 0x22b91b0 -2387> 2012-10-11 13:43:51.868105 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a17690 seq 3903 osr(2.9d 0x2130d50) 964 bytes (queue has 482 ops and 257587 bytes) -2386> 2012-10-11 13:43:51.868109 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a17190 seq 3904 osr(2.a6 0x2468130) 0x2cda2d0 -2385> 2012-10-11 13:43:51.868112 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a17190 seq 3904 osr(2.a6 0x2468130) 964 bytes (queue has 482 ops and 257587 bytes) -2384> 2012-10-11 13:43:51.868114 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21ff320 seq 3905 osr(2.42 0x1d71f00) 0x31c55a0 -2383> 2012-10-11 13:43:51.868117 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21ff320 seq 3905 osr(2.42 0x1d71f00) 921 bytes (queue has 482 ops and 257587 bytes) -2382> 2012-10-11 13:43:51.868119 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497280 seq 3906 osr(2.48 0x1d71e10) 0x28acb40 -2381> 2012-10-11 13:43:51.868121 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497280 seq 3906 osr(2.48 0x1d71e10) 921 bytes (queue has 482 ops and 257587 bytes) -2380> 2012-10-11 13:43:51.868124 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x269e140 seq 3907 osr(0.df 0x2468dd0) 0x2aa3ab0 -2379> 2012-10-11 13:43:51.868130 7f4409337700 5 filestore(/data/osd.0) queue_op 0x269e140 seq 3907 osr(0.df 0x2468dd0) 199 bytes (queue has 482 ops and 257587 bytes) -2378> 2012-10-11 13:43:51.868133 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x269efa0 seq 3908 osr(0.e0 0x2468da0) 0x311e990 -2377> 2012-10-11 13:43:51.868135 7f4409337700 5 filestore(/data/osd.0) queue_op 0x269efa0 seq 3908 osr(0.e0 0x2468da0) 199 bytes (queue has 482 ops and 257587 bytes) -2376> 2012-10-11 13:43:51.868138 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x269ee10 seq 3909 osr(0.e4 0x2468ce0) 0x2aa3240 -2375> 2012-10-11 13:43:51.868143 7f4409337700 5 filestore(/data/osd.0) queue_op 0x269ee10 seq 3909 osr(0.e4 0x2468ce0) 199 bytes (queue has 482 ops and 257587 bytes) -2374> 2012-10-11 13:43:51.868145 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fe7d0 seq 3910 osr(0.e6 0x2468c80) 0x311e630 -2373> 2012-10-11 13:43:51.868147 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fe7d0 seq 3910 osr(0.e6 0x2468c80) 199 bytes (queue has 482 ops and 257587 bytes) -2372> 2012-10-11 13:43:51.868150 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fe4b0 seq 3911 osr(0.ff 0x27a13d0) 0x2aa3360 -2371> 2012-10-11 13:43:51.868155 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fe4b0 seq 3911 osr(0.ff 0x27a13d0) 199 bytes (queue has 482 ops and 257587 bytes) -2370> 2012-10-11 13:43:51.868157 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27c7d70 seq 3912 osr(1.6 0x27a1280) 0x24b6750 -2369> 2012-10-11 13:43:51.868160 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27c7d70 seq 3912 osr(1.6 0x27a1280) 195 bytes (queue has 482 ops and 257587 bytes) -2368> 2012-10-11 13:43:51.868164 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497320 seq 3913 osr(2.4d 0x3176790) 0x28aca20 -2367> 2012-10-11 13:43:51.868166 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497320 seq 3913 osr(2.4d 0x3176790) 921 bytes (queue has 482 ops and 257587 bytes) -2366> 2012-10-11 13:43:51.868170 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24973c0 seq 3914 osr(0.5d 0x2130350) 0x28accf0 -2365> 2012-10-11 13:43:51.868173 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24973c0 seq 3914 osr(0.5d 0x2130350) 921 bytes (queue has 482 ops and 257587 bytes) -2364> 2012-10-11 13:43:51.868176 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2620e60 seq 3915 osr(2.b0 0x3176db0) 0x2cdaa20 -2363> 2012-10-11 13:43:51.868178 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2620e60 seq 3915 osr(2.b0 0x3176db0) 964 bytes (queue has 482 ops and 257587 bytes) -2362> 2012-10-11 13:43:51.868181 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2620550 seq 3916 osr(2.b3 0x3176d20) 0x2cda900 -2361> 2012-10-11 13:43:51.868183 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2620550 seq 3916 osr(2.b3 0x3176d20) 964 bytes (queue has 482 ops and 257587 bytes) -2360> 2012-10-11 13:43:51.868186 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497460 seq 3917 osr(0.5e 0x2130320) 0x28ac480 -2359> 2012-10-11 13:43:51.868189 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497460 seq 3917 osr(0.5e 0x2130320) 921 bytes (queue has 482 ops and 257587 bytes) -2358> 2012-10-11 13:43:51.868192 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236cd20 seq 3918 osr(2.bf 0x3176f70) 0x2cda6c0 -2357> 2012-10-11 13:43:51.868195 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236cd20 seq 3918 osr(2.bf 0x3176f70) 964 bytes (queue has 482 ops and 257587 bytes) -2356> 2012-10-11 13:43:51.868198 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497500 seq 3919 osr(0.67 0x2130480) 0x28acc60 -2355> 2012-10-11 13:43:51.868200 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497500 seq 3919 osr(0.67 0x2130480) 921 bytes (queue has 482 ops and 257587 bytes) -2354> 2012-10-11 13:43:51.868204 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236c6e0 seq 3920 osr(2.d8 0x25cf180) 0x2cda3f0 -2353> 2012-10-11 13:43:51.868207 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236c6e0 seq 3920 osr(2.d8 0x25cf180) 964 bytes (queue has 482 ops and 257587 bytes) -2352> 2012-10-11 13:43:51.868210 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323dc0 seq 3921 osr(0.96 0x2130ce0) 0x2cda240 -2351> 2012-10-11 13:43:51.868213 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323dc0 seq 3921 osr(0.96 0x2130ce0) 921 bytes (queue has 482 ops and 257587 bytes) -2350> 2012-10-11 13:43:51.868218 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2828280 seq 3922 osr(1.e 0x27a1500) 0x2aa3990 -2349> 2012-10-11 13:43:51.868221 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2828280 seq 3922 osr(1.e 0x27a1500) 195 bytes (queue has 482 ops and 257587 bytes) -2348> 2012-10-11 13:43:51.868226 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323e10 seq 3923 osr(0.8c 0x2130b10) 0x2cda360 -2347> 2012-10-11 13:43:51.868228 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323e10 seq 3923 osr(0.8c 0x2130b10) 921 bytes (queue has 482 ops and 257587 bytes) -2346> 2012-10-11 13:43:51.868233 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323e60 seq 3924 osr(1.8b 0x2adbd90) 0x2cda510 -2345> 2012-10-11 13:43:51.868235 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323e60 seq 3924 osr(1.8b 0x2adbd90) 921 bytes (queue has 482 ops and 257587 bytes) -2344> 2012-10-11 13:43:51.868238 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x288a5f0 seq 3925 osr(1.b7 0x2e38550) 0x24b6990 -2343> 2012-10-11 13:43:51.868242 7f4409337700 5 filestore(/data/osd.0) queue_op 0x288a5f0 seq 3925 osr(1.b7 0x2e38550) 199 bytes (queue has 482 ops and 257587 bytes) -2342> 2012-10-11 13:43:51.868244 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323eb0 seq 3926 osr(2.80 0x3176b70) 0x2cda1b0 -2341> 2012-10-11 13:43:51.868248 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323eb0 seq 3926 osr(2.80 0x3176b70) 921 bytes (queue has 482 ops and 257587 bytes) -2340> 2012-10-11 13:43:51.868251 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323f00 seq 3927 osr(0.82 0x2130960) 0x2cda750 -2339> 2012-10-11 13:43:51.868254 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323f00 seq 3927 osr(0.82 0x2130960) 921 bytes (queue has 482 ops and 257587 bytes) -2338> 2012-10-11 13:43:51.868259 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323f50 seq 3928 osr(2.8a 0x3176c10) 0x2cda480 -2337> 2012-10-11 13:43:51.868263 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323f50 seq 3928 osr(2.8a 0x3176c10) 921 bytes (queue has 482 ops and 257587 bytes) -2336> 2012-10-11 13:43:51.868265 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2edacd0 seq 3929 osr(1.ba 0x2e384c0) 0x2e55120 -2335> 2012-10-11 13:43:51.868268 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2edacd0 seq 3929 osr(1.ba 0x2e384c0) 199 bytes (queue has 482 ops and 257587 bytes) -2334> 2012-10-11 13:43:51.868270 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2574280 seq 3930 osr(1.81 0x2adbb70) 0x2cdaea0 -2333> 2012-10-11 13:43:51.868273 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2574280 seq 3930 osr(1.81 0x2adbb70) 921 bytes (queue has 482 ops and 257587 bytes) -2332> 2012-10-11 13:43:51.868275 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25748c0 seq 3931 osr(2.7d 0x2130910) 0x2cda630 -2331> 2012-10-11 13:43:51.868277 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25748c0 seq 3931 osr(2.7d 0x2130910) 921 bytes (queue has 482 ops and 257587 bytes) -2330> 2012-10-11 13:43:51.868280 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2574730 seq 3932 osr(0.7f 0x21309f0) 0x2cdae10 -2329> 2012-10-11 13:43:51.868282 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2574730 seq 3932 osr(0.7f 0x21309f0) 921 bytes (queue has 482 ops and 257587 bytes) -2328> 2012-10-11 13:43:51.868284 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2f3a820 seq 3933 osr(1.ca 0x2e389c0) 0x2a26ab0 -2327> 2012-10-11 13:43:51.868287 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2f3a820 seq 3933 osr(1.ca 0x2e389c0) 199 bytes (queue has 482 ops and 257587 bytes) -2326> 2012-10-11 13:43:52.067373 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1f31b40 seq 3770 osr(1.fd 0x3176030)/0x3176030 start -2325> 2012-10-11 13:43:52.067496 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ee 0x2e38f00)/0x2e38f00 -2324> 2012-10-11 13:43:52.067517 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -2323> 2012-10-11 13:43:52.067520 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -2322> 2012-10-11 13:43:52.067522 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4250 0x31c5f30 -2321> 2012-10-11 13:43:52.067528 7f4401226700 5 journal submit_entry seq 4250 len 64 (0x2f51d20) -2320> 2012-10-11 13:43:52.067533 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -2319> 2012-10-11 13:43:52.067542 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -2318> 2012-10-11 13:43:52.154781 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1f31a50 seq 3771 osr(2.4 0x3176270)/0x3176270 start -2317> 2012-10-11 13:43:52.156928 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.f9 0x31760f0)/0x31760f0 -2316> 2012-10-11 13:43:52.156945 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -2315> 2012-10-11 13:43:52.156949 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -2314> 2012-10-11 13:43:52.156951 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4251 0x31c5360 -2313> 2012-10-11 13:43:52.156957 7f4401226700 5 journal submit_entry seq 4251 len 64 (0x2f51840) -2312> 2012-10-11 13:43:52.156960 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -2311> 2012-10-11 13:43:52.156962 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -2310> 2012-10-11 13:43:52.199894 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497eb0 seq 3934 osr(1.7e 0x2adb800) 0x2cdabd0 -2309> 2012-10-11 13:43:52.199925 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497eb0 seq 3934 osr(1.7e 0x2adb800) 921 bytes (queue has 482 ops and 257309 bytes) -2308> 2012-10-11 13:43:52.199935 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x263b370 seq 3935 osr(1.af 0x2e382d0) 0x2a26480 -2307> 2012-10-11 13:43:52.199940 7f4409337700 5 filestore(/data/osd.0) queue_op 0x263b370 seq 3935 osr(1.af 0x2e382d0) 199 bytes (queue has 482 ops and 257309 bytes) -2306> 2012-10-11 13:43:52.199945 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2eda9b0 seq 3936 osr(1.d1 0x2e38870) 0x2a266c0 -2305> 2012-10-11 13:43:52.199949 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2eda9b0 seq 3936 osr(1.d1 0x2e38870) 199 bytes (queue has 482 ops and 257309 bytes) -2304> 2012-10-11 13:43:52.199953 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2620c30 seq 3937 osr(0.68 0x2130450) 0x1e41b40 -2303> 2012-10-11 13:43:52.199957 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2620c30 seq 3937 osr(0.68 0x2130450) 921 bytes (queue has 482 ops and 257309 bytes) -2302> 2012-10-11 13:43:52.199960 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236ce60 seq 3938 osr(1.5c 0x2adb260) 0x1e41f30 -2301> 2012-10-11 13:43:52.199956 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 80 (0xb7c748 -> 238) -2300> 2012-10-11 13:43:52.199963 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236ce60 seq 3938 osr(1.5c 0x2adb260) 921 bytes (queue has 482 ops and 257309 bytes) -2299> 2012-10-11 13:43:52.199965 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 56495 (0xb7c748 -> 98902) -2298> 2012-10-11 13:43:52.199966 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236ce10 seq 3939 osr(1.5d 0x2adb230) 0x1e41a20 -2297> 2012-10-11 13:43:52.199967 7f440a339700 5 journal put_throttle finished 80 ops and 56495 bytes, now 238 ops and 98902 bytes -2296> 2012-10-11 13:43:52.199972 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236ce10 seq 3939 osr(1.5d 0x2adb230) 921 bytes (queue has 482 ops and 257309 bytes) -2295> 2012-10-11 13:43:52.199974 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236c140 seq 3940 osr(1.66 0x2adb480) 0x1e41240 -2294> 2012-10-11 13:43:52.199979 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236c140 seq 3940 osr(1.66 0x2adb480) 921 bytes (queue has 482 ops and 257309 bytes) -2293> 2012-10-11 13:43:52.199982 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236c460 seq 3941 osr(1.67 0x2adb450) 0x1e415a0 -2292> 2012-10-11 13:43:52.199985 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236c460 seq 3941 osr(1.67 0x2adb450) 921 bytes (queue has 482 ops and 257309 bytes) -2291> 2012-10-11 13:43:52.199988 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236c780 seq 3942 osr(2.5b 0x2130170) 0x1e41750 -2290> 2012-10-11 13:43:52.199992 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236c780 seq 3942 osr(2.5b 0x2130170) 921 bytes (queue has 482 ops and 257309 bytes) -2289> 2012-10-11 13:43:52.199995 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236c0f0 seq 3943 osr(2.5c 0x2130250) 0x1e41e10 -2288> 2012-10-11 13:43:52.199999 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236c0f0 seq 3943 osr(2.5c 0x2130250) 921 bytes (queue has 482 ops and 257309 bytes) -2287> 2012-10-11 13:43:52.200002 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1faebe0 seq 3944 osr(2.65 0x21305b0) 0x22b9ab0 -2286> 2012-10-11 13:43:52.200005 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1faebe0 seq 3944 osr(2.65 0x21305b0) 921 bytes (queue has 482 ops and 257309 bytes) -2285> 2012-10-11 13:43:52.200008 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1faea00 seq 3945 osr(2.66 0x21302e0) 0x22b9ea0 -2284> 2012-10-11 13:43:52.200011 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1faea00 seq 3945 osr(2.66 0x21302e0) 921 bytes (queue has 482 ops and 257309 bytes) -2283> 2012-10-11 13:43:52.200014 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25b07d0 seq 3946 osr(2.57 0x3176880) 0x22b9cf0 -2282> 2012-10-11 13:43:52.200017 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25b07d0 seq 3946 osr(2.57 0x3176880) 921 bytes (queue has 482 ops and 257309 bytes) -2281> 2012-10-11 13:43:52.200020 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2ffe460 seq 3947 osr(1.aa 0x2e383c0) 0x2a267e0 -2280> 2012-10-11 13:43:52.200023 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2ffe460 seq 3947 osr(1.aa 0x2e383c0) 199 bytes (queue has 482 ops and 257309 bytes) -2279> 2012-10-11 13:43:52.200027 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76190 seq 3948 osr(1.dd 0x2e38a30) 0x3074ab0 -2278> 2012-10-11 13:43:52.200031 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76190 seq 3948 osr(1.dd 0x2e38a30) 199 bytes (queue has 482 ops and 257309 bytes) -2277> 2012-10-11 13:43:52.200035 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25b0820 seq 3949 osr(0.4e 0x2130060) 0x22b9c60 -2276> 2012-10-11 13:43:52.200038 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25b0820 seq 3949 osr(0.4e 0x2130060) 921 bytes (queue has 482 ops and 257309 bytes) -2275> 2012-10-11 13:43:52.200040 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3060190 seq 3950 osr(1.a8 0x2e38020) 0x3074750 -2274> 2012-10-11 13:43:52.200043 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3060190 seq 3950 osr(1.a8 0x2e38020) 199 bytes (queue has 482 ops and 257309 bytes) -2273> 2012-10-11 13:43:52.200046 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25b0870 seq 3951 osr(2.4c 0x31767c0) 0x22b9b40 -2272> 2012-10-11 13:43:52.200048 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25b0870 seq 3951 osr(2.4c 0x31767c0) 921 bytes (queue has 482 ops and 257309 bytes) -2271> 2012-10-11 13:43:52.200051 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x259d500 seq 3952 osr(0.0 0x1d71280) 0x2cdab40 -2270> 2012-10-11 13:43:52.200053 7f4409337700 5 filestore(/data/osd.0) queue_op 0x259d500 seq 3952 osr(0.0 0x1d71280) 958 bytes (queue has 482 ops and 257309 bytes) -2269> 2012-10-11 13:43:52.200057 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x259d960 seq 3953 osr(0.1 0x1d71260) 0x31cbc60 -2268> 2012-10-11 13:43:52.200060 7f4409337700 5 filestore(/data/osd.0) queue_op 0x259d960 seq 3953 osr(0.1 0x1d71260) 958 bytes (queue has 482 ops and 257309 bytes) -2267> 2012-10-11 13:43:52.200063 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x259d640 seq 3954 osr(0.a 0x1d714c0) 0x2cdac60 -2266> 2012-10-11 13:43:52.200066 7f4409337700 5 filestore(/data/osd.0) queue_op 0x259d640 seq 3954 osr(0.a 0x1d714c0) 958 bytes (queue has 482 ops and 257309 bytes) -2265> 2012-10-11 13:43:52.200074 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2068230 seq 3955 osr(0.b 0x1d71490) 0x3250000 -2264> 2012-10-11 13:43:52.200078 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2068230 seq 3955 osr(0.b 0x1d71490) 958 bytes (queue has 482 ops and 257309 bytes) -2263> 2012-10-11 13:43:52.200082 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2620780 seq 3956 osr(0.c 0x1d71460) 0x3250120 -2262> 2012-10-11 13:43:52.200085 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2620780 seq 3956 osr(0.c 0x1d71460) 958 bytes (queue has 482 ops and 257309 bytes) -2261> 2012-10-11 13:43:52.200087 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2adc0f0 seq 3957 osr(0.e1 0x2468d70) 0x250e090 -2260> 2012-10-11 13:43:52.200091 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2adc0f0 seq 3957 osr(0.e1 0x2468d70) 964 bytes (queue has 482 ops and 257309 bytes) -2259> 2012-10-11 13:43:52.200094 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2adc280 seq 3958 osr(0.e2 0x2468d40) 0x250ef30 -2258> 2012-10-11 13:43:52.200097 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2adc280 seq 3958 osr(0.e2 0x2468d40) 964 bytes (queue has 482 ops and 257309 bytes) -2257> 2012-10-11 13:43:52.200101 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2adc780 seq 3959 osr(0.e9 0x2468ff0) 0x250e990 -2256> 2012-10-11 13:43:52.200104 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2adc780 seq 3959 osr(0.e9 0x2468ff0) 964 bytes (queue has 482 ops and 257309 bytes) -2255> 2012-10-11 13:43:52.200108 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x32d0910 seq 3960 osr(0.ec 0x2468f60) 0x250e480 -2254> 2012-10-11 13:43:52.200110 7f4409337700 5 filestore(/data/osd.0) queue_op 0x32d0910 seq 3960 osr(0.ec 0x2468f60) 964 bytes (queue has 482 ops and 257309 bytes) -2253> 2012-10-11 13:43:52.200113 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x32d04b0 seq 3961 osr(0.ed 0x2468f30) 0x250ea20 -2252> 2012-10-11 13:43:52.200117 7f4409337700 5 filestore(/data/osd.0) queue_op 0x32d04b0 seq 3961 osr(0.ed 0x2468f30) 964 bytes (queue has 482 ops and 257309 bytes) -2251> 2012-10-11 13:43:52.200120 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2b3bf50 seq 3962 osr(0.f8 0x27a1120) 0x250e3f0 -2250> 2012-10-11 13:43:52.200122 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2b3bf50 seq 3962 osr(0.f8 0x27a1120) 964 bytes (queue has 482 ops and 257309 bytes) -2249> 2012-10-11 13:43:52.200125 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2b3baa0 seq 3963 osr(0.fd 0x27a1030) 0x2a26d80 -2248> 2012-10-11 13:43:52.200128 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2b3baa0 seq 3963 osr(0.fd 0x27a1030) 964 bytes (queue has 482 ops and 257309 bytes) -2247> 2012-10-11 13:43:52.200132 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2b3b410 seq 3964 osr(1.0 0x27a13a0) 0x2a26990 -2246> 2012-10-11 13:43:52.200135 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2b3b410 seq 3964 osr(1.0 0x27a13a0) 958 bytes (queue has 482 ops and 257309 bytes) -2245> 2012-10-11 13:43:52.200138 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2b3b5a0 seq 3965 osr(1.9 0x27a15f0) 0x2a26b40 -2244> 2012-10-11 13:43:52.200141 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2b3b5a0 seq 3965 osr(1.9 0x27a15f0) 958 bytes (queue has 482 ops and 257309 bytes) -2243> 2012-10-11 13:43:52.200143 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2b3b780 seq 3966 osr(1.a 0x27a15c0) 0x2a26cf0 -2242> 2012-10-11 13:43:52.200147 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2b3b780 seq 3966 osr(1.a 0x27a15c0) 958 bytes (queue has 482 ops and 257309 bytes) -2241> 2012-10-11 13:43:52.200149 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25b08c0 seq 3967 osr(1.4d 0x2adb130) 0x22b9750 -2240> 2012-10-11 13:43:52.200153 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25b08c0 seq 3967 osr(1.4d 0x2adb130) 921 bytes (queue has 482 ops and 257309 bytes) -2239> 2012-10-11 13:43:52.200156 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e764b0 seq 3968 osr(1.de 0x2e38a00) 0x3074870 -2238> 2012-10-11 13:43:52.200158 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e764b0 seq 3968 osr(1.de 0x2e38a00) 199 bytes (queue has 482 ops and 257309 bytes) -2237> 2012-10-11 13:43:52.200162 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25b0910 seq 3969 osr(2.38 0x3176670) 0x2bd6120 -2236> 2012-10-11 13:43:52.200164 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25b0910 seq 3969 osr(2.38 0x3176670) 921 bytes (queue has 482 ops and 257309 bytes) -2235> 2012-10-11 13:43:52.200168 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25b0960 seq 3970 osr(1.39 0x27a1cf0) 0x2bd65a0 -2234> 2012-10-11 13:43:52.200171 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25b0960 seq 3970 osr(1.39 0x27a1cf0) 921 bytes (queue has 482 ops and 257309 bytes) -2233> 2012-10-11 13:43:52.200174 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x213b9b0 seq 3971 osr(1.b 0x27a1590) 0x2a262d0 -2232> 2012-10-11 13:43:52.200178 7f4409337700 5 filestore(/data/osd.0) queue_op 0x213b9b0 seq 3971 osr(1.b 0x27a1590) 1089 bytes (queue has 482 ops and 257309 bytes) -2231> 2012-10-11 13:43:52.200181 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323780 seq 3972 osr(0.3a 0x1d71d30) 0x2bd67e0 -2230> 2012-10-11 13:43:52.200184 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323780 seq 3972 osr(0.3a 0x1d71d30) 921 bytes (queue has 482 ops and 257309 bytes) -2229> 2012-10-11 13:43:52.200187 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497fa0 seq 3973 osr(2.68 0x21303d0) 0x2bd6b40 -2228> 2012-10-11 13:43:52.200189 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497fa0 seq 3973 osr(2.68 0x21303d0) 921 bytes (queue has 482 ops and 257309 bytes) -2227> 2012-10-11 13:43:52.200193 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3060000 seq 3974 osr(1.a5 0x2e380b0) 0x3074900 -2226> 2012-10-11 13:43:52.200196 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3060000 seq 3974 osr(1.a5 0x2e380b0) 199 bytes (queue has 482 ops and 257309 bytes) -2225> 2012-10-11 13:43:52.200198 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31d39b0 seq 3975 osr(0.6a 0x2130720) 0x2bd6cf0 -2224> 2012-10-11 13:43:52.200202 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31d39b0 seq 3975 osr(0.6a 0x2130720) 921 bytes (queue has 482 ops and 257309 bytes) -2223> 2012-10-11 13:43:52.200205 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6910 seq 3976 osr(1.69 0x2adb7f0) 0x2f21510 -2222> 2012-10-11 13:43:52.200208 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6910 seq 3976 osr(1.69 0x2adb7f0) 921 bytes (queue has 482 ops and 257309 bytes) -2221> 2012-10-11 13:43:52.200211 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76960 seq 3977 osr(1.df 0x2e38dd0) 0x3074510 -2220> 2012-10-11 13:43:52.200213 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76960 seq 3977 osr(1.df 0x2e38dd0) 199 bytes (queue has 482 ops and 257309 bytes) -2219> 2012-10-11 13:43:52.200216 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23245a0 seq 3978 osr(1.da 0x2e38ac0) 0x2a265a0 -2218> 2012-10-11 13:43:52.200218 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23245a0 seq 3978 osr(1.da 0x2e38ac0) 964 bytes (queue has 482 ops and 257309 bytes) -2217> 2012-10-11 13:43:52.200221 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2324690 seq 3979 osr(1.e0 0x2e38da0) 0x2a26f30 -2216> 2012-10-11 13:43:52.200223 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2324690 seq 3979 osr(1.e0 0x2e38da0) 964 bytes (queue has 482 ops and 257309 bytes) -2215> 2012-10-11 13:43:52.200225 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6820 seq 3980 osr(0.61 0x21305a0) 0x2f21000 -2214> 2012-10-11 13:43:52.200228 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6820 seq 3980 osr(0.61 0x21305a0) 921 bytes (queue has 482 ops and 257309 bytes) -2213> 2012-10-11 13:43:52.200230 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3060e60 seq 3981 osr(1.a2 0x2e38140) 0x3074e10 -2212> 2012-10-11 13:43:52.200233 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3060e60 seq 3981 osr(1.a2 0x2e38140) 199 bytes (queue has 482 ops and 257309 bytes) -2211> 2012-10-11 13:43:52.200235 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6f50 seq 3982 osr(1.60 0x2adb5a0) 0x2f21f30 -2210> 2012-10-11 13:43:52.200238 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6f50 seq 3982 osr(1.60 0x2adb5a0) 921 bytes (queue has 482 ops and 257309 bytes) -2209> 2012-10-11 13:43:52.200240 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2324280 seq 3983 osr(1.e1 0x2e38d70) 0x2a26090 -2208> 2012-10-11 13:43:52.200242 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2324280 seq 3983 osr(1.e1 0x2e38d70) 964 bytes (queue has 482 ops and 257309 bytes) -2207> 2012-10-11 13:43:52.200245 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6dc0 seq 3984 osr(2.5d 0x2130200) 0x2f21a20 -2206> 2012-10-11 13:43:52.200247 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6dc0 seq 3984 osr(2.5d 0x2130200) 921 bytes (queue has 482 ops and 257309 bytes) -2205> 2012-10-11 13:43:52.200249 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6a50 seq 3985 osr(0.5f 0x21302f0) 0x2f21990 -2204> 2012-10-11 13:43:52.200252 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6a50 seq 3985 osr(0.5f 0x21302f0) 921 bytes (queue has 482 ops and 257309 bytes) -2203> 2012-10-11 13:43:52.200256 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e14e10 seq 3986 osr(1.e3 0x2e38d10) 0x3074630 -2202> 2012-10-11 13:43:52.200259 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e14e10 seq 3986 osr(1.e3 0x2e38d10) 199 bytes (queue has 482 ops and 257309 bytes) -2201> 2012-10-11 13:43:52.200263 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6f00 seq 3987 osr(1.5e 0x2adb200) 0x2f21360 -2200> 2012-10-11 13:43:52.200267 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6f00 seq 3987 osr(1.5e 0x2adb200) 921 bytes (queue has 482 ops and 257309 bytes) -2199> 2012-10-11 13:43:52.200270 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6690 seq 3988 osr(2.5f 0x31769c0) 0x2f21b40 -2198> 2012-10-11 13:43:52.200272 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6690 seq 3988 osr(2.5f 0x31769c0) 921 bytes (queue has 482 ops and 257309 bytes) -2197> 2012-10-11 13:43:52.200275 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6500 seq 3989 osr(0.59 0x2130410) 0x2f21c60 -2196> 2012-10-11 13:43:52.200277 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6500 seq 3989 osr(0.59 0x2130410) 921 bytes (queue has 482 ops and 257309 bytes) -2195> 2012-10-11 13:43:52.200280 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a67d0 seq 3990 osr(1.e8 0x2e38c20) 0x2a261b0 -2194> 2012-10-11 13:43:52.200282 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a67d0 seq 3990 osr(1.e8 0x2e38c20) 964 bytes (queue has 482 ops and 257309 bytes) -2193> 2012-10-11 13:43:52.200284 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6140 seq 3991 osr(1.58 0x2adb320) 0x2f21ea0 -2192> 2012-10-11 13:43:52.200287 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6140 seq 3991 osr(1.58 0x2adb320) 921 bytes (queue has 482 ops and 257309 bytes) -2191> 2012-10-11 13:43:52.200295 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26a6050 seq 3992 osr(1.eb 0x2e38f90) 0x2a26000 -2190> 2012-10-11 13:43:52.200298 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26a6050 seq 3992 osr(1.eb 0x2e38f90) 964 bytes (queue has 482 ops and 257309 bytes) -2189> 2012-10-11 13:43:52.200300 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x30ce820 seq 3993 osr(1.a3 0x2e38110) 0x3074360 -2188> 2012-10-11 13:43:52.200302 7f4409337700 5 filestore(/data/osd.0) queue_op 0x30ce820 seq 3993 osr(1.a3 0x2e38110) 199 bytes (queue has 482 ops and 257309 bytes) -2187> 2012-10-11 13:43:52.200305 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e14370 seq 3994 osr(1.4f 0x2adb0d0) 0x2f21240 -2186> 2012-10-11 13:43:52.200307 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e14370 seq 3994 osr(1.4f 0x2adb0d0) 964 bytes (queue has 482 ops and 257309 bytes) -2185> 2012-10-11 13:43:52.200310 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e14960 seq 3995 osr(2.4f 0x2130050) 0x2f21480 -2184> 2012-10-11 13:43:52.200312 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e14960 seq 3995 osr(2.4f 0x2130050) 964 bytes (queue has 482 ops and 257309 bytes) -2183> 2012-10-11 13:43:52.200315 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e31230 seq 3996 osr(1.ec 0x2e38f60) 0x2d17a20 -2182> 2012-10-11 13:43:52.200317 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e31230 seq 3996 osr(1.ec 0x2e38f60) 964 bytes (queue has 482 ops and 257309 bytes) -2181> 2012-10-11 13:43:52.200320 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e14c80 seq 3997 osr(1.e5 0x2e38cb0) 0x3074480 -2180> 2012-10-11 13:43:52.200323 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e14c80 seq 3997 osr(1.e5 0x2e38cb0) 199 bytes (queue has 482 ops and 257309 bytes) -2179> 2012-10-11 13:43:52.200327 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e31910 seq 3998 osr(1.f7 0x3176150) 0x2d17cf0 -2178> 2012-10-11 13:43:52.200330 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e31910 seq 3998 osr(1.f7 0x3176150) 964 bytes (queue has 482 ops and 257309 bytes) -2177> 2012-10-11 13:43:52.200332 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e313c0 seq 3999 osr(1.fc 0x3176060) 0x2d17bd0 -2176> 2012-10-11 13:43:52.200334 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e313c0 seq 3999 osr(1.fc 0x3176060) 964 bytes (queue has 482 ops and 257309 bytes) -2175> 2012-10-11 13:43:52.200337 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x30ce4b0 seq 4000 osr(1.fe 0x3176000) 0x30746c0 -2174> 2012-10-11 13:43:52.200339 7f4409337700 5 filestore(/data/osd.0) queue_op 0x30ce4b0 seq 4000 osr(1.fe 0x3176000) 199 bytes (queue has 482 ops and 257309 bytes) -2173> 2012-10-11 13:43:52.200342 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1f3fdc0 seq 4001 osr(2.5 0x3176240) 0x30743f0 -2172> 2012-10-11 13:43:52.200344 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1f3fdc0 seq 4001 osr(2.5 0x3176240) 195 bytes (queue has 482 ops and 257309 bytes) -2171> 2012-10-11 13:43:52.200347 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4280 seq 4002 osr(2.d 0x1d71430) 0x3074f30 -2170> 2012-10-11 13:43:52.200349 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4280 seq 4002 osr(2.d 0x1d71430) 195 bytes (queue has 482 ops and 257309 bytes) -2169> 2012-10-11 13:43:52.200352 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31d3780 seq 4003 osr(2.9b 0x2130cc0) 0x3074ea0 -2168> 2012-10-11 13:43:52.200354 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31d3780 seq 4003 osr(2.9b 0x2130cc0) 199 bytes (queue has 482 ops and 257309 bytes) -2167> 2012-10-11 13:43:52.200357 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236ca50 seq 4004 osr(2.9f 0x3176ce0) 0x3074240 -2166> 2012-10-11 13:43:52.200359 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236ca50 seq 4004 osr(2.9f 0x3176ce0) 199 bytes (queue has 482 ops and 257309 bytes) -2165> 2012-10-11 13:43:52.200362 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e31c80 seq 4005 osr(2.b1 0x3176d80) 0x3074090 -2164> 2012-10-11 13:43:52.200364 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e31c80 seq 4005 osr(2.b1 0x3176d80) 199 bytes (queue has 482 ops and 257309 bytes) -2163> 2012-10-11 13:43:52.200366 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25133c0 seq 4006 osr(2.b4 0x3176f40) 0x3074120 -2162> 2012-10-11 13:43:52.200369 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25133c0 seq 4006 osr(2.b4 0x3176f40) 199 bytes (queue has 482 ops and 257309 bytes) -2161> 2012-10-11 13:43:52.200371 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23ea2d0 seq 4007 osr(2.b5 0x3176f10) 0x3074a20 -2160> 2012-10-11 13:43:52.200374 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23ea2d0 seq 4007 osr(2.b5 0x3176f10) 199 bytes (queue has 482 ops and 257309 bytes) -2159> 2012-10-11 13:43:52.200379 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2384f50 seq 4008 osr(2.b6 0x2468540) 0x3074cf0 -2158> 2012-10-11 13:43:52.200381 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2384f50 seq 4008 osr(2.b6 0x2468540) 199 bytes (queue has 482 ops and 257309 bytes) -2157> 2012-10-11 13:43:52.200384 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2324f00 seq 4009 osr(2.b9 0x2468250) 0x30747e0 -2156> 2012-10-11 13:43:52.200386 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2324f00 seq 4009 osr(2.b9 0x2468250) 199 bytes (queue has 482 ops and 257309 bytes) -2155> 2012-10-11 13:43:52.200388 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fcbe0 seq 4010 osr(2.c9 0x3176fc0) 0x3074c60 -2154> 2012-10-11 13:43:52.200391 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fcbe0 seq 4010 osr(2.c9 0x3176fc0) 199 bytes (queue has 482 ops and 257309 bytes) -2153> 2012-10-11 13:43:52.200394 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e64140 seq 4011 osr(2.cf 0x24689d0) 0x3074990 -2152> 2012-10-11 13:43:52.200397 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e64140 seq 4011 osr(2.cf 0x24689d0) 199 bytes (queue has 482 ops and 257309 bytes) -2151> 2012-10-11 13:43:52.200400 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c55be0 seq 4012 osr(2.d0 0x2468980) 0x30741b0 -2150> 2012-10-11 13:43:52.200403 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c55be0 seq 4012 osr(2.d0 0x2468980) 199 bytes (queue has 482 ops and 257309 bytes) -2149> 2012-10-11 13:43:52.200406 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e31050 seq 4013 osr(2.dc 0x25cf0c0) 0x3074000 -2148> 2012-10-11 13:43:52.200410 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e31050 seq 4013 osr(2.dc 0x25cf0c0) 199 bytes (queue has 482 ops and 257309 bytes) -2147> 2012-10-11 13:43:52.463044 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1f31000 seq 3772 osr(2.7 0x1d71320)/0x1d71320 start -2146> 2012-10-11 13:43:52.464967 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.fd 0x3176030)/0x3176030 -2145> 2012-10-11 13:43:52.464987 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -2144> 2012-10-11 13:43:52.464990 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -2143> 2012-10-11 13:43:52.464998 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4252 0x3039990 -2142> 2012-10-11 13:43:52.465008 7f4401226700 5 journal submit_entry seq 4252 len 64 (0x2f517b0) -2141> 2012-10-11 13:43:52.465013 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -2140> 2012-10-11 13:43:52.465016 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -2139> 2012-10-11 13:43:52.509837 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2126190 seq 4014 osr(2.dd 0x25cf090) 0x30742d0 -2138> 2012-10-11 13:43:52.509910 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2126190 seq 4014 osr(2.dd 0x25cf090) 200 bytes (queue has 482 ops and 257170 bytes) -2137> 2012-10-11 13:43:52.509851 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 80 (0xb7c748 -> 159) -2136> 2012-10-11 13:43:52.509917 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2126000 seq 4015 osr(2.de 0x25cf060) 0x30745a0 -2135> 2012-10-11 13:43:52.509919 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2126000 seq 4015 osr(2.de 0x25cf060) 200 bytes (queue has 482 ops and 257170 bytes) -2134> 2012-10-11 13:43:52.509922 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2126e60 seq 4016 osr(2.e2 0x2468db0) 0x3074d80 -2133> 2012-10-11 13:43:52.509920 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 64876 (0xb7c748 -> 34090) -2132> 2012-10-11 13:43:52.509925 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2126e60 seq 4016 osr(2.e2 0x2468db0) 200 bytes (queue has 482 ops and 257170 bytes) -2131> 2012-10-11 13:43:52.509928 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2478eb0 seq 4017 osr(2.e4 0x2468aa0) 0x28acbd0 -2130> 2012-10-11 13:43:52.509942 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2478eb0 seq 4017 osr(2.e4 0x2468aa0) 200 bytes (queue has 482 ops and 257170 bytes) -2129> 2012-10-11 13:43:52.509945 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x288a730 seq 4018 osr(2.fd 0x25cf300) 0x31cb5a0 -2128> 2012-10-11 13:43:52.509927 7f440a339700 5 journal put_throttle finished 80 ops and 64876 bytes, now 159 ops and 34090 bytes -2127> 2012-10-11 13:43:52.509948 7f4409337700 5 filestore(/data/osd.0) queue_op 0x288a730 seq 4018 osr(2.fd 0x25cf300) 200 bytes (queue has 482 ops and 257170 bytes) -2126> 2012-10-11 13:43:52.510023 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3418fa0 seq 4019 osr(0.f 0x1d71500) 0x31cb630 -2125> 2012-10-11 13:43:52.510036 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3418fa0 seq 4019 osr(0.f 0x1d71500) 196 bytes (queue has 482 ops and 257170 bytes) -2124> 2012-10-11 13:43:52.510041 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1eea0a0 seq 4020 osr(0.7 0x1d71350) 0x31cb990 -2123> 2012-10-11 13:43:52.510044 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1eea0a0 seq 4020 osr(0.7 0x1d71350) 196 bytes (queue has 482 ops and 257170 bytes) -2122> 2012-10-11 13:43:52.510048 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e8b550 seq 4021 osr(1.9c 0x2adbe60) 0x31cbbd0 -2121> 2012-10-11 13:43:52.510051 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e8b550 seq 4021 osr(1.9c 0x2adbe60) 200 bytes (queue has 482 ops and 257170 bytes) -2120> 2012-10-11 13:43:52.510054 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e14730 seq 4022 osr(2.15 0x3176460) 0x31cbd80 -2119> 2012-10-11 13:43:52.510057 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e14730 seq 4022 osr(2.15 0x3176460) 200 bytes (queue has 482 ops and 257170 bytes) -2118> 2012-10-11 13:43:52.510060 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e31c30 seq 4023 osr(2.8 0x1d71360) 0x2d17360 -2117> 2012-10-11 13:43:52.510063 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e31c30 seq 4023 osr(2.8 0x1d71360) 958 bytes (queue has 482 ops and 257170 bytes) -2116> 2012-10-11 13:43:52.510066 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e315f0 seq 4024 osr(2.9 0x31763f0) 0x2d17090 -2115> 2012-10-11 13:43:52.510069 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e315f0 seq 4024 osr(2.9 0x31763f0) 958 bytes (queue has 482 ops and 257170 bytes) -2114> 2012-10-11 13:43:52.510073 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e316e0 seq 4025 osr(2.a 0x31763c0) 0x2d171b0 -2113> 2012-10-11 13:43:52.510075 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e316e0 seq 4025 osr(2.a 0x31763c0) 958 bytes (queue has 482 ops and 257170 bytes) -2112> 2012-10-11 13:43:52.510078 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e31eb0 seq 4026 osr(2.d9 0x25cf150) 0x2d17480 -2111> 2012-10-11 13:43:52.510081 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e31eb0 seq 4026 osr(2.d9 0x25cf150) 964 bytes (queue has 482 ops and 257170 bytes) -2110> 2012-10-11 13:43:52.510085 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497f00 seq 4027 osr(2.df 0x25cf030) 0x2bd6870 -2109> 2012-10-11 13:43:52.510088 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497f00 seq 4027 osr(2.df 0x25cf030) 964 bytes (queue has 482 ops and 257170 bytes) -2108> 2012-10-11 13:43:52.510091 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24975a0 seq 4028 osr(2.e0 0x25cf260) 0x2bd6900 -2107> 2012-10-11 13:43:52.510096 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24975a0 seq 4028 osr(2.e0 0x25cf260) 964 bytes (queue has 482 ops and 257170 bytes) -2106> 2012-10-11 13:43:52.510099 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497640 seq 4029 osr(2.e7 0x2468b10) 0x2bd61b0 -2105> 2012-10-11 13:43:52.510101 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497640 seq 4029 osr(2.e7 0x2468b10) 964 bytes (queue has 482 ops and 257170 bytes) -2104> 2012-10-11 13:43:52.510105 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24976e0 seq 4030 osr(2.ea 0x25cf290) 0x2bd63f0 -2103> 2012-10-11 13:43:52.510108 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24976e0 seq 4030 osr(2.ea 0x25cf290) 964 bytes (queue has 482 ops and 257170 bytes) -2102> 2012-10-11 13:43:52.510111 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497780 seq 4031 osr(2.eb 0x2468e60) 0x2bd6510 -2101> 2012-10-11 13:43:52.510114 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497780 seq 4031 osr(2.eb 0x2468e60) 964 bytes (queue has 482 ops and 257170 bytes) -2100> 2012-10-11 13:43:52.510117 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497820 seq 4032 osr(2.f6 0x25cf450) 0x2bd6a20 -2099> 2012-10-11 13:43:52.510121 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497820 seq 4032 osr(2.f6 0x25cf450) 964 bytes (queue has 482 ops and 257170 bytes) -2098> 2012-10-11 13:43:52.510124 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24978c0 seq 4033 osr(2.fb 0x25cf360) 0x2bd66c0 -2097> 2012-10-11 13:43:52.510127 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24978c0 seq 4033 osr(2.fb 0x25cf360) 964 bytes (queue has 482 ops and 257170 bytes) -2096> 2012-10-11 13:43:52.510130 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497960 seq 4034 osr(0.8b 0x2130b40) 0x2bd6ea0 -2095> 2012-10-11 13:43:52.510133 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497960 seq 4034 osr(0.8b 0x2130b40) 964 bytes (queue has 482 ops and 257170 bytes) -2094> 2012-10-11 13:43:52.510137 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497a00 seq 4035 osr(1.8a 0x2adbdc0) 0x2bd6f30 -2093> 2012-10-11 13:43:52.510143 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497a00 seq 4035 osr(1.8a 0x2adbdc0) 964 bytes (queue has 482 ops and 257170 bytes) -2092> 2012-10-11 13:43:52.510146 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b24b0 seq 4036 osr(2.88 0x2130ad0) 0x25f2900 -2091> 2012-10-11 13:43:52.510149 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b24b0 seq 4036 osr(2.88 0x2130ad0) 964 bytes (queue has 482 ops and 257170 bytes) -2090> 2012-10-11 13:43:52.510152 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b2460 seq 4037 osr(2.89 0x3176c40) 0x2aa3900 -2089> 2012-10-11 13:43:52.510155 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b2460 seq 4037 osr(2.89 0x3176c40) 964 bytes (queue has 482 ops and 257170 bytes) -2088> 2012-10-11 13:43:52.510159 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b2780 seq 4038 osr(1.ff 0x3176360) 0x2aa33f0 -2087> 2012-10-11 13:43:52.510161 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b2780 seq 4038 osr(1.ff 0x3176360) 1047 bytes (queue has 482 ops and 257170 bytes) -2090> 2012-10-11 13:43:52.510165 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e14910 seq 4039 osr(0.a5 0x24680b0) 0x2aa3a20 -2089> 2012-10-11 13:43:52.510167 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e14910 seq 4039 osr(0.a5 0x24680b0) 964 bytes (queue has 482 ops and 257170 bytes) -2088> 2012-10-11 13:43:52.510172 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b2af0 seq 4040 osr(1.b0 0x2e382a0) 0x2a26360 -2087> 2012-10-11 13:43:52.510174 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b2af0 seq 4040 osr(1.b0 0x2e382a0) 1177 bytes (queue has 482 ops and 257170 bytes) -2086> 2012-10-11 13:43:52.510178 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e148c0 seq 4041 osr(0.c0 0x24687a0) 0x2f21900 -2085> 2012-10-11 13:43:52.510181 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e148c0 seq 4041 osr(0.c0 0x24687a0) 964 bytes (queue has 482 ops and 257170 bytes) -2084> 2012-10-11 13:43:52.510183 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b21e0 seq 4042 osr(1.ad 0x2e38330) 0x2aa3cf0 -2083> 2012-10-11 13:43:52.510186 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b21e0 seq 4042 osr(1.ad 0x2e38330) 1050 bytes (queue has 482 ops and 257170 bytes) -2082> 2012-10-11 13:43:52.510188 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e145a0 seq 4043 osr(0.c6 0x2468680) 0x2f213f0 -2081> 2012-10-11 13:43:52.510192 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e145a0 seq 4043 osr(0.c6 0x2468680) 964 bytes (queue has 482 ops and 257170 bytes) -2080> 2012-10-11 13:43:52.510194 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e14280 seq 4044 osr(0.cf 0x24688d0) 0x2aa3f30 -2079> 2012-10-11 13:43:52.510198 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e14280 seq 4044 osr(0.cf 0x24688d0) 964 bytes (queue has 482 ops and 257170 bytes) -2078> 2012-10-11 13:43:52.510200 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2449780 seq 4045 osr(0.d3 0x2468810) 0x2aa3b40 -2077> 2012-10-11 13:43:52.510204 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2449780 seq 4045 osr(0.d3 0x2468810) 964 bytes (queue has 482 ops and 257170 bytes) -2076> 2012-10-11 13:43:52.510207 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2449140 seq 4046 osr(0.d8 0x2468b20) 0x2aa3510 -2075> 2012-10-11 13:43:52.510210 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2449140 seq 4046 osr(0.d8 0x2468b20) 964 bytes (queue has 482 ops and 257170 bytes) -2074> 2012-10-11 13:43:52.510213 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513500 seq 4047 osr(1.a4 0x2e380e0) 0x2aa35a0 -2073> 2012-10-11 13:43:52.510216 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513500 seq 4047 osr(1.a4 0x2e380e0) 964 bytes (queue has 482 ops and 257170 bytes) -2072> 2012-10-11 13:43:52.510218 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513050 seq 4048 osr(1.bf 0x2e387d0) 0x2aa3750 -2071> 2012-10-11 13:43:52.510222 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513050 seq 4048 osr(1.bf 0x2e387d0) 964 bytes (queue has 482 ops and 257170 bytes) -2070> 2012-10-11 13:43:52.510226 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513eb0 seq 4049 osr(1.c5 0x2e386b0) 0x2aa37e0 -2069> 2012-10-11 13:43:52.510228 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513eb0 seq 4049 osr(1.c5 0x2e386b0) 964 bytes (queue has 482 ops and 257170 bytes) -2068> 2012-10-11 13:43:52.510232 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2513d20 seq 4050 osr(1.ce 0x2e38900) 0x2aa3000 -2067> 2012-10-11 13:43:52.510234 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2513d20 seq 4050 osr(1.ce 0x2e38900) 964 bytes (queue has 482 ops and 257170 bytes) -2066> 2012-10-11 13:43:52.510240 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2574870 seq 4051 osr(1.d2 0x2e38840) 0x2aa3e10 -2065> 2012-10-11 13:43:52.510247 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2574870 seq 4051 osr(1.d2 0x2e38840) 964 bytes (queue has 482 ops and 257170 bytes) -2064> 2012-10-11 13:43:52.510250 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25dbf50 seq 4052 osr(1.d7 0x2e38b50) 0x2aa3bd0 -2063> 2012-10-11 13:43:52.510252 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25dbf50 seq 4052 osr(1.d7 0x2e38b50) 964 bytes (queue has 482 ops and 257170 bytes) -2062> 2012-10-11 13:43:52.510255 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x263b5f0 seq 4053 osr(2.a3 0x2468150) 0x2aa3120 -2061> 2012-10-11 13:43:52.510258 7f4409337700 5 filestore(/data/osd.0) queue_op 0x263b5f0 seq 4053 osr(2.a3 0x2468150) 964 bytes (queue has 482 ops and 257170 bytes) -2060> 2012-10-11 13:43:52.510260 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x263b460 seq 4054 osr(2.be 0x24683b0) 0x2aa3090 -2059> 2012-10-11 13:43:52.510263 7f4409337700 5 filestore(/data/osd.0) queue_op 0x263b460 seq 4054 osr(2.be 0x24683b0) 964 bytes (queue has 482 ops and 257170 bytes) -2058> 2012-10-11 13:43:52.510265 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x269e190 seq 4055 osr(2.c4 0x24687c0) 0x26fd1b0 -2057> 2012-10-11 13:43:52.510268 7f4409337700 5 filestore(/data/osd.0) queue_op 0x269e190 seq 4055 osr(2.c4 0x24687c0) 964 bytes (queue has 482 ops and 257170 bytes) -2056> 2012-10-11 13:43:52.510275 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x269e000 seq 4056 osr(2.cd 0x24688b0) 0x26fd240 -2055> 2012-10-11 13:43:52.510277 7f4409337700 5 filestore(/data/osd.0) queue_op 0x269e000 seq 4056 osr(2.cd 0x24688b0) 964 bytes (queue has 482 ops and 257170 bytes) -2054> 2012-10-11 13:43:52.510280 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x269ee60 seq 4057 osr(2.d1 0x2468630) 0x26fdea0 -2053> 2012-10-11 13:43:52.510284 7f4409337700 5 filestore(/data/osd.0) queue_op 0x269ee60 seq 4057 osr(2.d1 0x2468630) 964 bytes (queue has 482 ops and 257170 bytes) -2052> 2012-10-11 13:43:52.510287 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fe820 seq 4058 osr(2.d6 0x25cf1e0) 0x26fd000 -2051> 2012-10-11 13:43:52.510289 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fe820 seq 4058 osr(2.d6 0x25cf1e0) 964 bytes (queue has 482 ops and 257170 bytes) -2050> 2012-10-11 13:43:52.510293 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31d31e0 seq 4059 osr(2.1b 0x1d71880) 0x31cb000 -2049> 2012-10-11 13:43:52.510296 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31d31e0 seq 4059 osr(2.1b 0x1d71880) 200 bytes (queue has 482 ops and 257170 bytes) -2048> 2012-10-11 13:43:52.510300 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fe500 seq 4060 osr(0.8 0x1d71410) 0x26fd120 -2047> 2012-10-11 13:43:52.510302 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fe500 seq 4060 osr(0.8 0x1d71410) 958 bytes (queue has 482 ops and 257170 bytes) -2046> 2012-10-11 13:43:52.510305 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27c7dc0 seq 4061 osr(0.e8 0x2468c20) 0x26fdf30 -2045> 2012-10-11 13:43:52.510308 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27c7dc0 seq 4061 osr(0.e8 0x2468c20) 964 bytes (queue has 482 ops and 257170 bytes) -2044> 2012-10-11 13:43:52.510311 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x28282d0 seq 4062 osr(0.ee 0x2468f00) 0x26fd2d0 -2043> 2012-10-11 13:43:52.510313 7f4409337700 5 filestore(/data/osd.0) queue_op 0x28282d0 seq 4062 osr(0.ee 0x2468f00) 964 bytes (queue has 482 ops and 257170 bytes) -2042> 2012-10-11 13:43:52.510317 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21e4460 seq 4063 osr(2.1e 0x1d71780) 0x31cb3f0 -2041> 2012-10-11 13:43:52.510319 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21e4460 seq 4063 osr(2.1e 0x1d71780) 200 bytes (queue has 482 ops and 257170 bytes) -2040> 2012-10-11 13:43:52.510322 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x288a640 seq 4064 osr(0.f0 0x2468ea0) 0x26fde10 -2039> 2012-10-11 13:43:52.510324 7f4409337700 5 filestore(/data/osd.0) queue_op 0x288a640 seq 4064 osr(0.f0 0x2468ea0) 964 bytes (queue has 482 ops and 257170 bytes) -2038> 2012-10-11 13:43:52.510328 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2edad20 seq 4065 osr(0.f2 0x2468e40) 0x26fd090 -2037> 2012-10-11 13:43:52.510330 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2edad20 seq 4065 osr(0.f2 0x2468e40) 964 bytes (queue has 482 ops and 257170 bytes) -2036> 2012-10-11 13:43:52.510332 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2f3a870 seq 4066 osr(0.f3 0x2468e10) 0x26fdcf0 -2035> 2012-10-11 13:43:52.510336 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2f3a870 seq 4066 osr(0.f3 0x2468e10) 964 bytes (queue has 482 ops and 257170 bytes) -2034> 2012-10-11 13:43:52.510338 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x30ce500 seq 4067 osr(0.f5 0x27a11b0) 0x31cb360 -2033> 2012-10-11 13:43:52.510345 7f4409337700 5 filestore(/data/osd.0) queue_op 0x30ce500 seq 4067 osr(0.f5 0x27a11b0) 964 bytes (queue has 482 ops and 257170 bytes) -2032> 2012-10-11 13:43:52.510348 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21ca1e0 seq 4068 osr(2.1f 0x31764f0) 0x31cb2d0 -2031> 2012-10-11 13:43:52.510350 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21ca1e0 seq 4068 osr(2.1f 0x31764f0) 200 bytes (queue has 482 ops and 257170 bytes) -2030> 2012-10-11 13:43:52.510353 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1f3fe10 seq 4069 osr(0.f9 0x27a10f0) 0x31cb870 -2029> 2012-10-11 13:43:52.510355 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1f3fe10 seq 4069 osr(0.f9 0x27a10f0) 964 bytes (queue has 482 ops and 257170 bytes) -2028> 2012-10-11 13:43:52.510359 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a42d0 seq 4070 osr(0.fb 0x27a1090) 0x31cbcf0 -2027> 2012-10-11 13:43:52.510361 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a42d0 seq 4070 osr(0.fb 0x27a1090) 964 bytes (queue has 482 ops and 257170 bytes) -2026> 2012-10-11 13:43:52.510365 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31d37d0 seq 4071 osr(0.fc 0x27a1060) 0x31cb750 -2025> 2012-10-11 13:43:52.510367 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31d37d0 seq 4071 osr(0.fc 0x27a1060) 964 bytes (queue has 482 ops and 257170 bytes) -2024> 2012-10-11 13:43:52.510371 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236caa0 seq 4072 osr(1.e7 0x2e38c50) 0x31cb480 -2023> 2012-10-11 13:43:52.510373 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236caa0 seq 4072 osr(1.e7 0x2e38c50) 964 bytes (queue has 482 ops and 257170 bytes) -2022> 2012-10-11 13:43:52.510377 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31a4000 seq 4073 osr(2.26 0x1d71a10) 0x31cbf30 -2021> 2012-10-11 13:43:52.510379 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31a4000 seq 4073 osr(2.26 0x1d71a10) 200 bytes (queue has 482 ops and 257170 bytes) -2020> 2012-10-11 13:43:52.510383 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e31cd0 seq 4074 osr(1.ed 0x2e38f30) 0x31cb510 -2019> 2012-10-11 13:43:52.510388 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e31cd0 seq 4074 osr(1.ed 0x2e38f30) 964 bytes (queue has 482 ops and 257170 bytes) -2018> 2012-10-11 13:43:52.510391 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25130a0 seq 4075 osr(1.ef 0x2e38ed0) 0x308f900 -2017> 2012-10-11 13:43:52.510394 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25130a0 seq 4075 osr(1.ef 0x2e38ed0) 964 bytes (queue has 482 ops and 257170 bytes) -2016> 2012-10-11 13:43:52.510398 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23eae10 seq 4076 osr(1.f1 0x2e38e70) 0x1f95ab0 -2015> 2012-10-11 13:43:52.510400 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23eae10 seq 4076 osr(1.f1 0x2e38e70) 964 bytes (queue has 482 ops and 257170 bytes) -2014> 2012-10-11 13:43:52.510405 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2384dc0 seq 4077 osr(1.f2 0x2e38e40) 0x1f95f30 -2013> 2012-10-11 13:43:52.510407 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2384dc0 seq 4077 osr(1.f2 0x2e38e40) 964 bytes (queue has 482 ops and 257170 bytes) -2012> 2012-10-11 13:43:52.510410 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3060e10 seq 4078 osr(2.32 0x1d71b40) 0x31cb7e0 -2011> 2012-10-11 13:43:52.510413 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3060e10 seq 4078 osr(2.32 0x1d71b40) 200 bytes (queue has 482 ops and 257170 bytes) -2010> 2012-10-11 13:43:52.510416 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2324d70 seq 4079 osr(1.f8 0x3176120) 0x1f95480 -2009> 2012-10-11 13:43:52.510419 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2324d70 seq 4079 osr(1.f8 0x3176120) 964 bytes (queue has 482 ops and 257170 bytes) -2008> 2012-10-11 13:43:52.510422 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x26fcc30 seq 4080 osr(1.fa 0x31760c0) 0x1f95360 -2007> 2012-10-11 13:43:52.510426 7f4409337700 5 filestore(/data/osd.0) queue_op 0x26fcc30 seq 4080 osr(1.fa 0x31760c0) 964 bytes (queue has 482 ops and 257170 bytes) -2006> 2012-10-11 13:43:52.510428 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e64190 seq 4081 osr(1.fb 0x3176090) 0x1f951b0 -2005> 2012-10-11 13:43:52.510431 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e64190 seq 4081 osr(1.fb 0x3176090) 964 bytes (queue has 482 ops and 257170 bytes) -2004> 2012-10-11 13:43:52.510434 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21caa00 seq 4082 osr(2.3f 0x3176750) 0x31cba20 -2003> 2012-10-11 13:43:52.510437 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21caa00 seq 4082 osr(2.3f 0x3176750) 200 bytes (queue has 482 ops and 257170 bytes) -2002> 2012-10-11 13:43:52.510441 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x259df50 seq 4083 osr(2.e6 0x2468a70) 0x1f95cf0 -2001> 2012-10-11 13:43:52.510447 7f4409337700 5 filestore(/data/osd.0) queue_op 0x259df50 seq 4083 osr(2.e6 0x2468a70) 964 bytes (queue has 482 ops and 257170 bytes) -2000> 2012-10-11 13:43:52.510450 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e31000 seq 4084 osr(2.ec 0x2468ee0) 0x1f95240 -1999> 2012-10-11 13:43:52.510452 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e31000 seq 4084 osr(2.ec 0x2468ee0) 964 bytes (queue has 482 ops and 257170 bytes) -1998> 2012-10-11 13:43:52.510455 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21261e0 seq 4085 osr(2.6 0x1d712d0) 0x1f95630 -1997> 2012-10-11 13:43:52.510458 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21261e0 seq 4085 osr(2.6 0x1d712d0) 958 bytes (queue has 482 ops and 257170 bytes) -1996> 2012-10-11 13:43:52.510460 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2126050 seq 4086 osr(2.ee 0x2468fd0) 0x1f95ea0 -1995> 2012-10-11 13:43:52.510464 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2126050 seq 4086 osr(2.ee 0x2468fd0) 964 bytes (queue has 482 ops and 257170 bytes) -1994> 2012-10-11 13:43:52.510466 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2045050 seq 4087 osr(2.43 0x1d71ce0) 0x2062d80 -1993> 2012-10-11 13:43:52.510470 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2045050 seq 4087 osr(2.43 0x1d71ce0) 200 bytes (queue has 482 ops and 257170 bytes) -1992> 2012-10-11 13:43:52.510475 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2126eb0 seq 4088 osr(2.f0 0x2468c00) 0x1f95000 -1991> 2012-10-11 13:43:52.510478 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2126eb0 seq 4088 osr(2.f0 0x2468c00) 964 bytes (queue has 482 ops and 257170 bytes) -1990> 2012-10-11 13:43:52.510480 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2478e10 seq 4089 osr(2.f3 0x2468cd0) 0x1f956c0 -1989> 2012-10-11 13:43:52.510483 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2478e10 seq 4089 osr(2.f3 0x2468cd0) 964 bytes (queue has 482 ops and 257170 bytes) -1988> 2012-10-11 13:43:52.510487 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x312f460 seq 4090 osr(2.f1 0x2468c40) 0x1f95870 -1987> 2012-10-11 13:43:52.510489 7f4409337700 5 filestore(/data/osd.0) queue_op 0x312f460 seq 4090 osr(2.f1 0x2468c40) 964 bytes (queue has 482 ops and 257170 bytes) -1986> 2012-10-11 13:43:52.510491 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x27b6a00 seq 4091 osr(2.f9 0x25cf3c0) 0x1f95900 -1985> 2012-10-11 13:43:52.510494 7f4409337700 5 filestore(/data/osd.0) queue_op 0x27b6a00 seq 4091 osr(2.f9 0x25cf3c0) 964 bytes (queue has 482 ops and 257170 bytes) -1984> 2012-10-11 13:43:52.510496 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3240190 seq 4092 osr(2.45 0x1d71f70) 0x20623f0 -1983> 2012-10-11 13:43:52.510498 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3240190 seq 4092 osr(2.45 0x1d71f70) 200 bytes (queue has 482 ops and 257170 bytes) -1982> 2012-10-11 13:43:52.510501 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1eea0f0 seq 4093 osr(2.f7 0x25cf420) 0x1f95990 -1981> 2012-10-11 13:43:52.510503 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1eea0f0 seq 4093 osr(2.f7 0x25cf420) 964 bytes (queue has 482 ops and 257170 bytes) -1980> 2012-10-11 13:43:52.511340 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1f31280 seq 3773 osr(2.12 0x1d715a0)/0x1d715a0 start -1979> 2012-10-11 13:43:52.511420 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.4 0x3176270)/0x3176270 -1978> 2012-10-11 13:43:52.511429 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1977> 2012-10-11 13:43:52.511431 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1976> 2012-10-11 13:43:52.511432 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4253 0x3039000 -1975> 2012-10-11 13:43:52.511436 7f4401226700 5 journal submit_entry seq 4253 len 63 (0x2f51720) -1974> 2012-10-11 13:43:52.511438 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1973> 2012-10-11 13:43:52.511440 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 63 -1972> 2012-10-11 13:43:52.712480 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e8bdc0 seq 3774 osr(2.9a 0x2130fb0)/0x2130fb0 start -1971> 2012-10-11 13:43:52.712610 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.7 0x1d71320)/0x1d71320 -1970> 2012-10-11 13:43:52.712626 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1969> 2012-10-11 13:43:52.712634 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1968> 2012-10-11 13:43:52.712637 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4254 0x3039b40 -1967> 2012-10-11 13:43:52.712643 7f4401226700 5 journal submit_entry seq 4254 len 63 (0x2f51690) -1966> 2012-10-11 13:43:52.712647 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1965> 2012-10-11 13:43:52.712650 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 63 -1964> 2012-10-11 13:43:52.794875 7f4408335700 5 filestore(/data/osd.0) _do_op 0x31d3fa0 seq 3775 osr(2.9c 0x2130d90)/0x2130d90 start -1963> 2012-10-11 13:43:52.795075 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.12 0x1d715a0)/0x1d715a0 -1962> 2012-10-11 13:43:52.795086 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1961> 2012-10-11 13:43:52.795088 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1960> 2012-10-11 13:43:52.795090 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4255 0x3039f30 -1959> 2012-10-11 13:43:52.795097 7f4401226700 5 journal submit_entry seq 4255 len 64 (0x2f51600) -1958> 2012-10-11 13:43:52.795100 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1957> 2012-10-11 13:43:52.795103 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -1956> 2012-10-11 13:43:52.823074 7f43ff019700 5 throttle(msgr_dispatch_throttler-hbserver 0x1d9bc88) get 47 (0 -> 47) -1955> 2012-10-11 13:43:52.823140 7f440432d700 1 -- 149.165.228.10:6803/338 <== osd.2 149.165.228.10:0/1657 4 ==== osd_ping(ping e8 stamp 2012-10-11 13:43:52.822562) v2 ==== 47+0+0 (3782021788 0 0) 0x2a27e00 con 0x2fe2c80 -1954> 2012-10-11 13:43:52.823163 7f440432d700 1 -- 149.165.228.10:6803/338 --> 149.165.228.10:0/1657 -- osd_ping(ping_reply e8 stamp 2012-10-11 13:43:52.822562) v2 -- ?+0 0x27a2a80 con 0x2fe2c80 -1953> 2012-10-11 13:43:52.823177 7f440432d700 5 throttle(msgr_dispatch_throttler-hbserver 0x1d9bc88) put 47 (0xb7c748 -> 0) -1952> 2012-10-11 13:43:52.838235 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 80 (0xb7c748 -> 82) -1951> 2012-10-11 13:43:52.838283 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 18882 (0xb7c748 -> 15398) -1950> 2012-10-11 13:43:52.838286 7f440a339700 5 journal put_throttle finished 80 ops and 18882 bytes, now 82 ops and 15398 bytes -1949> 2012-10-11 13:43:52.838299 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1e8b5a0 seq 4094 osr(2.fa 0x25cf390) 0x1f95090 -1948> 2012-10-11 13:43:52.838315 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1e8b5a0 seq 4094 osr(2.fa 0x25cf390) 964 bytes (queue has 482 ops and 256759 bytes) -1947> 2012-10-11 13:43:52.838323 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1f31410 seq 4095 osr(1.8d 0x2adbd30) 0x1f952d0 -1946> 2012-10-11 13:43:52.838329 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1f31410 seq 4095 osr(1.8d 0x2adbd30) 964 bytes (queue has 482 ops and 256759 bytes) -1945> 2012-10-11 13:43:52.838333 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21ca9b0 seq 4096 osr(2.20 0x31764c0) 0x2062990 -1944> 2012-10-11 13:43:52.838338 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21ca9b0 seq 4096 osr(2.20 0x31764c0) 200 bytes (queue has 482 ops and 256759 bytes) -1943> 2012-10-11 13:43:52.838341 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2edaa00 seq 4097 osr(1.db 0x2e38a90) 0x1f95c60 -1942> 2012-10-11 13:43:52.838345 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2edaa00 seq 4097 osr(1.db 0x2e38a90) 677 bytes (queue has 482 ops and 256759 bytes) -1941> 2012-10-11 13:43:52.838348 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b2e10 seq 4098 osr(2.db 0x25cf0f0) 0x1f95a20 -1940> 2012-10-11 13:43:52.838352 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b2e10 seq 4098 osr(2.db 0x25cf0f0) 677 bytes (queue has 482 ops and 256759 bytes) -1939> 2012-10-11 13:43:52.838355 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x31d3a50 seq 4099 osr(2.4a 0x3176820) 0x2062750 -1938> 2012-10-11 13:43:52.838363 7f4409337700 5 filestore(/data/osd.0) queue_op 0x31d3a50 seq 4099 osr(2.4a 0x3176820) 200 bytes (queue has 482 ops and 256759 bytes) -1937> 2012-10-11 13:43:52.838366 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21b49b0 seq 4100 osr(2.46 0x1d71fb0) 0x2062f30 -1936> 2012-10-11 13:43:52.838369 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21b49b0 seq 4100 osr(2.46 0x1d71fb0) 200 bytes (queue has 482 ops and 256759 bytes) -1935> 2012-10-11 13:43:52.838372 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3240f00 seq 4101 osr(2.50 0x21300d0) 0x2062510 -1934> 2012-10-11 13:43:52.838374 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3240f00 seq 4101 osr(2.50 0x21300d0) 200 bytes (queue has 482 ops and 256759 bytes) -1933> 2012-10-11 13:43:52.838377 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21b4050 seq 4102 osr(2.58 0x2130390) 0x2062090 -1932> 2012-10-11 13:43:52.838379 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21b4050 seq 4102 osr(2.58 0x2130390) 200 bytes (queue has 482 ops and 256759 bytes) -1931> 2012-10-11 13:43:52.838382 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x32d0230 seq 4103 osr(2.59 0x2130430) 0x2062e10 -1930> 2012-10-11 13:43:52.838385 7f4409337700 5 filestore(/data/osd.0) queue_op 0x32d0230 seq 4103 osr(2.59 0x2130430) 200 bytes (queue has 482 ops and 256759 bytes) -1929> 2012-10-11 13:43:52.838389 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x32d00a0 seq 4104 osr(2.5e 0x21302b0) 0x20622d0 -1928> 2012-10-11 13:43:52.838393 7f4409337700 5 filestore(/data/osd.0) queue_op 0x32d00a0 seq 4104 osr(2.5e 0x21302b0) 200 bytes (queue has 482 ops and 256759 bytes) -1927> 2012-10-11 13:43:52.838395 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x240ba50 seq 4105 osr(2.47 0x1d71dd0) 0x2062ea0 -1926> 2012-10-11 13:43:52.838399 7f4409337700 5 filestore(/data/osd.0) queue_op 0x240ba50 seq 4105 osr(2.47 0x1d71dd0) 200 bytes (queue has 482 ops and 256759 bytes) -1925> 2012-10-11 13:43:52.838401 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3240d70 seq 4106 osr(2.6d 0x2130620) 0x2062360 -1924> 2012-10-11 13:43:52.838405 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3240d70 seq 4106 osr(2.6d 0x2130620) 200 bytes (queue has 482 ops and 256759 bytes) -1923> 2012-10-11 13:43:52.838407 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22d52d0 seq 4107 osr(2.6c 0x3176a00) 0x2062c60 -1922> 2012-10-11 13:43:52.838411 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22d52d0 seq 4107 osr(2.6c 0x3176a00) 200 bytes (queue has 482 ops and 256759 bytes) -1921> 2012-10-11 13:43:52.838414 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22d5460 seq 4108 osr(2.71 0x2130770) 0x2062ab0 -1920> 2012-10-11 13:43:52.838417 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22d5460 seq 4108 osr(2.71 0x2130770) 200 bytes (queue has 482 ops and 256759 bytes) -1919> 2012-10-11 13:43:52.838419 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x240b1e0 seq 4109 osr(2.78 0x21307b0) 0x20626c0 -1918> 2012-10-11 13:43:52.838423 7f4409337700 5 filestore(/data/osd.0) queue_op 0x240b1e0 seq 4109 osr(2.78 0x21307b0) 200 bytes (queue has 482 ops and 256759 bytes) -1917> 2012-10-11 13:43:52.838425 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x20d63c0 seq 4110 osr(2.86 0x2130a10) 0x20625a0 -1916> 2012-10-11 13:43:52.838429 7f4409337700 5 filestore(/data/osd.0) queue_op 0x20d63c0 seq 4110 osr(2.86 0x2130a10) 200 bytes (queue has 482 ops and 256759 bytes) -1915> 2012-10-11 13:43:52.838432 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22d5b40 seq 4111 osr(2.79 0x21308e0) 0x2062cf0 -1914> 2012-10-11 13:43:52.838435 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22d5b40 seq 4111 osr(2.79 0x21308e0) 200 bytes (queue has 482 ops and 256759 bytes) -1913> 2012-10-11 13:43:52.838438 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236c870 seq 4112 osr(2.90 0x2130b50) 0x2062b40 -1912> 2012-10-11 13:43:52.838440 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236c870 seq 4112 osr(2.90 0x2130b50) 200 bytes (queue has 482 ops and 256759 bytes) -1911> 2012-10-11 13:43:52.838442 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23ffc80 seq 4113 osr(2.91 0x2130bf0) 0x2062000 -1910> 2012-10-11 13:43:52.838445 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23ffc80 seq 4113 osr(2.91 0x2130bf0) 200 bytes (queue has 482 ops and 256759 bytes) -1909> 2012-10-11 13:43:52.838450 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3394910 seq 4114 osr(2.8f 0x2130b90) 0x20621b0 -1908> 2012-10-11 13:43:52.838453 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3394910 seq 4114 osr(2.8f 0x2130b90) 200 bytes (queue has 482 ops and 256759 bytes) -1907> 2012-10-11 13:43:52.838460 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23ffe10 seq 4115 osr(2.8e 0x2130e70) 0x2d176c0 -1906> 2012-10-11 13:43:52.838465 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23ffe10 seq 4115 osr(2.8e 0x2130e70) 200 bytes (queue has 482 ops and 256759 bytes) -1905> 2012-10-11 13:43:52.838467 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23fffa0 seq 4116 osr(0.45 0x1d71fc0) 0x2d17c60 -1904> 2012-10-11 13:43:52.838470 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23fffa0 seq 4116 osr(0.45 0x1d71fc0) 200 bytes (queue has 482 ops and 256759 bytes) -1903> 2012-10-11 13:43:52.838472 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x20d6050 seq 4117 osr(1.b6 0x2e38580) 0x2a06f30 -1902> 2012-10-11 13:43:52.838474 7f4409337700 5 filestore(/data/osd.0) queue_op 0x20d6050 seq 4117 osr(1.b6 0x2e38580) 200 bytes (queue has 482 ops and 256759 bytes) -1901> 2012-10-11 13:43:52.838477 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2f3a460 seq 4118 osr(0.48 0x1d71f30) 0x2a06cf0 -1900> 2012-10-11 13:43:52.838479 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2f3a460 seq 4118 osr(0.48 0x1d71f30) 200 bytes (queue has 482 ops and 256759 bytes) -1899> 2012-10-11 13:43:52.838482 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x20d6b90 seq 4119 osr(1.b5 0x2e385b0) 0x2a06bd0 -1898> 2012-10-11 13:43:52.838484 7f4409337700 5 filestore(/data/osd.0) queue_op 0x20d6b90 seq 4119 osr(1.b5 0x2e385b0) 200 bytes (queue has 482 ops and 256759 bytes) -1897> 2012-10-11 13:43:52.838487 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2eda050 seq 4120 osr(0.47 0x1d71f60) 0x2a06ab0 -1896> 2012-10-11 13:43:52.838489 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2eda050 seq 4120 osr(0.47 0x1d71f60) 200 bytes (queue has 482 ops and 256759 bytes) -1895> 2012-10-11 13:43:52.838492 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x20d6d20 seq 4121 osr(1.b2 0x2e38240) 0x2a06e10 -1894> 2012-10-11 13:43:52.838494 7f4409337700 5 filestore(/data/osd.0) queue_op 0x20d6d20 seq 4121 osr(1.b2 0x2e38240) 200 bytes (queue has 482 ops and 256759 bytes) -1893> 2012-10-11 13:43:52.838496 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2eda500 seq 4122 osr(0.4c 0x21300c0) 0x2a061b0 -1892> 2012-10-11 13:43:52.838499 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2eda500 seq 4122 osr(0.4c 0x21300c0) 200 bytes (queue has 482 ops and 256759 bytes) -1891> 2012-10-11 13:43:52.838501 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x213b5f0 seq 4123 osr(1.a0 0x2e381a0) 0x2a06360 -1890> 2012-10-11 13:43:52.838504 7f4409337700 5 filestore(/data/osd.0) queue_op 0x213b5f0 seq 4123 osr(1.a0 0x2e381a0) 200 bytes (queue has 482 ops and 256759 bytes) -1889> 2012-10-11 13:43:52.838506 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e14140 seq 4124 osr(0.49 0x2130150) 0x2a065a0 -1888> 2012-10-11 13:43:52.838508 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e14140 seq 4124 osr(0.49 0x2130150) 200 bytes (queue has 482 ops and 256759 bytes) -1887> 2012-10-11 13:43:52.838511 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x20d6a00 seq 4125 osr(0.52 0x2130270) 0x2a062d0 -1886> 2012-10-11 13:43:52.838513 7f4409337700 5 filestore(/data/osd.0) queue_op 0x20d6a00 seq 4125 osr(0.52 0x2130270) 200 bytes (queue has 482 ops and 256759 bytes) -1885> 2012-10-11 13:43:52.838515 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x213bc80 seq 4126 osr(0.5a 0x21303e0) 0x2a06090 -1884> 2012-10-11 13:43:52.838518 7f4409337700 5 filestore(/data/osd.0) queue_op 0x213bc80 seq 4126 osr(0.5a 0x21303e0) 200 bytes (queue has 482 ops and 256759 bytes) -1883> 2012-10-11 13:43:52.838520 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x219b0a0 seq 4127 osr(0.5b 0x21303b0) 0x2a06510 -1882> 2012-10-11 13:43:52.838523 7f4409337700 5 filestore(/data/osd.0) queue_op 0x219b0a0 seq 4127 osr(0.5b 0x21303b0) 200 bytes (queue has 482 ops and 256759 bytes) -1881> 2012-10-11 13:43:52.838525 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x219bf00 seq 4128 osr(0.60 0x21305d0) 0x2a06480 -1880> 2012-10-11 13:43:52.838528 7f4409337700 5 filestore(/data/osd.0) queue_op 0x219bf00 seq 4128 osr(0.60 0x21305d0) 200 bytes (queue has 482 ops and 256759 bytes) -1879> 2012-10-11 13:43:52.838532 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21ff730 seq 4129 osr(0.6e 0x2130660) 0x308f240 -1878> 2012-10-11 13:43:52.838535 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21ff730 seq 4129 osr(0.6e 0x2130660) 200 bytes (queue has 482 ops and 256759 bytes) -1877> 2012-10-11 13:43:52.838539 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x225f140 seq 4130 osr(0.6f 0x2130630) 0x308f990 -1876> 2012-10-11 13:43:52.838541 7f4409337700 5 filestore(/data/osd.0) queue_op 0x225f140 seq 4130 osr(0.6f 0x2130630) 200 bytes (queue has 482 ops and 256759 bytes) -1875> 2012-10-11 13:43:52.838544 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x225ffa0 seq 4131 osr(0.73 0x21308c0) 0x308ff30 -1874> 2012-10-11 13:43:52.838548 7f4409337700 5 filestore(/data/osd.0) queue_op 0x225ffa0 seq 4131 osr(0.73 0x21308c0) 200 bytes (queue has 482 ops and 256759 bytes) -1873> 2012-10-11 13:43:52.838551 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22c2960 seq 4132 osr(0.7a 0x2130ae0) 0x308f000 -1872> 2012-10-11 13:43:52.838555 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22c2960 seq 4132 osr(0.7a 0x2130ae0) 200 bytes (queue has 482 ops and 256759 bytes) -1871> 2012-10-11 13:43:52.838557 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22c2e60 seq 4133 osr(0.7b 0x2130ab0) 0x308f120 -1870> 2012-10-11 13:43:52.838560 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22c2e60 seq 4133 osr(0.7b 0x2130ab0) 200 bytes (queue has 482 ops and 256759 bytes) -1869> 2012-10-11 13:43:52.838563 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22c2cd0 seq 4134 osr(0.88 0x2130bd0) 0x308fea0 -1868> 2012-10-11 13:43:52.838566 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22c2cd0 seq 4134 osr(0.88 0x2130bd0) 200 bytes (queue has 482 ops and 256759 bytes) -1867> 2012-10-11 13:43:52.838569 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2384870 seq 4135 osr(0.90 0x2130e00) 0x308fd80 -1866> 2012-10-11 13:43:52.838572 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2384870 seq 4135 osr(0.90 0x2130e00) 200 bytes (queue has 482 ops and 256759 bytes) -1865> 2012-10-11 13:43:52.838575 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2384be0 seq 4136 osr(0.91 0x2130dd0) 0x308fc60 -1864> 2012-10-11 13:43:52.838578 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2384be0 seq 4136 osr(0.91 0x2130dd0) 200 bytes (queue has 482 ops and 256759 bytes) -1863> 2012-10-11 13:43:52.838581 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2384a50 seq 4137 osr(0.92 0x2130da0) 0x308fa20 -1862> 2012-10-11 13:43:52.838584 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2384a50 seq 4137 osr(0.92 0x2130da0) 200 bytes (queue has 482 ops and 256759 bytes) -1861> 2012-10-11 13:43:52.838587 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23ea8c0 seq 4138 osr(0.93 0x2130d70) 0x308f7e0 -1860> 2012-10-11 13:43:52.838590 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23ea8c0 seq 4138 osr(0.93 0x2130d70) 200 bytes (queue has 482 ops and 256759 bytes) -1859> 2012-10-11 13:43:52.838593 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23ea730 seq 4139 osr(1.16 0x27a1780) 0x308f630 -1858> 2012-10-11 13:43:52.838596 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23ea730 seq 4139 osr(1.16 0x27a1780) 200 bytes (queue has 482 ops and 256759 bytes) -1857> 2012-10-11 13:43:52.838599 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x28ef9b0 seq 4140 osr(1.1c 0x27a1660) 0x308f6c0 -1856> 2012-10-11 13:43:52.838603 7f4409337700 5 filestore(/data/osd.0) queue_op 0x28ef9b0 seq 4140 osr(1.1c 0x27a1660) 200 bytes (queue has 482 ops and 256759 bytes) -1855> 2012-10-11 13:43:52.838607 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x28ef050 seq 4141 osr(1.1f 0x27a19d0) 0x308f360 -1854> 2012-10-11 13:43:52.838609 7f4409337700 5 filestore(/data/osd.0) queue_op 0x28ef050 seq 4141 osr(1.1f 0x27a19d0) 200 bytes (queue has 482 ops and 256759 bytes) -1853> 2012-10-11 13:43:52.838613 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x28efb90 seq 4142 osr(1.20 0x27a19a0) 0x308f1b0 -1852> 2012-10-11 13:43:52.838615 7f4409337700 5 filestore(/data/osd.0) queue_op 0x28efb90 seq 4142 osr(1.20 0x27a19a0) 200 bytes (queue has 482 ops and 256759 bytes) -1851> 2012-10-11 13:43:52.838618 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x28efa00 seq 4143 osr(1.27 0x27a1850) 0x308f090 -1850> 2012-10-11 13:43:52.838621 7f4409337700 5 filestore(/data/osd.0) queue_op 0x28efa00 seq 4143 osr(1.27 0x27a1850) 200 bytes (queue has 482 ops and 256759 bytes) -1849> 2012-10-11 13:43:52.838625 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2951f00 seq 4144 osr(1.21 0x27a1970) 0x308f510 -1848> 2012-10-11 13:43:52.838627 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2951f00 seq 4144 osr(1.21 0x27a1970) 200 bytes (queue has 482 ops and 256759 bytes) -1847> 2012-10-11 13:43:52.838631 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2951870 seq 4145 osr(1.33 0x27a1a10) 0x308f480 -1846> 2012-10-11 13:43:52.838634 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2951870 seq 4145 osr(1.33 0x27a1a10) 200 bytes (queue has 482 ops and 256759 bytes) -1845> 2012-10-11 13:43:52.838637 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b2c30 seq 4146 osr(1.40 0x27a1fa0) 0x308f2d0 -1844> 2012-10-11 13:43:52.838640 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b2c30 seq 4146 osr(1.40 0x27a1fa0) 200 bytes (queue has 482 ops and 256759 bytes) -1843> 2012-10-11 13:43:52.838647 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a767d0 seq 4147 osr(1.44 0x27a1ee0) 0x308fcf0 -1842> 2012-10-11 13:43:52.838651 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a767d0 seq 4147 osr(1.44 0x27a1ee0) 200 bytes (queue has 482 ops and 256759 bytes) -1841> 2012-10-11 13:43:52.838654 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a76190 seq 4148 osr(1.46 0x27a1e80) 0x308fb40 -1840> 2012-10-11 13:43:52.838656 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a76190 seq 4148 osr(1.46 0x27a1e80) 200 bytes (queue has 482 ops and 256759 bytes) -1839> 2012-10-11 13:43:52.838660 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a76e60 seq 4149 osr(1.47 0x27a1e50) 0x2a06a20 -1838> 2012-10-11 13:43:52.838663 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a76e60 seq 4149 osr(1.47 0x27a1e50) 200 bytes (queue has 482 ops and 256759 bytes) -1837> 2012-10-11 13:43:52.838665 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a76cd0 seq 4150 osr(1.48 0x27a1e20) 0x2a066c0 -1836> 2012-10-11 13:43:52.838669 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a76cd0 seq 4150 osr(1.48 0x27a1e20) 200 bytes (queue has 482 ops and 256759 bytes) -1835> 2012-10-11 13:43:52.838672 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a76b40 seq 4151 osr(1.4b 0x2adb190) 0x2a06d80 -1834> 2012-10-11 13:43:52.838674 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a76b40 seq 4151 osr(1.4b 0x2adb190) 200 bytes (queue has 482 ops and 256759 bytes) -1833> 2012-10-11 13:43:52.838681 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2adc690 seq 4152 osr(1.51 0x2adb070) 0x2a06990 -1832> 2012-10-11 13:43:52.838684 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2adc690 seq 4152 osr(1.51 0x2adb070) 200 bytes (queue has 482 ops and 256759 bytes) -1831> 2012-10-11 13:43:52.838687 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2adcd20 seq 4153 osr(1.59 0x2adb2f0) 0x2a06870 -1830> 2012-10-11 13:43:52.838689 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2adcd20 seq 4153 osr(1.59 0x2adb2f0) 200 bytes (queue has 482 ops and 256759 bytes) -1829> 2012-10-11 13:43:52.838693 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2b3b0a0 seq 4154 osr(1.5a 0x2adb2c0) 0x2a06630 -1828> 2012-10-11 13:43:52.838695 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2b3b0a0 seq 4154 osr(1.5a 0x2adb2c0) 200 bytes (queue has 482 ops and 256759 bytes) -1827> 2012-10-11 13:43:52.838698 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2b3bf00 seq 4155 osr(1.5f 0x2adb5d0) 0x2a06750 -1826> 2012-10-11 13:43:52.838701 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2b3bf00 seq 4155 osr(1.5f 0x2adb5d0) 200 bytes (queue has 482 ops and 256759 bytes) -1825> 2012-10-11 13:43:52.838704 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2bbe730 seq 4156 osr(1.6d 0x2adb730) 0x2d2df30 -1824> 2012-10-11 13:43:52.838707 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2bbe730 seq 4156 osr(1.6d 0x2adb730) 200 bytes (queue has 482 ops and 256759 bytes) -1823> 2012-10-11 13:43:52.838710 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c20140 seq 4157 osr(1.6e 0x2adb700) 0x2d2dea0 -1822> 2012-10-11 13:43:52.838712 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c20140 seq 4157 osr(1.6e 0x2adb700) 200 bytes (queue has 482 ops and 256759 bytes) -1821> 2012-10-11 13:43:52.838715 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c20fa0 seq 4158 osr(1.72 0x2adb640) 0x2d2de10 -1820> 2012-10-11 13:43:52.838719 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c20fa0 seq 4158 osr(1.72 0x2adb640) 200 bytes (queue has 482 ops and 256759 bytes) -1819> 2012-10-11 13:43:52.838721 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c82960 seq 4159 osr(1.79 0x2adb8f0) 0x2d2dd80 -1818> 2012-10-11 13:43:52.838725 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c82960 seq 4159 osr(1.79 0x2adb8f0) 200 bytes (queue has 482 ops and 256759 bytes) -1817> 2012-10-11 13:43:52.838727 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c82e60 seq 4160 osr(1.7a 0x2adb8c0) 0x2d2dcf0 -1816> 2012-10-11 13:43:52.838730 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c82e60 seq 4160 osr(1.7a 0x2adb8c0) 200 bytes (queue has 482 ops and 256759 bytes) -1815> 2012-10-11 13:43:52.838733 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c82cd0 seq 4161 osr(0.58 0x2130440) 0x22ff630 -1814> 2012-10-11 13:43:52.838736 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c82cd0 seq 4161 osr(0.58 0x2130440) 200 bytes (queue has 482 ops and 256759 bytes) -1813> 2012-10-11 13:43:52.838739 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x219b3c0 seq 4162 osr(0.5c 0x2130380) 0x22ff870 -1812> 2012-10-11 13:43:52.838742 7f4409337700 5 filestore(/data/osd.0) queue_op 0x219b3c0 seq 4162 osr(0.5c 0x2130380) 200 bytes (queue has 482 ops and 256759 bytes) -1811> 2012-10-11 13:43:52.838745 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x219bd70 seq 4163 osr(0.65 0x21304e0) 0x2aa3870 -1810> 2012-10-11 13:43:52.838751 7f4409337700 5 filestore(/data/osd.0) queue_op 0x219bd70 seq 4163 osr(0.65 0x21304e0) 200 bytes (queue has 482 ops and 256759 bytes) -1809> 2012-10-11 13:43:52.838753 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21fff50 seq 4164 osr(0.64 0x2130510) 0x29311b0 -1808> 2012-10-11 13:43:52.838755 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21fff50 seq 4164 osr(0.64 0x2130510) 200 bytes (queue has 482 ops and 256759 bytes) -1807> 2012-10-11 13:43:52.838758 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21ff0f0 seq 4165 osr(0.6b 0x21306f0) 0x2931480 -1806> 2012-10-11 13:43:52.838762 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21ff0f0 seq 4165 osr(0.6b 0x21306f0) 200 bytes (queue has 482 ops and 256759 bytes) -1805> 2012-10-11 13:43:52.838765 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x225f5f0 seq 4166 osr(0.6d 0x2130690) 0x2931360 -1804> 2012-10-11 13:43:52.838767 7f4409337700 5 filestore(/data/osd.0) queue_op 0x225f5f0 seq 4166 osr(0.6d 0x2130690) 200 bytes (queue has 482 ops and 256759 bytes) -1803> 2012-10-11 13:43:52.838769 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x225f2d0 seq 4167 osr(0.71 0x2130920) 0x2931bd0 -1802> 2012-10-11 13:43:52.838771 7f4409337700 5 filestore(/data/osd.0) queue_op 0x225f2d0 seq 4167 osr(0.71 0x2130920) 200 bytes (queue has 482 ops and 256759 bytes) -1801> 2012-10-11 13:43:52.838774 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x225fc80 seq 4168 osr(0.6c 0x21306c0) 0x2931f30 -1800> 2012-10-11 13:43:52.838776 7f4409337700 5 filestore(/data/osd.0) queue_op 0x225fc80 seq 4168 osr(0.6c 0x21306c0) 200 bytes (queue has 482 ops and 256759 bytes) -1799> 2012-10-11 13:43:52.838779 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x225f460 seq 4169 osr(0.75 0x2130860) 0x29316c0 -1798> 2012-10-11 13:43:52.838781 7f4409337700 5 filestore(/data/osd.0) queue_op 0x225f460 seq 4169 osr(0.75 0x2130860) 200 bytes (queue has 482 ops and 256759 bytes) -1797> 2012-10-11 13:43:52.838783 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22c2640 seq 4170 osr(0.77 0x2130800) 0x1d86ea0 -1796> 2012-10-11 13:43:52.838786 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22c2640 seq 4170 osr(0.77 0x2130800) 200 bytes (queue has 482 ops and 256759 bytes) -1795> 2012-10-11 13:43:52.838788 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22c2320 seq 4171 osr(0.74 0x2130890) 0x1d86d80 -1794> 2012-10-11 13:43:52.838790 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22c2320 seq 4171 osr(0.74 0x2130890) 200 bytes (queue has 482 ops and 256759 bytes) -1793> 2012-10-11 13:43:52.838793 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22c27d0 seq 4172 osr(0.7e 0x2130a20) 0x1d86e10 -1792> 2012-10-11 13:43:52.838795 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22c27d0 seq 4172 osr(0.7e 0x2130a20) 200 bytes (queue has 482 ops and 256759 bytes) -1791> 2012-10-11 13:43:52.838798 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2324820 seq 4173 osr(0.80 0x21309c0) 0x1d86f30 -1790> 2012-10-11 13:43:52.838800 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2324820 seq 4173 osr(0.80 0x21309c0) 200 bytes (queue has 482 ops and 256759 bytes) -1789> 2012-10-11 13:43:53.122366 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e177d0 seq 3776 osr(0.1e 0x1d71830)/0x1d71830 start -1788> 2012-10-11 13:43:53.122497 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.9a 0x2130fb0)/0x2130fb0 -1787> 2012-10-11 13:43:53.122512 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1786> 2012-10-11 13:43:53.122515 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1785> 2012-10-11 13:43:53.122517 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4256 0x2e55630 -1784> 2012-10-11 13:43:53.122523 7f4401226700 5 journal submit_entry seq 4256 len 65 (0x2f516f0) -1783> 2012-10-11 13:43:53.122526 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1782> 2012-10-11 13:43:53.122530 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1781> 2012-10-11 13:43:53.123726 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e17870 seq 3777 osr(0.23 0x1d71910)/0x1d71910 start -1780> 2012-10-11 13:43:53.125020 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x236ccd0 seq 3778 osr(2.9e 0x2130e20)/0x2130e20 start -1779> 2012-10-11 13:43:53.130620 7f4408335700 5 filestore(/data/osd.0) _do_op 0x23d5320 seq 3779 osr(0.25 0x1d718b0)/0x1d718b0 start -1778> 2012-10-11 13:43:53.130705 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.9c 0x2130d90)/0x2130d90 -1777> 2012-10-11 13:43:53.130718 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1776> 2012-10-11 13:43:53.130722 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1775> 2012-10-11 13:43:53.130724 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4257 0x2e55360 -1774> 2012-10-11 13:43:53.130729 7f4401226700 5 journal submit_entry seq 4257 len 65 (0x2f51630) -1773> 2012-10-11 13:43:53.130732 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1772> 2012-10-11 13:43:53.130735 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1771> 2012-10-11 13:43:53.131958 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2e31e60 seq 3780 osr(2.a1 0x2468000)/0x2468000 start -1770> 2012-10-11 13:43:53.174118 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 80 (0xb7c748 -> 4) -1769> 2012-10-11 13:43:53.174141 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 15271 (0xb7c748 -> 257) -1768> 2012-10-11 13:43:53.174144 7f440a339700 5 journal put_throttle finished 80 ops and 15271 bytes, now 4 ops and 257 bytes -1767> 2012-10-11 13:43:53.174154 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2324500 seq 4174 osr(0.83 0x2130930) 0x3039240 -1766> 2012-10-11 13:43:53.174169 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2324500 seq 4174 osr(0.83 0x2130930) 200 bytes (queue has 479 ops and 253718 bytes) -1765> 2012-10-11 13:43:53.174175 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2324050 seq 4175 osr(0.85 0x2130c60) 0x3039d80 -1764> 2012-10-11 13:43:53.174179 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2324050 seq 4175 osr(0.85 0x2130c60) 200 bytes (queue has 479 ops and 253718 bytes) -1763> 2012-10-11 13:43:53.174182 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2324d20 seq 4176 osr(0.84 0x2130c90) 0x3039e10 -1762> 2012-10-11 13:43:53.174185 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2324d20 seq 4176 osr(0.84 0x2130c90) 200 bytes (queue has 479 ops and 253718 bytes) -1761> 2012-10-11 13:43:53.174188 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2324eb0 seq 4177 osr(0.86 0x2130c30) 0x3039cf0 -1760> 2012-10-11 13:43:53.174191 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2324eb0 seq 4177 osr(0.86 0x2130c30) 200 bytes (queue has 479 ops and 253718 bytes) -1759> 2012-10-11 13:43:53.174194 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2324b90 seq 4178 osr(0.89 0x2130ba0) 0x3039c60 -1758> 2012-10-11 13:43:53.174196 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2324b90 seq 4178 osr(0.89 0x2130ba0) 200 bytes (queue has 479 ops and 253718 bytes) -1757> 2012-10-11 13:43:53.174206 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x23846e0 seq 4179 osr(1.23 0x27a1910) 0x3039bd0 -1756> 2012-10-11 13:43:53.174215 7f4409337700 5 filestore(/data/osd.0) queue_op 0x23846e0 seq 4179 osr(1.23 0x27a1910) 200 bytes (queue has 479 ops and 253718 bytes) -1755> 2012-10-11 13:43:53.174219 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2951550 seq 4180 osr(1.2b 0x27a1b90) 0x24bc120 -1754> 2012-10-11 13:43:53.174222 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2951550 seq 4180 osr(1.2b 0x27a1b90) 200 bytes (queue has 479 ops and 253718 bytes) -1753> 2012-10-11 13:43:53.174227 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b28c0 seq 4181 osr(1.31 0x27a1a70) 0x24bc000 -1752> 2012-10-11 13:43:53.174230 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b28c0 seq 4181 osr(1.31 0x27a1a70) 200 bytes (queue has 479 ops and 253718 bytes) -1751> 2012-10-11 13:43:53.174233 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b2f50 seq 4182 osr(1.32 0x27a1a40) 0x24bc1b0 -1750> 2012-10-11 13:43:53.174238 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b2f50 seq 4182 osr(1.32 0x27a1a40) 200 bytes (queue has 479 ops and 253718 bytes) -1749> 2012-10-11 13:43:53.174241 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b2dc0 seq 4183 osr(1.37 0x27a1d50) 0x3157d80 -1748> 2012-10-11 13:43:53.174244 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b2dc0 seq 4183 osr(1.37 0x27a1d50) 200 bytes (queue has 479 ops and 253718 bytes) -1747> 2012-10-11 13:43:53.174248 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a175f0 seq 4184 osr(1.3b 0x27a1c90) 0x31571b0 -1746> 2012-10-11 13:43:53.174251 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a175f0 seq 4184 osr(1.3b 0x27a1c90) 200 bytes (queue has 479 ops and 253718 bytes) -1745> 2012-10-11 13:43:53.174254 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a17fa0 seq 4185 osr(1.3f 0x27a1fd0) 0x3157f30 -1744> 2012-10-11 13:43:53.174258 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a17fa0 seq 4185 osr(1.3f 0x27a1fd0) 200 bytes (queue has 479 ops and 253718 bytes) -1743> 2012-10-11 13:43:53.174261 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2a76960 seq 4186 osr(1.2e 0x27a1b00) 0x31576c0 -1742> 2012-10-11 13:43:53.174263 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2a76960 seq 4186 osr(1.2e 0x27a1b00) 200 bytes (queue has 479 ops and 253718 bytes) -1741> 2012-10-11 13:43:53.174267 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b2410 seq 4187 osr(1.5b 0x2adb290) 0x3157a20 -1740> 2012-10-11 13:43:53.174270 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b2410 seq 4187 osr(1.5b 0x2adb290) 200 bytes (queue has 479 ops and 253718 bytes) -1739> 2012-10-11 13:43:53.174273 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2b3bd70 seq 4188 osr(1.63 0x2adb510) 0x2ac9f30 -1738> 2012-10-11 13:43:53.174276 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2b3bd70 seq 4188 osr(1.63 0x2adb510) 200 bytes (queue has 479 ops and 253718 bytes) -1737> 2012-10-11 13:43:53.174279 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2bbe0f0 seq 4189 osr(1.57 0x2adb350) 0x31572d0 -1736> 2012-10-11 13:43:53.174283 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2bbe0f0 seq 4189 osr(1.57 0x2adb350) 200 bytes (queue has 479 ops and 253718 bytes) -1735> 2012-10-11 13:43:53.174285 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2b3b3c0 seq 4190 osr(1.6a 0x2adb7c0) 0x2ac96c0 -1734> 2012-10-11 13:43:53.174288 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2b3b3c0 seq 4190 osr(1.6a 0x2adb7c0) 200 bytes (queue has 479 ops and 253718 bytes) -1733> 2012-10-11 13:43:53.174292 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c205f0 seq 4191 osr(1.6b 0x2adb790) 0x2ac9e10 -1732> 2012-10-11 13:43:53.174295 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c205f0 seq 4191 osr(1.6b 0x2adb790) 200 bytes (queue has 479 ops and 253718 bytes) -1731> 2012-10-11 13:43:53.174297 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c20460 seq 4192 osr(1.64 0x2adb4e0) 0x24b67e0 -1730> 2012-10-11 13:43:53.174301 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c20460 seq 4192 osr(1.64 0x2adb4e0) 200 bytes (queue has 479 ops and 253718 bytes) -1729> 2012-10-11 13:43:53.174303 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2bbef50 seq 4193 osr(1.70 0x2adb6a0) 0x24b6900 -1728> 2012-10-11 13:43:53.174307 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2bbef50 seq 4193 osr(1.70 0x2adb6a0) 200 bytes (queue has 479 ops and 253718 bytes) -1727> 2012-10-11 13:43:53.174310 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c20c80 seq 4194 osr(1.6c 0x2adb760) 0x24b6a20 -1726> 2012-10-11 13:43:53.174312 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c20c80 seq 4194 osr(1.6c 0x2adb760) 200 bytes (queue has 479 ops and 253718 bytes) -1725> 2012-10-11 13:43:53.174316 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c202d0 seq 4195 osr(1.73 0x2adb610) 0x301d120 -1724> 2012-10-11 13:43:53.174321 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c202d0 seq 4195 osr(1.73 0x2adb610) 200 bytes (queue has 479 ops and 253718 bytes) -1723> 2012-10-11 13:43:53.174325 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c827d0 seq 4196 osr(1.74 0x2adb9e0) 0x301d480 -1722> 2012-10-11 13:43:53.174327 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c827d0 seq 4196 osr(1.74 0x2adb9e0) 200 bytes (queue has 479 ops and 253718 bytes) -1721> 2012-10-11 13:43:53.174331 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c82640 seq 4197 osr(1.76 0x2adb980) 0x301dea0 -1720> 2012-10-11 13:43:53.174335 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c82640 seq 4197 osr(1.76 0x2adb980) 200 bytes (queue has 479 ops and 253718 bytes) -1719> 2012-10-11 13:43:53.174338 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c82320 seq 4198 osr(1.7d 0x2adb830) 0x301dbd0 -1718> 2012-10-11 13:43:53.174340 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c82320 seq 4198 osr(1.7d 0x2adb830) 200 bytes (queue has 479 ops and 253718 bytes) -1717> 2012-10-11 13:43:53.174342 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2ce7820 seq 4199 osr(1.82 0x2adbb40) 0x301d630 -1716> 2012-10-11 13:43:53.174345 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2ce7820 seq 4199 osr(1.82 0x2adbb40) 200 bytes (queue has 479 ops and 253718 bytes) -1715> 2012-10-11 13:43:53.174347 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2ce7050 seq 4200 osr(1.83 0x2adbb10) 0x301d5a0 -1714> 2012-10-11 13:43:53.174350 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2ce7050 seq 4200 osr(1.83 0x2adbb10) 200 bytes (queue has 479 ops and 253718 bytes) -1713> 2012-10-11 13:43:53.174352 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2ce7eb0 seq 4201 osr(2.22 0x1d71920) 0x301d240 -1712> 2012-10-11 13:43:53.174355 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2ce7eb0 seq 4201 osr(2.22 0x1d71920) 200 bytes (queue has 479 ops and 253718 bytes) -1711> 2012-10-11 13:43:53.174357 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21e4d20 seq 4202 osr(2.2a 0x3176600) 0x301d7e0 -1710> 2012-10-11 13:43:53.174360 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21e4d20 seq 4202 osr(2.2a 0x3176600) 200 bytes (queue has 479 ops and 253718 bytes) -1709> 2012-10-11 13:43:53.174363 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21ca690 seq 4203 osr(2.2d 0x3176570) 0x301dab0 -1708> 2012-10-11 13:43:53.174365 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21ca690 seq 4203 osr(2.2d 0x3176570) 200 bytes (queue has 479 ops and 253718 bytes) -1707> 2012-10-11 13:43:53.174368 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21ca140 seq 4204 osr(2.30 0x1d71ab0) 0x301d000 -1706> 2012-10-11 13:43:53.174370 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21ca140 seq 4204 osr(2.30 0x1d71ab0) 200 bytes (queue has 479 ops and 253718 bytes) -1705> 2012-10-11 13:43:53.174372 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2045b40 seq 4205 osr(2.31 0x1d71b00) 0x301d990 -1704> 2012-10-11 13:43:53.174374 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2045b40 seq 4205 osr(2.31 0x1d71b00) 200 bytes (queue has 479 ops and 253718 bytes) -1703> 2012-10-11 13:43:53.174377 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x20459b0 seq 4206 osr(2.36 0x31766d0) 0x301dc60 -1702> 2012-10-11 13:43:53.174379 7f4409337700 5 filestore(/data/osd.0) queue_op 0x20459b0 seq 4206 osr(2.36 0x31766d0) 200 bytes (queue has 479 ops and 253718 bytes) -1701> 2012-10-11 13:43:53.174382 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1faee10 seq 4207 osr(2.3a 0x1d71db0) 0x301d900 -1700> 2012-10-11 13:43:53.174384 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1faee10 seq 4207 osr(2.3a 0x1d71db0) 200 bytes (queue has 479 ops and 253718 bytes) -1699> 2012-10-11 13:43:53.174387 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2045820 seq 4208 osr(2.3e 0x1d71c50) 0x301d750 -1698> 2012-10-11 13:43:53.174390 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2045820 seq 4208 osr(2.3e 0x1d71c50) 200 bytes (queue has 479 ops and 253718 bytes) -1697> 2012-10-11 13:43:53.174393 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x20451e0 seq 4209 osr(2.56 0x31768b0) 0x301df30 -1696> 2012-10-11 13:43:53.174396 7f4409337700 5 filestore(/data/osd.0) queue_op 0x20451e0 seq 4209 osr(2.56 0x31768b0) 200 bytes (queue has 479 ops and 253718 bytes) -1695> 2012-10-11 13:43:53.174399 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x32d0550 seq 4210 osr(2.5a 0x21301c0) 0x301d6c0 -1694> 2012-10-11 13:43:53.174405 7f4409337700 5 filestore(/data/osd.0) queue_op 0x32d0550 seq 4210 osr(2.5a 0x21301c0) 200 bytes (queue has 479 ops and 253718 bytes) -1693> 2012-10-11 13:43:53.174409 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x32d0f00 seq 4211 osr(2.62 0x3176930) 0x301de10 -1692> 2012-10-11 13:43:53.174415 7f4409337700 5 filestore(/data/osd.0) queue_op 0x32d0f00 seq 4211 osr(2.62 0x3176930) 200 bytes (queue has 479 ops and 253718 bytes) -1691> 2012-10-11 13:43:53.174418 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21b4a50 seq 4212 osr(2.63 0x2130520) 0x301d870 -1690> 2012-10-11 13:43:53.174432 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21b4a50 seq 4212 osr(2.63 0x2130520) 200 bytes (queue has 479 ops and 253718 bytes) -1689> 2012-10-11 13:43:53.174435 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21b4d70 seq 4213 osr(2.69 0x3176a90) 0x301da20 -1688> 2012-10-11 13:43:53.174437 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21b4d70 seq 4213 osr(2.69 0x3176a90) 200 bytes (queue has 479 ops and 253718 bytes) -1687> 2012-10-11 13:43:53.174441 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x225fb90 seq 4214 osr(2.6a 0x3176a60) 0x301dcf0 -1686> 2012-10-11 13:43:53.174443 7f4409337700 5 filestore(/data/osd.0) queue_op 0x225fb90 seq 4214 osr(2.6a 0x3176a60) 200 bytes (queue has 479 ops and 253718 bytes) -1685> 2012-10-11 13:43:53.174446 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22d5780 seq 4215 osr(2.6b 0x3176a30) 0x22ff3f0 -1684> 2012-10-11 13:43:53.174449 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22d5780 seq 4215 osr(2.6b 0x3176a30) 200 bytes (queue has 479 ops and 253718 bytes) -1683> 2012-10-11 13:43:53.174455 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22d55f0 seq 4216 osr(2.6f 0x21306e0) 0x22ffd80 -1682> 2012-10-11 13:43:53.174458 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22d55f0 seq 4216 osr(2.6f 0x21306e0) 200 bytes (queue has 479 ops and 253718 bytes) -1681> 2012-10-11 13:43:53.174460 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22d5fa0 seq 4217 osr(2.72 0x21304c0) 0x250e510 -1680> 2012-10-11 13:43:53.174463 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22d5fa0 seq 4217 osr(2.72 0x21304c0) 200 bytes (queue has 479 ops and 253718 bytes) -1679> 2012-10-11 13:43:53.174466 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x22c2d20 seq 4218 osr(2.73 0x21304a0) 0x22ffab0 -1678> 2012-10-11 13:43:53.174469 7f4409337700 5 filestore(/data/osd.0) queue_op 0x22c2d20 seq 4218 osr(2.73 0x21304a0) 200 bytes (queue has 479 ops and 253718 bytes) -1677> 2012-10-11 13:43:53.174471 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2c82d70 seq 4219 osr(2.75 0x3176af0) 0x22fff30 -1676> 2012-10-11 13:43:53.174475 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2c82d70 seq 4219 osr(2.75 0x3176af0) 200 bytes (queue has 479 ops and 253718 bytes) -1675> 2012-10-11 13:43:53.174478 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x219baa0 seq 4220 osr(2.7c 0x2130640) 0x22ff6c0 -1674> 2012-10-11 13:43:53.174480 7f4409337700 5 filestore(/data/osd.0) queue_op 0x219baa0 seq 4220 osr(2.7c 0x2130640) 200 bytes (queue has 479 ops and 253718 bytes) -1673> 2012-10-11 13:43:53.174484 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236c3c0 seq 4221 osr(2.7e 0x1d71d70) 0x22ff5a0 -1672> 2012-10-11 13:43:53.174486 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236c3c0 seq 4221 osr(2.7e 0x1d71d70) 200 bytes (queue has 479 ops and 253718 bytes) -1671> 2012-10-11 13:43:53.174489 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x236c050 seq 4222 osr(2.81 0x3176b40) 0x250e2d0 -1670> 2012-10-11 13:43:53.174492 7f4409337700 5 filestore(/data/osd.0) queue_op 0x236c050 seq 4222 osr(2.81 0x3176b40) 200 bytes (queue has 479 ops and 253718 bytes) -1669> 2012-10-11 13:43:53.174495 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x225fe60 seq 4223 osr(2.82 0x2130c80) 0x250ed80 -1668> 2012-10-11 13:43:53.174498 7f4409337700 5 filestore(/data/osd.0) queue_op 0x225fe60 seq 4223 osr(2.82 0x2130c80) 200 bytes (queue has 479 ops and 253718 bytes) -1667> 2012-10-11 13:43:53.174501 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x21fffa0 seq 4224 osr(2.83 0x21309d0) 0x301d360 -1666> 2012-10-11 13:43:53.174504 7f4409337700 5 filestore(/data/osd.0) queue_op 0x21fffa0 seq 4224 osr(2.83 0x21309d0) 200 bytes (queue has 479 ops and 253718 bytes) -1665> 2012-10-11 13:43:53.174506 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x219b0f0 seq 4225 osr(2.84 0x2130980) 0x2e55f30 -1664> 2012-10-11 13:43:53.174510 7f4409337700 5 filestore(/data/osd.0) queue_op 0x219b0f0 seq 4225 osr(2.84 0x2130980) 200 bytes (queue has 479 ops and 253718 bytes) -1663> 2012-10-11 13:43:53.174512 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x213b000 seq 4226 osr(2.87 0x2130a90) 0x250e870 -1662> 2012-10-11 13:43:53.174516 7f4409337700 5 filestore(/data/osd.0) queue_op 0x213b000 seq 4226 osr(2.87 0x2130a90) 200 bytes (queue has 479 ops and 253718 bytes) -1661> 2012-10-11 13:43:53.174519 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x32d0500 seq 4227 osr(1.88 0x2adba20) 0x2a06900 -1660> 2012-10-11 13:43:53.174524 7f4409337700 5 filestore(/data/osd.0) queue_op 0x32d0500 seq 4227 osr(1.88 0x2adba20) 200 bytes (queue has 479 ops and 253718 bytes) -1659> 2012-10-11 13:43:53.174527 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2d4c690 seq 4228 osr(0.40 0x1d71e80) 0x2a06120 -1658> 2012-10-11 13:43:53.174529 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2d4c690 seq 4228 osr(0.40 0x1d71e80) 200 bytes (queue has 479 ops and 253718 bytes) -1657> 2012-10-11 13:43:53.174531 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x20d67d0 seq 4229 osr(1.84 0x2adbae0) 0x3250d80 -1656> 2012-10-11 13:43:53.174534 7f4409337700 5 filestore(/data/osd.0) queue_op 0x20d67d0 seq 4229 osr(1.84 0x2adbae0) 200 bytes (queue has 479 ops and 253718 bytes) -1655> 2012-10-11 13:43:53.174536 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2ce7cd0 seq 4230 osr(1.85 0x2adbab0) 0x3250090 -1654> 2012-10-11 13:43:53.174539 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2ce7cd0 seq 4230 osr(1.85 0x2adbab0) 200 bytes (queue has 479 ops and 253718 bytes) -1653> 2012-10-11 13:43:53.174541 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2ce7b40 seq 4231 osr(0.3c 0x1d71cd0) 0x32505a0 -1652> 2012-10-11 13:43:53.174543 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2ce7b40 seq 4231 osr(0.3c 0x1d71cd0) 200 bytes (queue has 479 ops and 253718 bytes) -1651> 2012-10-11 13:43:53.174546 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x25db9b0 seq 4232 osr(0.38 0x1d71d90) 0x31cbe10 -1650> 2012-10-11 13:43:53.174549 7f4409337700 5 filestore(/data/osd.0) queue_op 0x25db9b0 seq 4232 osr(0.38 0x1d71d90) 200 bytes (queue has 479 ops and 253718 bytes) -1649> 2012-10-11 13:43:53.174552 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x206a3c0 seq 4233 osr(0.33 0x1d71c30) 0x2cda090 -1648> 2012-10-11 13:43:53.174554 7f4409337700 5 filestore(/data/osd.0) queue_op 0x206a3c0 seq 4233 osr(0.33 0x1d71c30) 200 bytes (queue has 479 ops and 253718 bytes) -1647> 2012-10-11 13:43:53.174557 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x200a960 seq 4234 osr(0.32 0x1d71c60) 0x2e552d0 -1646> 2012-10-11 13:43:53.174560 7f4409337700 5 filestore(/data/osd.0) queue_op 0x200a960 seq 4234 osr(0.32 0x1d71c60) 200 bytes (queue has 479 ops and 253718 bytes) -1645> 2012-10-11 13:43:53.174564 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x200aaf0 seq 4235 osr(0.2f 0x1d71ac0) 0x1e41bd0 -1644> 2012-10-11 13:43:53.174566 7f4409337700 5 filestore(/data/osd.0) queue_op 0x200aaf0 seq 4235 osr(0.2f 0x1d71ac0) 200 bytes (queue has 479 ops and 253718 bytes) -1643> 2012-10-11 13:43:53.174569 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x200a0f0 seq 4236 osr(0.2c 0x1d71b50) 0x2e55c60 -1642> 2012-10-11 13:43:53.174572 7f4409337700 5 filestore(/data/osd.0) queue_op 0x200a0f0 seq 4236 osr(0.2c 0x1d71b50) 200 bytes (queue has 479 ops and 253718 bytes) -1641> 2012-10-11 13:43:53.174575 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x200a5a0 seq 4237 osr(0.24 0x1d718e0) 0x2e55b40 -1640> 2012-10-11 13:43:53.174579 7f4409337700 5 filestore(/data/osd.0) queue_op 0x200a5a0 seq 4237 osr(0.24 0x1d718e0) 200 bytes (queue has 479 ops and 253718 bytes) -1639> 2012-10-11 13:43:53.174581 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x29b23c0 seq 4238 osr(1.92 0x2adbc40) 0x2d2dab0 -1638> 2012-10-11 13:43:53.174584 7f4409337700 5 filestore(/data/osd.0) queue_op 0x29b23c0 seq 4238 osr(1.92 0x2adbc40) 200 bytes (queue has 479 ops and 253718 bytes) -1637> 2012-10-11 13:43:53.174588 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2db1730 seq 4239 osr(1.91 0x2adbc70) 0x2d2da20 -1636> 2012-10-11 13:43:53.174590 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2db1730 seq 4239 osr(1.91 0x2adbc70) 200 bytes (queue has 479 ops and 253718 bytes) -1635> 2012-10-11 13:43:53.174594 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2db18c0 seq 4240 osr(1.8f 0x2adbcd0) 0x2d2d990 -1634> 2012-10-11 13:43:53.174596 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2db18c0 seq 4240 osr(1.8f 0x2adbcd0) 200 bytes (queue has 479 ops and 253718 bytes) -1633> 2012-10-11 13:43:53.174599 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2d4cbe0 seq 4241 osr(1.87 0x2adba50) 0x2d2d900 -1632> 2012-10-11 13:43:53.174602 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2d4cbe0 seq 4241 osr(1.87 0x2adba50) 200 bytes (queue has 479 ops and 253718 bytes) -1631> 2012-10-11 13:43:53.174606 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2d4c870 seq 4242 osr(0.41 0x1d71e50) 0x2d2d870 -1630> 2012-10-11 13:43:53.174608 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2d4c870 seq 4242 osr(0.41 0x1d71e50) 200 bytes (queue has 479 ops and 253718 bytes) -1629> 2012-10-11 13:43:53.174614 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x20d6690 seq 4243 osr(0.34 0x1d71c00) 0x2d2d7e0 -1628> 2012-10-11 13:43:53.174620 7f4409337700 5 filestore(/data/osd.0) queue_op 0x20d6690 seq 4243 osr(0.34 0x1d71c00) 200 bytes (queue has 479 ops and 253718 bytes) -1627> 2012-10-11 13:43:53.174622 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x200a820 seq 4244 osr(0.28 0x1d71a00) 0x2d2d750 -1626> 2012-10-11 13:43:53.174625 7f4409337700 5 filestore(/data/osd.0) queue_op 0x200a820 seq 4244 osr(0.28 0x1d71a00) 200 bytes (queue has 479 ops and 253718 bytes) -1625> 2012-10-11 13:43:53.174627 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x1fae960 seq 4245 osr(0.22 0x1d71940) 0x2d2d630 -1624> 2012-10-11 13:43:53.174631 7f4409337700 5 filestore(/data/osd.0) queue_op 0x1fae960 seq 4245 osr(0.22 0x1d71940) 200 bytes (queue has 479 ops and 253718 bytes) -1623> 2012-10-11 13:43:53.174634 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24971e0 seq 4246 osr(1.b9 0x2e384f0) 0x22ffbd0 -1622> 2012-10-11 13:43:53.174636 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24971e0 seq 4246 osr(1.b9 0x2e384f0) 59 bytes (queue has 479 ops and 253718 bytes) -1621> 2012-10-11 13:43:53.174639 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497140 seq 4247 osr(1.c2 0x2e38740) 0x31c56c0 -1620> 2012-10-11 13:43:53.174641 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497140 seq 4247 osr(1.c2 0x2e38740) 59 bytes (queue has 479 ops and 253718 bytes) -1619> 2012-10-11 13:43:53.174646 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497190 seq 4248 osr(1.cb 0x2e38990) 0x31c5090 -1618> 2012-10-11 13:43:53.174649 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497190 seq 4248 osr(1.cb 0x2e38990) 59 bytes (queue has 479 ops and 253718 bytes) -1617> 2012-10-11 13:43:53.174651 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497e10 seq 4249 osr(1.cf 0x2e388d0) 0x30391b0 -1616> 2012-10-11 13:43:53.174653 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497e10 seq 4249 osr(1.cf 0x2e388d0) 59 bytes (queue has 479 ops and 253718 bytes) -1615> 2012-10-11 13:43:53.174656 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497e60 seq 4250 osr(1.ee 0x2e38f00) 0x31c5f30 -1614> 2012-10-11 13:43:53.174658 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497e60 seq 4250 osr(1.ee 0x2e38f00) 59 bytes (queue has 479 ops and 253718 bytes) -1613> 2012-10-11 13:43:53.174661 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24970a0 seq 4251 osr(1.f9 0x31760f0) 0x31c5360 -1612> 2012-10-11 13:43:53.174663 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24970a0 seq 4251 osr(1.f9 0x31760f0) 59 bytes (queue has 479 ops and 253718 bytes) -1611> 2012-10-11 13:43:53.174665 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497c80 seq 4252 osr(1.fd 0x3176030) 0x3039990 -1610> 2012-10-11 13:43:53.174668 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497c80 seq 4252 osr(1.fd 0x3176030) 59 bytes (queue has 479 ops and 253718 bytes) -1609> 2012-10-11 13:43:53.174670 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497cd0 seq 4253 osr(2.4 0x3176270) 0x3039000 -1608> 2012-10-11 13:43:53.174672 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497cd0 seq 4253 osr(2.4 0x3176270) 58 bytes (queue has 479 ops and 253718 bytes) -1607> 2012-10-11 13:43:53.194066 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 4 (0xb7c748 -> 0) -1606> 2012-10-11 13:43:53.194205 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 257 (0xb7c748 -> 0) -1605> 2012-10-11 13:43:53.194210 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497d20 seq 4254 osr(2.7 0x1d71320) 0x3039b40 -1604> 2012-10-11 13:43:53.194222 7f440a339700 5 journal put_throttle finished 4 ops and 257 bytes, now 0 ops and 0 bytes -1603> 2012-10-11 13:43:53.194231 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497d20 seq 4254 osr(2.7 0x1d71320) 58 bytes (queue has 479 ops and 253718 bytes) -1602> 2012-10-11 13:43:53.194260 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497d70 seq 4255 osr(2.12 0x1d715a0) 0x3039f30 -1601> 2012-10-11 13:43:53.194274 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497d70 seq 4255 osr(2.12 0x1d715a0) 59 bytes (queue has 479 ops and 253718 bytes) -1600> 2012-10-11 13:43:53.194277 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497dc0 seq 4256 osr(2.9a 0x2130fb0) 0x2e55630 -1599> 2012-10-11 13:43:53.194280 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497dc0 seq 4256 osr(2.9a 0x2130fb0) 60 bytes (queue has 479 ops and 253718 bytes) -1598> 2012-10-11 13:43:53.194283 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497000 seq 4257 osr(2.9c 0x2130d90) 0x2e55360 -1597> 2012-10-11 13:43:53.194287 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497000 seq 4257 osr(2.9c 0x2130d90) 60 bytes (queue has 479 ops and 253718 bytes) -1596> 2012-10-11 13:43:53.196015 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x23d5140 seq 3781 osr(1.1d 0x27a1630)/0x27a1630 start -1595> 2012-10-11 13:43:53.196139 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.9e 0x2130e20)/0x2130e20 -1594> 2012-10-11 13:43:53.196152 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1593> 2012-10-11 13:43:53.196166 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1592> 2012-10-11 13:43:53.196168 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4258 0x2e55480 -1591> 2012-10-11 13:43:53.196174 7f4401226700 5 journal submit_entry seq 4258 len 65 (0x2f51960) -1590> 2012-10-11 13:43:53.196184 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1589> 2012-10-11 13:43:53.196187 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1588> 2012-10-11 13:43:53.197576 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2e319b0 seq 3782 osr(2.a2 0x2468070)/0x2468070 start -1587> 2012-10-11 13:43:53.206060 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1586> 2012-10-11 13:43:53.206086 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1585> 2012-10-11 13:43:53.206089 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1584> 2012-10-11 13:43:53.206099 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497050 seq 4258 osr(2.9e 0x2130e20) 0x2e55480 -1583> 2012-10-11 13:43:53.206114 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497050 seq 4258 osr(2.9e 0x2130e20) 60 bytes (queue has 478 ops and 252530 bytes) -1582> 2012-10-11 13:43:53.207646 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2e31820 seq 3783 osr(2.a4 0x24680a0)/0x24680a0 start -1581> 2012-10-11 13:43:53.207716 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.a1 0x2468000)/0x2468000 -1580> 2012-10-11 13:43:53.207724 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1579> 2012-10-11 13:43:53.207726 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1578> 2012-10-11 13:43:53.207727 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4259 0x2e55090 -1577> 2012-10-11 13:43:53.207730 7f4401226700 5 journal submit_entry seq 4259 len 65 (0x292e420) -1576> 2012-10-11 13:43:53.207731 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1575> 2012-10-11 13:43:53.207733 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1574> 2012-10-11 13:43:53.209570 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2c55910 seq 3784 osr(2.a7 0x24681b0)/0x24681b0 start -1573> 2012-10-11 13:43:53.209641 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.a2 0x2468070)/0x2468070 -1572> 2012-10-11 13:43:53.209650 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1571> 2012-10-11 13:43:53.209651 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1570> 2012-10-11 13:43:53.209652 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4260 0x2e555a0 -1569> 2012-10-11 13:43:53.209657 7f4401226700 5 journal submit_entry seq 4260 len 65 (0x292e9c0) -1568> 2012-10-11 13:43:53.209659 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1567> 2012-10-11 13:43:53.209660 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1566> 2012-10-11 13:43:53.218136 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1565> 2012-10-11 13:43:53.218180 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1564> 2012-10-11 13:43:53.218183 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1563> 2012-10-11 13:43:53.218193 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x24970f0 seq 4259 osr(2.a1 0x2468000) 0x2e55090 -1562> 2012-10-11 13:43:53.218212 7f4409337700 5 filestore(/data/osd.0) queue_op 0x24970f0 seq 4259 osr(2.a1 0x2468000) 60 bytes (queue has 478 ops and 252252 bytes) -1561> 2012-10-11 13:43:53.230155 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1560> 2012-10-11 13:43:53.230170 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1559> 2012-10-11 13:43:53.230173 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1558> 2012-10-11 13:43:53.230277 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2497c30 seq 4260 osr(2.a2 0x2468070) 0x2e555a0 -1557> 2012-10-11 13:43:53.230292 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2497c30 seq 4260 osr(2.a2 0x2468070) 60 bytes (queue has 478 ops and 252252 bytes) -1556> 2012-10-11 13:43:53.231301 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2513c80 seq 3785 osr(1.22 0x27a1940)/0x27a1940 start -1555> 2012-10-11 13:43:53.231410 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.a4 0x24680a0)/0x24680a0 -1554> 2012-10-11 13:43:53.231431 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1553> 2012-10-11 13:43:53.231433 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1552> 2012-10-11 13:43:53.231435 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4261 0x311ec60 -1551> 2012-10-11 13:43:53.231441 7f4401226700 5 journal submit_entry seq 4261 len 65 (0x292ecc0) -1550> 2012-10-11 13:43:53.231453 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1549> 2012-10-11 13:43:53.231456 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1548> 2012-10-11 13:43:53.232221 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e64cd0 seq 3786 osr(0.2b 0x1d71270)/0x1d71270 start -1547> 2012-10-11 13:43:53.232331 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.a7 0x24681b0)/0x24681b0 -1546> 2012-10-11 13:43:53.232343 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1545> 2012-10-11 13:43:53.232345 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1544> 2012-10-11 13:43:53.232347 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4262 0x311eab0 -1543> 2012-10-11 13:43:53.232352 7f4401226700 5 journal submit_entry seq 4262 len 65 (0x33a7840) -1542> 2012-10-11 13:43:53.232356 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1541> 2012-10-11 13:43:53.232359 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1540> 2012-10-11 13:43:53.233604 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2c55460 seq 3787 osr(2.a9 0x3176f00)/0x3176f00 start -1539> 2012-10-11 13:43:53.234429 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2c55140 seq 3788 osr(2.ae 0x3176e10)/0x3176e10 start -1538> 2012-10-11 13:43:53.241858 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1537> 2012-10-11 13:43:53.241873 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1536> 2012-10-11 13:43:53.241877 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1535> 2012-10-11 13:43:53.241871 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76f00 seq 4261 osr(2.a4 0x24680a0) 0x311ec60 -1534> 2012-10-11 13:43:53.241886 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76f00 seq 4261 osr(2.a4 0x24680a0) 60 bytes (queue has 476 ops and 250132 bytes) -1533> 2012-10-11 13:43:53.253449 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1532> 2012-10-11 13:43:53.253553 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1531> 2012-10-11 13:43:53.253556 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1530> 2012-10-11 13:43:53.253567 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2edadc0 seq 4262 osr(2.a7 0x24681b0) 0x311eab0 -1529> 2012-10-11 13:43:53.253588 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2edadc0 seq 4262 osr(2.a7 0x24681b0) 60 bytes (queue has 476 ops and 250132 bytes) -1528> 2012-10-11 13:43:53.254993 7f4408335700 5 filestore(/data/osd.0) _do_op 0x22d5c80 seq 3789 osr(2.b2 0x3176d50)/0x3176d50 start -1527> 2012-10-11 13:43:53.255091 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.a9 0x3176f00)/0x3176f00 -1526> 2012-10-11 13:43:53.255108 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1525> 2012-10-11 13:43:53.255112 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1524> 2012-10-11 13:43:53.255114 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4263 0x311ecf0 -1523> 2012-10-11 13:43:53.255121 7f4401226700 5 journal submit_entry seq 4263 len 65 (0x33a7ba0) -1522> 2012-10-11 13:43:53.255124 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1521> 2012-10-11 13:43:53.255126 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1520> 2012-10-11 13:43:53.255865 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x24ad050 seq 3790 osr(2.b8 0x2468200)/0x2468200 start -1519> 2012-10-11 13:43:53.255960 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.ae 0x3176e10)/0x3176e10 -1518> 2012-10-11 13:43:53.255976 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1517> 2012-10-11 13:43:53.255979 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1516> 2012-10-11 13:43:53.255980 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4264 0x2ab11b0 -1515> 2012-10-11 13:43:53.255985 7f4401226700 5 journal submit_entry seq 4264 len 65 (0x338ed20) -1514> 2012-10-11 13:43:53.255988 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1513> 2012-10-11 13:43:53.255990 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1512> 2012-10-11 13:43:53.265319 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1511> 2012-10-11 13:43:53.265364 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1510> 2012-10-11 13:43:53.265369 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1509> 2012-10-11 13:43:53.265379 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2edaaa0 seq 4263 osr(2.a9 0x3176f00) 0x311ecf0 -1508> 2012-10-11 13:43:53.265400 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2edaaa0 seq 4263 osr(2.a9 0x3176f00) 60 bytes (queue has 476 ops and 249854 bytes) -1507> 2012-10-11 13:43:53.277342 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1506> 2012-10-11 13:43:53.277356 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1505> 2012-10-11 13:43:53.277359 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1504> 2012-10-11 13:43:53.277413 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2eda910 seq 4264 osr(2.ae 0x3176e10) 0x2ab11b0 -1503> 2012-10-11 13:43:53.277428 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2eda910 seq 4264 osr(2.ae 0x3176e10) 60 bytes (queue has 476 ops and 249854 bytes) -1502> 2012-10-11 13:43:53.278325 7f4408335700 5 filestore(/data/osd.0) _do_op 0x26fcdc0 seq 3791 osr(2.c1 0x24686f0)/0x24686f0 start -1501> 2012-10-11 13:43:53.278438 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b2 0x3176d50)/0x3176d50 -1500> 2012-10-11 13:43:53.278450 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1499> 2012-10-11 13:43:53.278453 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1498> 2012-10-11 13:43:53.278455 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4265 0x2e557e0 -1497> 2012-10-11 13:43:53.278461 7f4401226700 5 journal submit_entry seq 4265 len 65 (0x33a3bd0) -1496> 2012-10-11 13:43:53.278464 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1495> 2012-10-11 13:43:53.278467 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1494> 2012-10-11 13:43:53.279193 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x259dfa0 seq 3792 osr(2.ca 0x2468bd0)/0x2468bd0 start -1493> 2012-10-11 13:43:53.279292 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b8 0x2468200)/0x2468200 -1492> 2012-10-11 13:43:53.279303 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1491> 2012-10-11 13:43:53.279305 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1490> 2012-10-11 13:43:53.279307 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4266 0x2e553f0 -1489> 2012-10-11 13:43:53.279313 7f4401226700 5 journal submit_entry seq 4266 len 65 (0x33a30c0) -1488> 2012-10-11 13:43:53.279316 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1487> 2012-10-11 13:43:53.279318 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1486> 2012-10-11 13:43:53.289557 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1485> 2012-10-11 13:43:53.289572 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1484> 2012-10-11 13:43:53.289574 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1483> 2012-10-11 13:43:53.289682 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e14c30 seq 4265 osr(2.b2 0x3176d50) 0x2e557e0 -1482> 2012-10-11 13:43:53.289697 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e14c30 seq 4265 osr(2.b2 0x3176d50) 60 bytes (queue has 476 ops and 249576 bytes) -1481> 2012-10-11 13:43:53.301276 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e14dc0 seq 4266 osr(2.b8 0x2468200) 0x2e553f0 -1480> 2012-10-11 13:43:53.301301 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e14dc0 seq 4266 osr(2.b8 0x2468200) 60 bytes (queue has 476 ops and 249576 bytes) -1479> 2012-10-11 13:43:53.301316 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1478> 2012-10-11 13:43:53.301324 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1477> 2012-10-11 13:43:53.301327 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1476> 2012-10-11 13:43:53.302708 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1e64000 seq 3793 osr(2.ce 0x2468950)/0x2468950 start -1475> 2012-10-11 13:43:53.302761 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.c1 0x24686f0)/0x24686f0 -1474> 2012-10-11 13:43:53.302778 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1473> 2012-10-11 13:43:53.302781 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1472> 2012-10-11 13:43:53.302783 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4267 0x22b96c0 -1471> 2012-10-11 13:43:53.302789 7f4401226700 5 journal submit_entry seq 4267 len 65 (0x33a3480) -1470> 2012-10-11 13:43:53.302792 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1469> 2012-10-11 13:43:53.302795 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1468> 2012-10-11 13:43:53.304229 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x259dc30 seq 3794 osr(2.ed 0x2468f50)/0x2468f50 start -1467> 2012-10-11 13:43:53.304313 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.ca 0x2468bd0)/0x2468bd0 -1466> 2012-10-11 13:43:53.304329 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1465> 2012-10-11 13:43:53.304333 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1464> 2012-10-11 13:43:53.304336 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4268 0x22b9510 -1463> 2012-10-11 13:43:53.304343 7f4401226700 5 journal submit_entry seq 4268 len 65 (0x2f58c30) -1462> 2012-10-11 13:43:53.304348 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1461> 2012-10-11 13:43:53.304351 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1460> 2012-10-11 13:43:53.310296 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1459> 2012-10-11 13:43:53.310311 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1458> 2012-10-11 13:43:53.310315 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1457> 2012-10-11 13:43:53.310424 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76410 seq 4267 osr(2.c1 0x24686f0) 0x22b96c0 -1456> 2012-10-11 13:43:53.310445 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76410 seq 4267 osr(2.c1 0x24686f0) 60 bytes (queue has 476 ops and 249298 bytes) -1455> 2012-10-11 13:43:53.318588 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27b6910 seq 3795 osr(2.f8 0x25cf3f0)/0x25cf3f0 start -1454> 2012-10-11 13:43:53.318696 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.ce 0x2468950)/0x2468950 -1453> 2012-10-11 13:43:53.318708 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1452> 2012-10-11 13:43:53.318711 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1451> 2012-10-11 13:43:53.318712 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4269 0x1d86bd0 -1450> 2012-10-11 13:43:53.318721 7f4401226700 5 journal submit_entry seq 4269 len 65 (0x2d19780) -1449> 2012-10-11 13:43:53.318724 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1448> 2012-10-11 13:43:53.318727 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1447> 2012-10-11 13:43:53.321398 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1446> 2012-10-11 13:43:53.321412 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1445> 2012-10-11 13:43:53.321416 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1444> 2012-10-11 13:43:53.321442 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e763c0 seq 4268 osr(2.ca 0x2468bd0) 0x22b9510 -1443> 2012-10-11 13:43:53.321457 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e763c0 seq 4268 osr(2.ca 0x2468bd0) 60 bytes (queue has 476 ops and 249159 bytes) -1442> 2012-10-11 13:43:53.325883 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x25dbaf0 seq 3796 osr(2.fc 0x25cf330)/0x25cf330 start -1441> 2012-10-11 13:43:53.325970 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.ed 0x2468f50)/0x2468f50 -1440> 2012-10-11 13:43:53.325981 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1439> 2012-10-11 13:43:53.325984 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1438> 2012-10-11 13:43:53.325985 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4270 0x2a26510 -1437> 2012-10-11 13:43:53.325993 7f4401226700 5 journal submit_entry seq 4270 len 65 (0x29228d0) -1436> 2012-10-11 13:43:53.326005 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1435> 2012-10-11 13:43:53.326007 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1434> 2012-10-11 13:43:53.328778 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1433> 2012-10-11 13:43:53.328791 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1432> 2012-10-11 13:43:53.328794 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1431> 2012-10-11 13:43:53.328793 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76a00 seq 4269 osr(2.ce 0x2468950) 0x1d86bd0 -1430> 2012-10-11 13:43:53.328809 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76a00 seq 4269 osr(2.ce 0x2468950) 60 bytes (queue has 476 ops and 249020 bytes) -1429> 2012-10-11 13:43:53.334601 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27b6b90 seq 3797 osr(2.ff 0x25cf2a0)/0x25cf2a0 start -1428> 2012-10-11 13:43:53.334703 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.f8 0x25cf3f0)/0x25cf3f0 -1427> 2012-10-11 13:43:53.334720 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1426> 2012-10-11 13:43:53.334722 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1425> 2012-10-11 13:43:53.334724 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4271 0x250eea0 -1424> 2012-10-11 13:43:53.334729 7f4401226700 5 journal submit_entry seq 4271 len 65 (0x28818d0) -1423> 2012-10-11 13:43:53.334732 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1422> 2012-10-11 13:43:53.334735 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1421> 2012-10-11 13:43:53.337584 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1420> 2012-10-11 13:43:53.337597 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1419> 2012-10-11 13:43:53.337600 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1418> 2012-10-11 13:43:53.337595 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e769b0 seq 4270 osr(2.ed 0x2468f50) 0x2a26510 -1417> 2012-10-11 13:43:53.337610 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e769b0 seq 4270 osr(2.ed 0x2468f50) 60 bytes (queue has 476 ops and 248881 bytes) -1416> 2012-10-11 13:43:53.349621 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1415> 2012-10-11 13:43:53.349635 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1414> 2012-10-11 13:43:53.349640 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1413> 2012-10-11 13:43:53.349719 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76050 seq 4271 osr(2.f8 0x25cf3f0) 0x250eea0 -1412> 2012-10-11 13:43:53.349735 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76050 seq 4271 osr(2.f8 0x25cf3f0) 60 bytes (queue has 476 ops and 248881 bytes) -1411> 2012-10-11 13:43:53.351134 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3418cd0 seq 3798 osr(0.9c 0x2130f00)/0x2130f00 start -1410> 2012-10-11 13:43:53.351244 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.fc 0x25cf330)/0x25cf330 -1409> 2012-10-11 13:43:53.351261 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1408> 2012-10-11 13:43:53.351263 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1407> 2012-10-11 13:43:53.351265 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4272 0x250e7e0 -1406> 2012-10-11 13:43:53.351272 7f4401226700 5 journal submit_entry seq 4272 len 65 (0x27abb70) -1405> 2012-10-11 13:43:53.351275 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1404> 2012-10-11 13:43:53.351278 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1403> 2012-10-11 13:43:53.352038 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2449910 seq 3799 osr(0.9e 0x2130ea0)/0x2130ea0 start -1402> 2012-10-11 13:43:53.352133 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(2.ff 0x25cf2a0)/0x25cf2a0 -1401> 2012-10-11 13:43:53.352144 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1400> 2012-10-11 13:43:53.352148 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1399> 2012-10-11 13:43:53.352150 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4273 0x2f21e10 -1398> 2012-10-11 13:43:53.352154 7f4401226700 5 journal submit_entry seq 4273 len 65 (0x33f38d0) -1397> 2012-10-11 13:43:53.352157 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1396> 2012-10-11 13:43:53.352159 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1395> 2012-10-11 13:43:53.361334 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1394> 2012-10-11 13:43:53.361348 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1393> 2012-10-11 13:43:53.361352 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1392> 2012-10-11 13:43:53.361432 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e761e0 seq 4272 osr(2.fc 0x25cf330) 0x250e7e0 -1391> 2012-10-11 13:43:53.361452 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e761e0 seq 4272 osr(2.fc 0x25cf330) 60 bytes (queue has 476 ops and 248603 bytes) -1390> 2012-10-11 13:43:53.362864 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x24495f0 seq 3800 osr(0.a0 0x24681a0)/0x24681a0 start -1389> 2012-10-11 13:43:53.362970 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.9c 0x2130f00)/0x2130f00 -1388> 2012-10-11 13:43:53.362988 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1387> 2012-10-11 13:43:53.362991 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1386> 2012-10-11 13:43:53.362993 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4274 0x3250c60 -1385> 2012-10-11 13:43:53.362998 7f4401226700 5 journal submit_entry seq 4274 len 65 (0x33f3c00) -1384> 2012-10-11 13:43:53.363001 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1383> 2012-10-11 13:43:53.363004 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1382> 2012-10-11 13:43:53.364274 7f4408335700 5 filestore(/data/osd.0) _do_op 0x24492d0 seq 3801 osr(0.a3 0x2468110)/0x2468110 start -1381> 2012-10-11 13:43:53.364378 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.9e 0x2130ea0)/0x2130ea0 -1380> 2012-10-11 13:43:53.364396 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1379> 2012-10-11 13:43:53.364398 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1378> 2012-10-11 13:43:53.364400 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4275 0x3250a20 -1377> 2012-10-11 13:43:53.364409 7f4401226700 5 journal submit_entry seq 4275 len 65 (0x341c0f0) -1376> 2012-10-11 13:43:53.364412 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1375> 2012-10-11 13:43:53.364415 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1374> 2012-10-11 13:43:53.368745 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 2) -1373> 2012-10-11 13:43:53.368769 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 130) -1372> 2012-10-11 13:43:53.368772 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 2 ops and 130 bytes -1371> 2012-10-11 13:43:53.368782 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e760a0 seq 4273 osr(2.ff 0x25cf2a0) 0x2f21e10 -1370> 2012-10-11 13:43:53.368798 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e760a0 seq 4273 osr(2.ff 0x25cf2a0) 60 bytes (queue has 476 ops and 248325 bytes) -1369> 2012-10-11 13:43:53.385661 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 2 (0xb7c748 -> 0) -1368> 2012-10-11 13:43:53.385675 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 130 (0xb7c748 -> 0) -1367> 2012-10-11 13:43:53.385679 7f440a339700 5 journal put_throttle finished 2 ops and 130 bytes, now 0 ops and 0 bytes -1366> 2012-10-11 13:43:53.385768 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76dc0 seq 4274 osr(0.9c 0x2130f00) 0x3250c60 -1365> 2012-10-11 13:43:53.385784 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76dc0 seq 4274 osr(0.9c 0x2130f00) 60 bytes (queue has 476 ops and 248325 bytes) -1364> 2012-10-11 13:43:53.385799 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76a50 seq 4275 osr(0.9e 0x2130ea0) 0x3250a20 -1363> 2012-10-11 13:43:53.385804 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76a50 seq 4275 osr(0.9e 0x2130ea0) 60 bytes (queue has 476 ops and 248325 bytes) -1362> 2012-10-11 13:43:53.386639 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2449e10 seq 3802 osr(0.a4 0x24680e0)/0x24680e0 start -1361> 2012-10-11 13:43:53.386735 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a0 0x24681a0)/0x24681a0 -1360> 2012-10-11 13:43:53.386750 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1359> 2012-10-11 13:43:53.386752 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1358> 2012-10-11 13:43:53.386769 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4276 0x3250480 -1357> 2012-10-11 13:43:53.386775 7f4401226700 5 journal submit_entry seq 4276 len 65 (0x24422d0) -1356> 2012-10-11 13:43:53.386779 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1355> 2012-10-11 13:43:53.386790 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1354> 2012-10-11 13:43:53.388067 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2449c80 seq 3803 osr(0.a6 0x2468080)/0x2468080 start -1353> 2012-10-11 13:43:53.388168 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a3 0x2468110)/0x2468110 -1352> 2012-10-11 13:43:53.388186 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1351> 2012-10-11 13:43:53.388189 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1350> 2012-10-11 13:43:53.388191 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4277 0x3039900 -1349> 2012-10-11 13:43:53.388196 7f4401226700 5 journal submit_entry seq 4277 len 65 (0x2442b70) -1348> 2012-10-11 13:43:53.388199 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1347> 2012-10-11 13:43:53.388201 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1346> 2012-10-11 13:43:53.397866 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1345> 2012-10-11 13:43:53.398182 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1344> 2012-10-11 13:43:53.398186 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1343> 2012-10-11 13:43:53.397947 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e768c0 seq 4276 osr(0.a0 0x24681a0) 0x3250480 -1342> 2012-10-11 13:43:53.398272 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e768c0 seq 4276 osr(0.a0 0x24681a0) 60 bytes (queue has 476 ops and 248047 bytes) -1341> 2012-10-11 13:43:53.409412 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1340> 2012-10-11 13:43:53.409426 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1339> 2012-10-11 13:43:53.409431 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1338> 2012-10-11 13:43:53.409512 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76870 seq 4277 osr(0.a3 0x2468110) 0x3039900 -1337> 2012-10-11 13:43:53.409533 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76870 seq 4277 osr(0.a3 0x2468110) 60 bytes (queue has 476 ops and 248047 bytes) -1336> 2012-10-11 13:43:53.410455 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x24ad960 seq 3804 osr(0.a9 0x24683f0)/0x24683f0 start -1335> 2012-10-11 13:43:53.410559 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a4 0x24680e0)/0x24680e0 -1334> 2012-10-11 13:43:53.410574 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1333> 2012-10-11 13:43:53.410576 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1332> 2012-10-11 13:43:53.410578 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4278 0x2cdad80 -1331> 2012-10-11 13:43:53.410583 7f4401226700 5 journal submit_entry seq 4278 len 65 (0x2442810) -1330> 2012-10-11 13:43:53.410588 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1329> 2012-10-11 13:43:53.410591 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1328> 2012-10-11 13:43:53.411361 7f4408335700 5 filestore(/data/osd.0) _do_op 0x24ad4b0 seq 3805 osr(0.ab 0x2468390)/0x2468390 start -1327> 2012-10-11 13:43:53.411470 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a6 0x2468080)/0x2468080 -1326> 2012-10-11 13:43:53.411488 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1325> 2012-10-11 13:43:53.411491 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1324> 2012-10-11 13:43:53.411493 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4279 0x2e55a20 -1323> 2012-10-11 13:43:53.411498 7f4401226700 5 journal submit_entry seq 4279 len 65 (0x2442cf0) -1322> 2012-10-11 13:43:53.411501 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1321> 2012-10-11 13:43:53.411503 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1320> 2012-10-11 13:43:53.421493 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1319> 2012-10-11 13:43:53.421641 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1318> 2012-10-11 13:43:53.421645 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1317> 2012-10-11 13:43:53.421656 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76550 seq 4278 osr(0.a4 0x24680e0) 0x2cdad80 -1316> 2012-10-11 13:43:53.421672 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76550 seq 4278 osr(0.a4 0x24680e0) 60 bytes (queue has 476 ops and 247769 bytes) -1315> 2012-10-11 13:43:53.426117 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x24ad190 seq 3806 osr(0.b0 0x24682a0)/0x24682a0 start -1314> 2012-10-11 13:43:53.426226 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a9 0x24683f0)/0x24683f0 -1313> 2012-10-11 13:43:53.426250 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1312> 2012-10-11 13:43:53.426253 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1311> 2012-10-11 13:43:53.426256 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4280 0x2e55d80 -1310> 2012-10-11 13:43:53.426261 7f4401226700 5 journal submit_entry seq 4280 len 65 (0x2496540) -1309> 2012-10-11 13:43:53.426265 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1308> 2012-10-11 13:43:53.426277 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1307> 2012-10-11 13:43:53.426984 7f4408335700 5 filestore(/data/osd.0) _do_op 0x25139b0 seq 3807 osr(0.b4 0x24685e0)/0x24685e0 start -1306> 2012-10-11 13:43:53.427080 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.ab 0x2468390)/0x2468390 -1305> 2012-10-11 13:43:53.427096 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1304> 2012-10-11 13:43:53.427098 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1303> 2012-10-11 13:43:53.427100 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4281 0x31cb6c0 -1302> 2012-10-11 13:43:53.427105 7f4401226700 5 journal submit_entry seq 4281 len 65 (0x24961e0) -1301> 2012-10-11 13:43:53.427108 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1300> 2012-10-11 13:43:53.427111 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1299> 2012-10-11 13:43:53.429931 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 2) -1298> 2012-10-11 13:43:53.429996 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 130) -1297> 2012-10-11 13:43:53.429999 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 2 ops and 130 bytes -1296> 2012-10-11 13:43:53.430011 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e766e0 seq 4279 osr(0.a6 0x2468080) 0x2e55a20 -1295> 2012-10-11 13:43:53.430026 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e766e0 seq 4279 osr(0.a6 0x2468080) 60 bytes (queue has 476 ops and 247491 bytes) -1294> 2012-10-11 13:43:53.445737 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 2 (0xb7c748 -> 0) -1293> 2012-10-11 13:43:53.445801 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 130 (0xb7c748 -> 0) -1292> 2012-10-11 13:43:53.445804 7f440a339700 5 journal put_throttle finished 2 ops and 130 bytes, now 0 ops and 0 bytes -1291> 2012-10-11 13:43:53.445818 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76280 seq 4280 osr(0.a9 0x24683f0) 0x2e55d80 -1290> 2012-10-11 13:43:53.445834 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76280 seq 4280 osr(0.a9 0x24683f0) 60 bytes (queue has 476 ops and 247491 bytes) -1289> 2012-10-11 13:43:53.445841 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76230 seq 4281 osr(0.ab 0x2468390) 0x31cb6c0 -1288> 2012-10-11 13:43:53.445846 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76230 seq 4281 osr(0.ab 0x2468390) 60 bytes (queue has 476 ops and 247491 bytes) -1287> 2012-10-11 13:43:53.447643 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2513370 seq 3808 osr(0.ba 0x24684c0)/0x24684c0 start -1286> 2012-10-11 13:43:53.447794 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.b0 0x24682a0)/0x24682a0 -1285> 2012-10-11 13:43:53.447814 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1284> 2012-10-11 13:43:53.447818 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1283> 2012-10-11 13:43:53.447820 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4282 0x311e510 -1282> 2012-10-11 13:43:53.447828 7f4401226700 5 journal submit_entry seq 4282 len 65 (0x24968d0) -1281> 2012-10-11 13:43:53.447831 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1280> 2012-10-11 13:43:53.447834 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1279> 2012-10-11 13:43:53.448546 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2513a00 seq 3809 osr(0.c3 0x2468710)/0x2468710 start -1278> 2012-10-11 13:43:53.448641 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.b4 0x24685e0)/0x24685e0 -1277> 2012-10-11 13:43:53.448652 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1276> 2012-10-11 13:43:53.448654 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1275> 2012-10-11 13:43:53.448656 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4283 0x311e6c0 -1274> 2012-10-11 13:43:53.448661 7f4401226700 5 journal submit_entry seq 4283 len 65 (0x2496f60) -1273> 2012-10-11 13:43:53.448663 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1272> 2012-10-11 13:43:53.448666 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1271> 2012-10-11 13:43:53.457303 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1270> 2012-10-11 13:43:53.457343 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1269> 2012-10-11 13:43:53.457347 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1268> 2012-10-11 13:43:53.457360 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76b90 seq 4282 osr(0.b0 0x24682a0) 0x311e510 -1267> 2012-10-11 13:43:53.457380 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76b90 seq 4282 osr(0.b0 0x24682a0) 60 bytes (queue has 476 ops and 247213 bytes) -1266> 2012-10-11 13:43:53.469724 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1265> 2012-10-11 13:43:53.469738 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1264> 2012-10-11 13:43:53.469742 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1263> 2012-10-11 13:43:53.469842 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76d20 seq 4283 osr(0.b4 0x24685e0) 0x311e6c0 -1262> 2012-10-11 13:43:53.469863 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76d20 seq 4283 osr(0.b4 0x24685e0) 60 bytes (queue has 476 ops and 247213 bytes) -1261> 2012-10-11 13:43:53.470757 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2574be0 seq 3810 osr(0.cc 0x2468960)/0x2468960 start -1260> 2012-10-11 13:43:53.470862 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.ba 0x24684c0)/0x24684c0 -1259> 2012-10-11 13:43:53.470880 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1258> 2012-10-11 13:43:53.470882 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1257> 2012-10-11 13:43:53.470884 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4284 0x311e480 -1256> 2012-10-11 13:43:53.470889 7f4401226700 5 journal submit_entry seq 4284 len 65 (0x24f80f0) -1255> 2012-10-11 13:43:53.470892 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1254> 2012-10-11 13:43:53.470895 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1253> 2012-10-11 13:43:53.471791 7f4408335700 5 filestore(/data/osd.0) _do_op 0x25dbdc0 seq 3811 osr(0.d0 0x24688a0)/0x24688a0 start -1252> 2012-10-11 13:43:53.471886 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.c3 0x2468710)/0x2468710 -1251> 2012-10-11 13:43:53.471901 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1250> 2012-10-11 13:43:53.471904 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1249> 2012-10-11 13:43:53.471906 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4285 0x311e750 -1248> 2012-10-11 13:43:53.471913 7f4401226700 5 journal submit_entry seq 4285 len 65 (0x24f8630) -1247> 2012-10-11 13:43:53.471915 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1246> 2012-10-11 13:43:53.471918 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1245> 2012-10-11 13:43:53.481285 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1244> 2012-10-11 13:43:53.481326 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1243> 2012-10-11 13:43:53.481327 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76820 seq 4284 osr(0.ba 0x24684c0) 0x311e480 -1242> 2012-10-11 13:43:53.481343 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76820 seq 4284 osr(0.ba 0x24684c0) 60 bytes (queue has 476 ops and 246935 bytes) -1241> 2012-10-11 13:43:53.481345 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1240> 2012-10-11 13:43:53.494672 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1239> 2012-10-11 13:43:53.494689 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1238> 2012-10-11 13:43:53.494693 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1237> 2012-10-11 13:43:53.494738 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76eb0 seq 4285 osr(0.c3 0x2468710) 0x311e750 -1236> 2012-10-11 13:43:53.494757 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76eb0 seq 4285 osr(0.c3 0x2468710) 60 bytes (queue has 476 ops and 246935 bytes) -1235> 2012-10-11 13:43:53.495658 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x263b780 seq 3812 osr(0.ef 0x2468ed0)/0x2468ed0 start -1234> 2012-10-11 13:43:53.495761 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.cc 0x2468960)/0x2468960 -1233> 2012-10-11 13:43:53.495778 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1232> 2012-10-11 13:43:53.495780 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1231> 2012-10-11 13:43:53.495787 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4286 0x311eea0 -1230> 2012-10-11 13:43:53.495792 7f4401226700 5 journal submit_entry seq 4286 len 65 (0x2553000) -1229> 2012-10-11 13:43:53.495796 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1228> 2012-10-11 13:43:53.495799 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1227> 2012-10-11 13:43:53.497159 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27616e0 seq 3813 osr(0.fa 0x27a10c0)/0x27a10c0 start -1226> 2012-10-11 13:43:53.497281 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.d0 0x24688a0)/0x24688a0 -1225> 2012-10-11 13:43:53.497293 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1224> 2012-10-11 13:43:53.497295 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1223> 2012-10-11 13:43:53.497297 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4287 0x311e120 -1222> 2012-10-11 13:43:53.497302 7f4401226700 5 journal submit_entry seq 4287 len 65 (0x25a30c0) -1221> 2012-10-11 13:43:53.497305 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1220> 2012-10-11 13:43:53.497308 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1219> 2012-10-11 13:43:53.499342 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x27c75a0 seq 3814 osr(0.fe 0x27a1000)/0x27a1000 start -1218> 2012-10-11 13:43:53.499493 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.ef 0x2468ed0)/0x2468ed0 -1217> 2012-10-11 13:43:53.499509 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1216> 2012-10-11 13:43:53.499512 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1215> 2012-10-11 13:43:53.499514 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4288 0x311e870 -1214> 2012-10-11 13:43:53.499519 7f4401226700 5 journal submit_entry seq 4288 len 65 (0x2609180) -1213> 2012-10-11 13:43:53.499522 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1212> 2012-10-11 13:43:53.499524 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1211> 2012-10-11 13:43:53.503529 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 2) -1210> 2012-10-11 13:43:53.503544 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 130) -1209> 2012-10-11 13:43:53.503548 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 2 ops and 130 bytes -1208> 2012-10-11 13:43:53.503540 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76500 seq 4286 osr(0.cc 0x2468960) 0x311eea0 -1207> 2012-10-11 13:43:53.503556 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76500 seq 4286 osr(0.cc 0x2468960) 60 bytes (queue has 476 ops and 246518 bytes) -1206> 2012-10-11 13:43:53.504782 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27c7f50 seq 3815 osr(1.5 0x27a12b0)/0x27a12b0 start -1205> 2012-10-11 13:43:53.504862 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.fa 0x27a10c0)/0x27a10c0 -1204> 2012-10-11 13:43:53.504877 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1203> 2012-10-11 13:43:53.504880 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1202> 2012-10-11 13:43:53.504882 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4289 0x311eb40 -1201> 2012-10-11 13:43:53.504887 7f4401226700 5 journal submit_entry seq 4289 len 65 (0x26096c0) -1200> 2012-10-11 13:43:53.504889 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1199> 2012-10-11 13:43:53.504892 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1198> 2012-10-11 13:43:53.518016 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 2 (0xb7c748 -> 1) -1197> 2012-10-11 13:43:53.518031 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 130 (0xb7c748 -> 65) -1196> 2012-10-11 13:43:53.518035 7f440a339700 5 journal put_throttle finished 2 ops and 130 bytes, now 1 ops and 65 bytes -1195> 2012-10-11 13:43:53.518166 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76370 seq 4287 osr(0.d0 0x24688a0) 0x311e120 -1194> 2012-10-11 13:43:53.518182 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76370 seq 4287 osr(0.d0 0x24688a0) 60 bytes (queue has 476 ops and 246379 bytes) -1193> 2012-10-11 13:43:53.518188 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e760f0 seq 4288 osr(0.ef 0x2468ed0) 0x311e870 -1192> 2012-10-11 13:43:53.518192 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e760f0 seq 4288 osr(0.ef 0x2468ed0) 60 bytes (queue has 476 ops and 246379 bytes) -1191> 2012-10-11 13:43:53.533223 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76c30 seq 4289 osr(0.fa 0x27a10c0) 0x311eb40 -1190> 2012-10-11 13:43:53.533241 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76c30 seq 4289 osr(0.fa 0x27a10c0) 60 bytes (queue has 476 ops and 246379 bytes) -1189> 2012-10-11 13:43:53.533267 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1188> 2012-10-11 13:43:53.533273 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1187> 2012-10-11 13:43:53.533275 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1186> 2012-10-11 13:43:53.534281 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2828460 seq 3816 osr(1.8 0x27a1220)/0x27a1220 start -1185> 2012-10-11 13:43:53.534387 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.fe 0x27a1000)/0x27a1000 -1184> 2012-10-11 13:43:53.534400 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1183> 2012-10-11 13:43:53.534403 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1182> 2012-10-11 13:43:53.534405 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4290 0x31c5510 -1181> 2012-10-11 13:43:53.534411 7f4401226700 5 journal submit_entry seq 4290 len 65 (0x2719c30) -1180> 2012-10-11 13:43:53.534414 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1179> 2012-10-11 13:43:53.534417 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1178> 2012-10-11 13:43:53.535159 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2a76690 seq 3817 osr(1.24 0x27a18e0)/0x27a18e0 start -1177> 2012-10-11 13:43:53.536475 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2828fa0 seq 3818 osr(1.13 0x27a1410)/0x27a1410 start -1176> 2012-10-11 13:43:53.537595 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.5 0x27a12b0)/0x27a12b0 -1175> 2012-10-11 13:43:53.537612 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1174> 2012-10-11 13:43:53.537615 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1173> 2012-10-11 13:43:53.537617 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4291 0x2a32ab0 -1172> 2012-10-11 13:43:53.537622 7f4401226700 5 journal submit_entry seq 4291 len 64 (0x27d2390) -1171> 2012-10-11 13:43:53.537624 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1170> 2012-10-11 13:43:53.537627 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -1169> 2012-10-11 13:43:53.541876 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1168> 2012-10-11 13:43:53.541893 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76be0 seq 4290 osr(0.fe 0x27a1000) 0x31c5510 -1167> 2012-10-11 13:43:53.541909 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76be0 seq 4290 osr(0.fe 0x27a1000) 60 bytes (queue has 475 ops and 245183 bytes) -1166> 2012-10-11 13:43:53.541914 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 64) -1165> 2012-10-11 13:43:53.541937 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 64 bytes -1164> 2012-10-11 13:43:53.553619 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1163> 2012-10-11 13:43:53.553667 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 64 (0xb7c748 -> 0) -1162> 2012-10-11 13:43:53.553690 7f440a339700 5 journal put_throttle finished 1 ops and 64 bytes, now 0 ops and 0 bytes -1161> 2012-10-11 13:43:53.553755 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x33235a0 seq 4291 osr(1.5 0x27a12b0) 0x2a32ab0 -1160> 2012-10-11 13:43:53.553774 7f4409337700 5 filestore(/data/osd.0) queue_op 0x33235a0 seq 4291 osr(1.5 0x27a12b0) 59 bytes (queue has 475 ops and 245183 bytes) -1159> 2012-10-11 13:43:53.554482 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3394aa0 seq 3819 osr(2.1c 0x1d716f0)/0x1d716f0 start -1158> 2012-10-11 13:43:53.554594 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.8 0x27a1220)/0x27a1220 -1157> 2012-10-11 13:43:53.554607 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1156> 2012-10-11 13:43:53.554610 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1155> 2012-10-11 13:43:53.554612 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4292 0x2a32ea0 -1154> 2012-10-11 13:43:53.554621 7f4401226700 5 journal submit_entry seq 4292 len 64 (0x27d28d0) -1153> 2012-10-11 13:43:53.554624 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1152> 2012-10-11 13:43:53.554627 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -1151> 2012-10-11 13:43:53.555676 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.13 0x27a1410)/0x27a1410 -1150> 2012-10-11 13:43:53.555704 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1149> 2012-10-11 13:43:53.555709 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1148> 2012-10-11 13:43:53.555711 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4293 0x2a32870 -1147> 2012-10-11 13:43:53.555716 7f4401226700 5 journal submit_entry seq 4293 len 65 (0x2827270) -1146> 2012-10-11 13:43:53.555719 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1145> 2012-10-11 13:43:53.555721 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1144> 2012-10-11 13:43:53.555747 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2513d70 seq 3820 osr(2.21 0x1d714b0)/0x1d714b0 start -1143> 2012-10-11 13:43:53.556758 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x288ae60 seq 3821 osr(0.9 0x1d713e0)/0x1d713e0 start -1142> 2012-10-11 13:43:53.557840 7f4408335700 5 filestore(/data/osd.0) _do_op 0x25138c0 seq 3822 osr(2.23 0x1d717c0)/0x1d717c0 start -1141> 2012-10-11 13:43:53.559139 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1e64050 seq 3823 osr(0.30 0x1d71a90)/0x1d71a90 start -1140> 2012-10-11 13:43:53.560407 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1e64820 seq 3824 osr(0.39 0x1d71d60)/0x1d71d60 start -1139> 2012-10-11 13:43:53.561701 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1e8b870 seq 3825 osr(0.6 0x1d71380)/0x1d71380 start -1138> 2012-10-11 13:43:53.565913 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1137> 2012-10-11 13:43:53.565931 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 64 (0xb7c748 -> 65) -1136> 2012-10-11 13:43:53.565923 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x33233c0 seq 4292 osr(1.8 0x27a1220) 0x2a32ea0 -1135> 2012-10-11 13:43:53.565934 7f440a339700 5 journal put_throttle finished 1 ops and 64 bytes, now 1 ops and 65 bytes -1134> 2012-10-11 13:43:53.565940 7f4409337700 5 filestore(/data/osd.0) queue_op 0x33233c0 seq 4292 osr(1.8 0x27a1220) 59 bytes (queue has 470 ops and 240303 bytes) -1133> 2012-10-11 13:43:53.570129 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e640f0 seq 3826 osr(0.3e 0x1d71ee0)/0x1d71ee0 start -1132> 2012-10-11 13:43:53.570229 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.9 0x1d713e0)/0x1d713e0 -1131> 2012-10-11 13:43:53.570242 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1130> 2012-10-11 13:43:53.570245 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1129> 2012-10-11 13:43:53.570247 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4294 0x2a326c0 -1128> 2012-10-11 13:43:53.570252 7f4401226700 5 journal submit_entry seq 4294 len 64 (0x28278d0) -1127> 2012-10-11 13:43:53.570255 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1126> 2012-10-11 13:43:53.570258 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -1125> 2012-10-11 13:43:53.571398 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e64b90 seq 3827 osr(0.42 0x1d71e20)/0x1d71e20 start -1124> 2012-10-11 13:43:53.572699 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e8b730 seq 3828 osr(1.9f 0x2e381d0)/0x2e381d0 start -1123> 2012-10-11 13:43:53.572871 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1122> 2012-10-11 13:43:53.572887 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323550 seq 4293 osr(1.13 0x27a1410) 0x2a32870 -1121> 2012-10-11 13:43:53.572906 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323550 seq 4293 osr(1.13 0x27a1410) 60 bytes (queue has 468 ops and 238325 bytes) -1120> 2012-10-11 13:43:53.572900 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 64) -1119> 2012-10-11 13:43:53.572935 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 64 bytes -1118> 2012-10-11 13:43:53.573979 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1e64640 seq 3829 osr(0.44 0x1d71ff0)/0x1d71ff0 start -1117> 2012-10-11 13:43:53.574082 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.6 0x1d71380)/0x1d71380 -1116> 2012-10-11 13:43:53.574094 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1115> 2012-10-11 13:43:53.574097 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1114> 2012-10-11 13:43:53.574099 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4295 0x2a32990 -1113> 2012-10-11 13:43:53.574104 7f4401226700 5 journal submit_entry seq 4295 len 64 (0x2881e10) -1112> 2012-10-11 13:43:53.574107 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1111> 2012-10-11 13:43:53.574110 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 64 -1110> 2012-10-11 13:43:53.575261 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1e64550 seq 3830 osr(0.4a 0x2130120)/0x2130120 start -1109> 2012-10-11 13:43:53.576552 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2e142d0 seq 3831 osr(1.9d 0x2adbe30)/0x2adbe30 start -1108> 2012-10-11 13:43:53.578180 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e643c0 seq 3832 osr(0.4f 0x2130030)/0x2130030 start -1107> 2012-10-11 13:43:53.578281 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.9f 0x2e381d0)/0x2e381d0 -1106> 2012-10-11 13:43:53.578293 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1105> 2012-10-11 13:43:53.578300 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1104> 2012-10-11 13:43:53.578301 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4296 0x311ef30 -1103> 2012-10-11 13:43:53.578307 7f4401226700 5 journal submit_entry seq 4296 len 65 (0x1e96540) -1102> 2012-10-11 13:43:53.578310 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1101> 2012-10-11 13:43:53.578312 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1100> 2012-10-11 13:43:53.579460 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e646e0 seq 3833 osr(1.2a 0x27a1bc0)/0x27a1bc0 start -1099> 2012-10-11 13:43:53.580728 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2e145f0 seq 3834 osr(1.9b 0x2adbe90)/0x2adbe90 start -1098> 2012-10-11 13:43:53.580928 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 2) -1097> 2012-10-11 13:43:53.580945 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 64 (0xb7c748 -> 129) -1096> 2012-10-11 13:43:53.580949 7f440a339700 5 journal put_throttle finished 1 ops and 64 bytes, now 2 ops and 129 bytes -1095> 2012-10-11 13:43:53.580943 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323050 seq 4294 osr(0.9 0x1d713e0) 0x2a326c0 -1094> 2012-10-11 13:43:53.580963 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323050 seq 4294 osr(0.9 0x1d713e0) 59 bytes (queue has 464 ops and 234366 bytes) -1093> 2012-10-11 13:43:53.598754 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x33230a0 seq 4295 osr(0.6 0x1d71380) 0x2a32990 -1092> 2012-10-11 13:43:53.598774 7f4409337700 5 filestore(/data/osd.0) queue_op 0x33230a0 seq 4295 osr(0.6 0x1d71380) 59 bytes (queue has 464 ops and 234366 bytes) -1091> 2012-10-11 13:43:53.598810 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x33230f0 seq 4296 osr(1.9f 0x2e381d0) 0x311ef30 -1090> 2012-10-11 13:43:53.598819 7f4409337700 5 filestore(/data/osd.0) queue_op 0x33230f0 seq 4296 osr(1.9f 0x2e381d0) 60 bytes (queue has 464 ops and 234366 bytes) -1089> 2012-10-11 13:43:53.598829 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 2 (0xb7c748 -> 0) -1088> 2012-10-11 13:43:53.598836 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 129 (0xb7c748 -> 0) -1087> 2012-10-11 13:43:53.598839 7f440a339700 5 journal put_throttle finished 2 ops and 129 bytes, now 0 ops and 0 bytes -1086> 2012-10-11 13:43:53.600223 7f4408335700 5 filestore(/data/osd.0) _do_op 0x236c190 seq 3835 osr(1.2f 0x27a1ad0)/0x27a1ad0 start -1085> 2012-10-11 13:43:53.600327 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.9d 0x2adbe30)/0x2adbe30 -1084> 2012-10-11 13:43:53.600345 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1083> 2012-10-11 13:43:53.600347 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1082> 2012-10-11 13:43:53.600349 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4297 0x311ebd0 -1081> 2012-10-11 13:43:53.600355 7f4401226700 5 journal submit_entry seq 4297 len 65 (0x1e96060) -1080> 2012-10-11 13:43:53.600358 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1079> 2012-10-11 13:43:53.600361 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1078> 2012-10-11 13:43:53.601575 7f4408335700 5 filestore(/data/osd.0) _do_op 0x25040a0 seq 3836 osr(1.38 0x27a1d20)/0x27a1d20 start -1077> 2012-10-11 13:43:53.602861 7f4408335700 5 filestore(/data/osd.0) _do_op 0x20f36e0 seq 3837 osr(1.3d 0x27a1c30)/0x27a1c30 start -1076> 2012-10-11 13:43:53.604140 7f4408335700 5 filestore(/data/osd.0) _do_op 0x23ff500 seq 3838 osr(1.41 0x27a1f70)/0x27a1f70 start -1075> 2012-10-11 13:43:53.605456 7f4408335700 5 filestore(/data/osd.0) _do_op 0x23ff820 seq 3839 osr(1.43 0x27a1f10)/0x27a1f10 start -1074> 2012-10-11 13:43:53.606733 7f4408335700 5 filestore(/data/osd.0) _do_op 0x23ffeb0 seq 3840 osr(1.49 0x2adb1f0)/0x2adb1f0 start -1073> 2012-10-11 13:43:53.607998 7f4408335700 5 filestore(/data/osd.0) _do_op 0x28effa0 seq 3841 osr(1.4e 0x2adb100)/0x2adb100 start -1072> 2012-10-11 13:43:53.609342 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1e8b6e0 seq 3842 osr(0.9d 0x2130ed0)/0x2130ed0 start -1071> 2012-10-11 13:43:53.613521 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1070> 2012-10-11 13:43:53.613531 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323140 seq 4297 osr(1.9d 0x2adbe30) 0x311ebd0 -1069> 2012-10-11 13:43:53.613546 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323140 seq 4297 osr(1.9d 0x2adbe30) 60 bytes (queue has 457 ops and 227780 bytes) -1068> 2012-10-11 13:43:53.613553 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1067> 2012-10-11 13:43:53.613577 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1066> 2012-10-11 13:43:53.615254 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3240c80 seq 3843 osr(2.29 0x3176630)/0x3176630 start -1065> 2012-10-11 13:43:53.615354 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(1.9b 0x2adbe90)/0x2adbe90 -1064> 2012-10-11 13:43:53.615366 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1063> 2012-10-11 13:43:53.615369 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1062> 2012-10-11 13:43:53.615371 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4298 0x311e000 -1061> 2012-10-11 13:43:53.615376 7f4401226700 5 journal submit_entry seq 4298 len 65 (0x2e13090) -1060> 2012-10-11 13:43:53.615379 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1059> 2012-10-11 13:43:53.615382 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1058> 2012-10-11 13:43:53.616125 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2bbe640 seq 3844 osr(2.2e 0x3176540)/0x3176540 start -1057> 2012-10-11 13:43:53.616420 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.9d 0x2130ed0)/0x2130ed0 -1056> 2012-10-11 13:43:53.616436 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1055> 2012-10-11 13:43:53.616439 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1054> 2012-10-11 13:43:53.616441 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4299 0x311e2d0 -1053> 2012-10-11 13:43:53.616446 7f4401226700 5 journal submit_entry seq 4299 len 65 (0x2e13450) -1052> 2012-10-11 13:43:53.616449 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1051> 2012-10-11 13:43:53.616451 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1050> 2012-10-11 13:43:53.617364 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2449730 seq 3845 osr(0.a1 0x2468170)/0x2468170 start -1049> 2012-10-11 13:43:53.618382 7f4408335700 5 filestore(/data/osd.0) _do_op 0x24490f0 seq 3846 osr(0.b3 0x2468210)/0x2468210 start -1048> 2012-10-11 13:43:53.625320 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1047> 2012-10-11 13:43:53.625324 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76d70 seq 4298 osr(1.9b 0x2adbe90) 0x311e000 -1046> 2012-10-11 13:43:53.625335 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1045> 2012-10-11 13:43:53.625338 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76d70 seq 4298 osr(1.9b 0x2adbe90) 60 bytes (queue has 455 ops and 225660 bytes) -1044> 2012-10-11 13:43:53.625339 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1043> 2012-10-11 13:43:53.637225 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 0) -1042> 2012-10-11 13:43:53.637240 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 0) -1041> 2012-10-11 13:43:53.637233 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e76690 seq 4299 osr(0.9d 0x2130ed0) 0x311e2d0 -1040> 2012-10-11 13:43:53.637244 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 0 ops and 0 bytes -1039> 2012-10-11 13:43:53.637258 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e76690 seq 4299 osr(0.9d 0x2130ed0) 60 bytes (queue has 455 ops and 225660 bytes) -1038> 2012-10-11 13:43:53.638208 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2513730 seq 3847 osr(0.7d 0x2130a50)/0x2130a50 start -1037> 2012-10-11 13:43:53.638313 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a1 0x2468170)/0x2468170 -1036> 2012-10-11 13:43:53.638332 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1035> 2012-10-11 13:43:53.638335 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1034> 2012-10-11 13:43:53.638337 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4300 0x311e3f0 -1033> 2012-10-11 13:43:53.638345 7f4401226700 5 journal submit_entry seq 4300 len 65 (0x2881cc0) -1032> 2012-10-11 13:43:53.638350 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1031> 2012-10-11 13:43:53.638353 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1030> 2012-10-11 13:43:53.639244 7f4408335700 5 filestore(/data/osd.0) _do_op 0x25134b0 seq 3848 osr(0.b6 0x2468580)/0x2468580 start -1029> 2012-10-11 13:43:53.639329 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.b3 0x2468210)/0x2468210 -1028> 2012-10-11 13:43:53.639349 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1027> 2012-10-11 13:43:53.639351 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1026> 2012-10-11 13:43:53.639353 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4301 0x2f217e0 -1025> 2012-10-11 13:43:53.639358 7f4401226700 5 journal submit_entry seq 4301 len 65 (0x2827780) -1024> 2012-10-11 13:43:53.639361 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1023> 2012-10-11 13:43:53.639364 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1022> 2012-10-11 13:43:53.640523 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2513410 seq 3849 osr(0.8f 0x2130e30)/0x2130e30 start -1021> 2012-10-11 13:43:53.641894 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x26b1c80 seq 3850 osr(0.94 0x2130d40)/0x2130d40 start -1020> 2012-10-11 13:43:53.643178 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2513000 seq 3851 osr(0.b7 0x2468550)/0x2468550 start -1019> 2012-10-11 13:43:53.648625 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1018> 2012-10-11 13:43:53.648653 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1017> 2012-10-11 13:43:53.648667 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1016> 2012-10-11 13:43:53.648661 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x2e319b0 seq 4300 osr(0.a1 0x2468170) 0x311e3f0 -1015> 2012-10-11 13:43:53.648693 7f4409337700 5 filestore(/data/osd.0) queue_op 0x2e319b0 seq 4300 osr(0.a1 0x2468170) 60 bytes (queue has 452 ops and 222619 bytes) -1014> 2012-10-11 13:43:53.658439 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1e1bfa0 seq 3852 osr(1.7c 0x2adb860)/0x2adb860 start -1013> 2012-10-11 13:43:53.658545 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.b6 0x2468580)/0x2468580 -1012> 2012-10-11 13:43:53.658563 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -1011> 2012-10-11 13:43:53.658565 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -1010> 2012-10-11 13:43:53.658567 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4302 0x2f212d0 -1009> 2012-10-11 13:43:53.658576 7f4401226700 5 journal submit_entry seq 4302 len 65 (0x2827120) -1008> 2012-10-11 13:43:53.658582 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -1007> 2012-10-11 13:43:53.658585 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -1006> 2012-10-11 13:43:53.659811 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2513e60 seq 3853 osr(0.b8 0x2468520)/0x2468520 start -1005> 2012-10-11 13:43:53.662601 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -1004> 2012-10-11 13:43:53.662616 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -1003> 2012-10-11 13:43:53.662620 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -1002> 2012-10-11 13:43:53.662622 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x3323500 seq 4301 osr(0.b3 0x2468210) 0x2f217e0 -1001> 2012-10-11 13:43:53.662638 7f4409337700 5 filestore(/data/osd.0) queue_op 0x3323500 seq 4301 osr(0.b3 0x2468210) 60 bytes (queue has 451 ops and 221431 bytes) -1000> 2012-10-11 13:43:53.667014 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2513cd0 seq 3854 osr(0.bb 0x2468490)/0x2468490 start -999> 2012-10-11 13:43:53.667116 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.b7 0x2468550)/0x2468550 -998> 2012-10-11 13:43:53.667134 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -997> 2012-10-11 13:43:53.667138 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -996> 2012-10-11 13:43:53.667142 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4303 0x2bd6990 -995> 2012-10-11 13:43:53.667149 7f4401226700 5 journal submit_entry seq 4303 len 65 (0x2d19300) -994> 2012-10-11 13:43:53.667155 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -993> 2012-10-11 13:43:53.667158 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -992> 2012-10-11 13:43:53.669908 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x33239b0 seq 4302 osr(0.b6 0x2468580) 0x2f212d0 -991> 2012-10-11 13:43:53.669926 7f4409337700 5 filestore(/data/osd.0) queue_op 0x33239b0 seq 4302 osr(0.b6 0x2468580) 60 bytes (queue has 451 ops and 221292 bytes) -990> 2012-10-11 13:43:53.669939 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 1) -989> 2012-10-11 13:43:53.669943 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 65) -988> 2012-10-11 13:43:53.669946 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 1 ops and 65 bytes -987> 2012-10-11 13:43:53.671136 7f4408335700 5 filestore(/data/osd.0) _do_op 0x28289b0 seq 3855 osr(1.8e 0x2adbd00)/0x2adbd00 start -986> 2012-10-11 13:43:53.671247 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.b8 0x2468520)/0x2468520 -985> 2012-10-11 13:43:53.671269 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -984> 2012-10-11 13:43:53.671272 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -983> 2012-10-11 13:43:53.671273 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4304 0x2bd6240 -982> 2012-10-11 13:43:53.671279 7f4401226700 5 journal submit_entry seq 4304 len 65 (0x2d19a80) -981> 2012-10-11 13:43:53.671282 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -980> 2012-10-11 13:43:53.671284 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -979> 2012-10-11 13:43:53.672547 7f4408335700 5 filestore(/data/osd.0) _do_op 0x30601e0 seq 3856 osr(1.93 0x2adbc10)/0x2adbc10 start -978> 2012-10-11 13:43:53.673457 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- osd_sub_op(osd.0.0:21 1.8e c4405e8e/608.00000000/head//1 [push] v 3'1 snapset=0=[]:[] snapc=0=[]) v7 -- ?+0 0x2fbf400 -977> 2012-10-11 13:43:53.674138 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.d8) v3 -- ?+0 0x2337700 -976> 2012-10-11 13:43:53.674156 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2574820 seq 3857 osr(0.cb 0x2468990)/0x2468990 start -975> 2012-10-11 13:43:53.674188 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.d8 0x2e38b20)/0x2e38b20 -974> 2012-10-11 13:43:53.674195 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -973> 2012-10-11 13:43:53.674197 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -972> 2012-10-11 13:43:53.674199 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4305 0x2f21630 -971> 2012-10-11 13:43:53.674204 7f4402228700 5 journal submit_entry seq 4305 len 682 (0x2719780) -970> 2012-10-11 13:43:53.674207 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -969> 2012-10-11 13:43:53.674209 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -968> 2012-10-11 13:43:53.674222 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.d9) v3 -- ?+0 0x2337e00 -967> 2012-10-11 13:43:53.674250 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.d9 0x2468af0)/0x2468af0 -966> 2012-10-11 13:43:53.674255 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -965> 2012-10-11 13:43:53.674256 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -964> 2012-10-11 13:43:53.674259 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4306 0x2f21750 -963> 2012-10-11 13:43:53.674263 7f4402228700 5 journal submit_entry seq 4306 len 682 (0x341c000) -962> 2012-10-11 13:43:53.674266 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -961> 2012-10-11 13:43:53.674268 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -960> 2012-10-11 13:43:53.674282 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.da) v3 -- ?+0 0x3099380 -959> 2012-10-11 13:43:53.674309 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.da 0x25cf120)/0x25cf120 -958> 2012-10-11 13:43:53.674313 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -957> 2012-10-11 13:43:53.674315 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -956> 2012-10-11 13:43:53.674317 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4307 0x2f21120 -955> 2012-10-11 13:43:53.674321 7f4402228700 5 journal submit_entry seq 4307 len 682 (0x31a16f0) -954> 2012-10-11 13:43:53.674323 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -953> 2012-10-11 13:43:53.674326 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -952> 2012-10-11 13:43:53.674337 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.d5) v3 -- ?+0 0x30991c0 -951> 2012-10-11 13:43:53.674363 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.d5 0x25cf210)/0x25cf210 -950> 2012-10-11 13:43:53.674367 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -949> 2012-10-11 13:43:53.674369 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -948> 2012-10-11 13:43:53.674371 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4308 0x2f216c0 -947> 2012-10-11 13:43:53.674375 7f4402228700 5 journal submit_entry seq 4308 len 682 (0x2a69b40) -946> 2012-10-11 13:43:53.674378 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -945> 2012-10-11 13:43:53.674381 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -944> 2012-10-11 13:43:53.674393 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1846, time: 2012-10-11 13:43:53.674392, event: done, request: pg_info(1 pgs e8:1.8e) v3 -943> 2012-10-11 13:43:53.674421 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 471 (0xb7c748 -> 71717) -942> 2012-10-11 13:43:53.674431 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.2 149.165.228.10:6808/1657 741 ==== osd pg remove(epoch 8; pg0.21; ) v1 ==== 25+0+0 (3573557037 0 0) 0x256e1c0 con 0x2fe2280 -941> 2012-10-11 13:43:53.674452 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1847, time: 2012-10-11 13:43:51.017051, event: header_read, request: osd pg remove(epoch 8; pg0.21; ) v1 -940> 2012-10-11 13:43:53.674461 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1847, time: 2012-10-11 13:43:51.017053, event: throttled, request: osd pg remove(epoch 8; pg0.21; ) v1 -939> 2012-10-11 13:43:53.674469 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1847, time: 2012-10-11 13:43:51.017057, event: all_read, request: osd pg remove(epoch 8; pg0.21; ) v1 -938> 2012-10-11 13:43:53.674476 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1847, time: 2012-10-11 13:43:53.674450, event: dispatched, request: osd pg remove(epoch 8; pg0.21; ) v1 -937> 2012-10-11 13:43:53.674484 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1847, time: 2012-10-11 13:43:53.674484, event: waiting_for_osdmap, request: osd pg remove(epoch 8; pg0.21; ) v1 -936> 2012-10-11 13:43:53.674497 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1847, time: 2012-10-11 13:43:53.674497, event: started, request: osd pg remove(epoch 8; pg0.21; ) v1 -935> 2012-10-11 13:43:53.674504 7f440532f700 5 osd.0 8 queue_pg_for_deletion: 0.21 -934> 2012-10-11 13:43:53.674534 7f440532f700 5 filestore(/data/osd.0) queue_transactions existing osr(0.21 0x1d71970)/0x1d71970 -933> 2012-10-11 13:43:53.674540 7f440532f700 5 throttle(filestore_ops 0x1dc5328) wait -932> 2012-10-11 13:43:53.674542 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) wait -931> 2012-10-11 13:43:53.674544 7f440532f700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4309 0x2d2d510 -930> 2012-10-11 13:43:53.674549 7f440532f700 5 journal submit_entry seq 4309 len 205 (0x1f9c450) -929> 2012-10-11 13:43:53.674553 7f440532f700 5 throttle(filestore_ops 0x1dc5328) take 1 -928> 2012-10-11 13:43:53.674555 7f440532f700 5 throttle(filestore_bytes 0x1dc53a8) take 205 -927> 2012-10-11 13:43:53.674589 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1847, time: 2012-10-11 13:43:53.674589, event: done, request: osd pg remove(epoch 8; pg0.21; ) v1 -926> 2012-10-11 13:43:53.674603 7f440532f700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) put 25 (0xb7c748 -> 71692) -925> 2012-10-11 13:43:53.674607 7f440532f700 1 -- 149.165.228.10:6802/338 <== osd.1 149.165.228.10:6805/1098 1086 ==== pg_info(1 pgs e8:1.93) v3 ==== 471+0+0 (3502180230 0 0) 0x28d1c40 con 0x2fe2140 -924> 2012-10-11 13:43:53.674622 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1848, time: 2012-10-11 13:43:50.937308, event: header_read, request: pg_info(1 pgs e8:1.93) v3 -923> 2012-10-11 13:43:53.674635 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1848, time: 2012-10-11 13:43:50.937310, event: throttled, request: pg_info(1 pgs e8:1.93) v3 -922> 2012-10-11 13:43:53.674642 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1848, time: 2012-10-11 13:43:50.937318, event: all_read, request: pg_info(1 pgs e8:1.93) v3 -921> 2012-10-11 13:43:53.674648 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1848, time: 2012-10-11 13:43:53.674620, event: dispatched, request: pg_info(1 pgs e8:1.93) v3 -920> 2012-10-11 13:43:53.674636 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.d6) v3 -- ?+0 0x3099c40 -919> 2012-10-11 13:43:53.674655 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1848, time: 2012-10-11 13:43:53.674655, event: waiting_for_osdmap, request: pg_info(1 pgs e8:1.93) v3 -918> 2012-10-11 13:43:53.674664 7f440532f700 5 --OSD::tracker-- reqid: unknown.0.0:0, seq: 1848, time: 2012-10-11 13:43:53.674664, event: started, request: pg_info(1 pgs e8:1.93) v3 -917> 2012-10-11 13:43:53.674688 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.d6 0x2e38b80)/0x2e38b80 -916> 2012-10-11 13:43:53.674697 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -915> 2012-10-11 13:43:53.674700 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -914> 2012-10-11 13:43:53.674702 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4310 0x250e5a0 -913> 2012-10-11 13:43:53.674706 7f4402228700 5 journal submit_entry seq 4310 len 682 (0x31a1480) -912> 2012-10-11 13:43:53.674709 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -911> 2012-10-11 13:43:53.674712 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -910> 2012-10-11 13:43:53.674726 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.d7) v3 -- ?+0 0x2f4fc40 -909> 2012-10-11 13:43:53.674757 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.d7 0x2468b50)/0x2468b50 -908> 2012-10-11 13:43:53.674764 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -907> 2012-10-11 13:43:53.674766 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -906> 2012-10-11 13:43:53.674768 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4311 0x250e6c0 -905> 2012-10-11 13:43:53.674774 7f4402228700 5 journal submit_entry seq 4311 len 682 (0x2a69780) -904> 2012-10-11 13:43:53.674782 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -903> 2012-10-11 13:43:53.674784 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -902> 2012-10-11 13:43:53.674796 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.d7) v3 -- ?+0 0x2f4fa80 -901> 2012-10-11 13:43:53.674825 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.d7 0x25cf1b0)/0x25cf1b0 -900> 2012-10-11 13:43:53.674832 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -899> 2012-10-11 13:43:53.674834 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -898> 2012-10-11 13:43:53.674836 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4312 0x250ebd0 -897> 2012-10-11 13:43:53.674840 7f4402228700 5 journal submit_entry seq 4312 len 682 (0x2a64c00) -896> 2012-10-11 13:43:53.674845 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -895> 2012-10-11 13:43:53.674848 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -894> 2012-10-11 13:43:53.674862 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.d4) v3 -- ?+0 0x2f4f8c0 -893> 2012-10-11 13:43:53.674891 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.d4 0x2e38be0)/0x2e38be0 -892> 2012-10-11 13:43:53.674897 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -891> 2012-10-11 13:43:53.674899 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -890> 2012-10-11 13:43:53.674901 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4313 0x250ee10 -889> 2012-10-11 13:43:53.674907 7f4402228700 5 journal submit_entry seq 4313 len 682 (0x1e86870) -888> 2012-10-11 13:43:53.674912 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -887> 2012-10-11 13:43:53.674914 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -886> 2012-10-11 13:43:53.674928 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.d5) v3 -- ?+0 0x3257000 -885> 2012-10-11 13:43:53.674956 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.d5 0x2468bb0)/0x2468bb0 -884> 2012-10-11 13:43:53.674963 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -883> 2012-10-11 13:43:53.674965 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -882> 2012-10-11 13:43:53.674967 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4314 0x250ecf0 -881> 2012-10-11 13:43:53.674973 7f4402228700 5 journal submit_entry seq 4314 len 682 (0x292e180) -880> 2012-10-11 13:43:53.674977 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -879> 2012-10-11 13:43:53.674980 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -878> 2012-10-11 13:43:53.674991 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.d4) v3 -- ?+0 0x3257380 -877> 2012-10-11 13:43:53.675019 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.d4 0x2468be0)/0x2468be0 -876> 2012-10-11 13:43:53.675026 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -875> 2012-10-11 13:43:53.675028 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -874> 2012-10-11 13:43:53.675033 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4315 0x250e360 -873> 2012-10-11 13:43:53.675038 7f4402228700 5 journal submit_entry seq 4315 len 682 (0x1f50090) -872> 2012-10-11 13:43:53.675042 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -871> 2012-10-11 13:43:53.675044 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -870> 2012-10-11 13:43:53.675065 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.d3) v3 -- ?+0 0x331a700 -869> 2012-10-11 13:43:53.675095 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.d3 0x2e38810)/0x2e38810 -868> 2012-10-11 13:43:53.675102 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -867> 2012-10-11 13:43:53.675104 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -866> 2012-10-11 13:43:53.675106 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4316 0x250e750 -865> 2012-10-11 13:43:53.675113 7f4402228700 5 journal submit_entry seq 4316 len 682 (0x2c78840) -864> 2012-10-11 13:43:53.675118 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -863> 2012-10-11 13:43:53.675120 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -862> 2012-10-11 13:43:53.675134 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.d3) v3 -- ?+0 0x331ae00 -861> 2012-10-11 13:43:53.675163 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.d3 0x2468690)/0x2468690 -860> 2012-10-11 13:43:53.675170 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -859> 2012-10-11 13:43:53.675172 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -858> 2012-10-11 13:43:53.675174 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4317 0x250e1b0 -857> 2012-10-11 13:43:53.675180 7f4402228700 5 journal submit_entry seq 4317 len 682 (0x292e2a0) -856> 2012-10-11 13:43:53.675185 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -855> 2012-10-11 13:43:53.675188 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -854> 2012-10-11 13:43:53.675199 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.d2) v3 -- ?+0 0x20aa540 -853> 2012-10-11 13:43:53.675228 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.d2 0x2468610)/0x2468610 -852> 2012-10-11 13:43:53.675232 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -851> 2012-10-11 13:43:53.675234 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -850> 2012-10-11 13:43:53.675236 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4318 0x250e120 -849> 2012-10-11 13:43:53.675240 7f4402228700 5 journal submit_entry seq 4318 len 682 (0x292e150) -848> 2012-10-11 13:43:53.675243 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -847> 2012-10-11 13:43:53.675249 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -846> 2012-10-11 13:43:53.675260 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.cc) v3 -- ?+0 0x301be00 -845> 2012-10-11 13:43:53.675289 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.cc 0x2468860)/0x2468860 -844> 2012-10-11 13:43:53.675295 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -843> 2012-10-11 13:43:53.675297 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -842> 2012-10-11 13:43:53.675301 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4319 0x250e240 -841> 2012-10-11 13:43:53.675306 7f4402228700 5 journal submit_entry seq 4319 len 682 (0x2219810) -840> 2012-10-11 13:43:53.675310 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -839> 2012-10-11 13:43:53.675312 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -838> 2012-10-11 13:43:53.675328 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.ce) v3 -- ?+0 0x301bc40 -837> 2012-10-11 13:43:53.675357 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.ce 0x2468900)/0x2468900 -836> 2012-10-11 13:43:53.675362 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -835> 2012-10-11 13:43:53.675363 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -834> 2012-10-11 13:43:53.675365 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4320 0x2ab1870 -833> 2012-10-11 13:43:53.675369 7f4402228700 5 journal submit_entry seq 4320 len 682 (0x2803c90) -832> 2012-10-11 13:43:53.675372 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -831> 2012-10-11 13:43:53.675374 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -830> 2012-10-11 13:43:53.675385 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.cd) v3 -- ?+0 0x29e48c0 -829> 2012-10-11 13:43:53.675411 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.cd 0x2468930)/0x2468930 -828> 2012-10-11 13:43:53.675415 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -827> 2012-10-11 13:43:53.675417 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -826> 2012-10-11 13:43:53.675419 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4321 0x2ab1b40 -825> 2012-10-11 13:43:53.675423 7f4402228700 5 journal submit_entry seq 4321 len 682 (0x25a3ab0) -824> 2012-10-11 13:43:53.675425 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -823> 2012-10-11 13:43:53.675427 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -822> 2012-10-11 13:43:53.675438 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.cc) v3 -- ?+0 0x29e4e00 -821> 2012-10-11 13:43:53.675464 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.cc 0x2e38960)/0x2e38960 -820> 2012-10-11 13:43:53.675468 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -819> 2012-10-11 13:43:53.675470 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -818> 2012-10-11 13:43:53.675472 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4322 0x2ab1120 -817> 2012-10-11 13:43:53.675476 7f4402228700 5 journal submit_entry seq 4322 len 682 (0x322ee70) -816> 2012-10-11 13:43:53.675478 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -815> 2012-10-11 13:43:53.675480 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -814> 2012-10-11 13:43:53.675490 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.cd) v3 -- ?+0 0x255ae00 -813> 2012-10-11 13:43:53.675516 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.cd 0x2e38930)/0x2e38930 -812> 2012-10-11 13:43:53.675520 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -811> 2012-10-11 13:43:53.675522 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -810> 2012-10-11 13:43:53.675526 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4323 0x2ab13f0 -809> 2012-10-11 13:43:53.675530 7f4402228700 5 journal submit_entry seq 4323 len 682 (0x2e18510) -808> 2012-10-11 13:43:53.675532 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -807> 2012-10-11 13:43:53.675534 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -806> 2012-10-11 13:43:53.675544 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.cb) v3 -- ?+0 0x2dc6540 -805> 2012-10-11 13:43:53.675570 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.cb 0x2468820)/0x2468820 -804> 2012-10-11 13:43:53.675574 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -803> 2012-10-11 13:43:53.675576 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -802> 2012-10-11 13:43:53.675578 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4324 0x2ab12d0 -801> 2012-10-11 13:43:53.675581 7f4402228700 5 journal submit_entry seq 4324 len 682 (0x22199c0) -800> 2012-10-11 13:43:53.675584 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -799> 2012-10-11 13:43:53.675586 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -798> 2012-10-11 13:43:53.675596 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.c8) v3 -- ?+0 0x206d1c0 -797> 2012-10-11 13:43:53.675622 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.c8 0x2468620)/0x2468620 -796> 2012-10-11 13:43:53.675626 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -795> 2012-10-11 13:43:53.675628 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -794> 2012-10-11 13:43:53.675630 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4325 0x2ab17e0 -793> 2012-10-11 13:43:53.675633 7f4402228700 5 journal submit_entry seq 4325 len 682 (0x322eed0) -792> 2012-10-11 13:43:53.675636 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -791> 2012-10-11 13:43:53.675638 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -790> 2012-10-11 13:43:53.675648 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.c5) v3 -- ?+0 0x206d8c0 -789> 2012-10-11 13:43:53.675674 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.c5 0x2468470)/0x2468470 -788> 2012-10-11 13:43:53.675679 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -787> 2012-10-11 13:43:53.675680 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -786> 2012-10-11 13:43:53.675682 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4326 0x2ab1000 -785> 2012-10-11 13:43:53.675686 7f4402228700 5 journal submit_entry seq 4326 len 682 (0x2881c90) -784> 2012-10-11 13:43:53.675688 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -783> 2012-10-11 13:43:53.675691 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -782> 2012-10-11 13:43:53.675702 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.c6) v3 -- ?+0 0x309e540 -781> 2012-10-11 13:43:53.675728 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.c6 0x2e38680)/0x2e38680 -780> 2012-10-11 13:43:53.675733 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -779> 2012-10-11 13:43:53.675735 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -778> 2012-10-11 13:43:53.675740 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4327 0x2ab1090 -777> 2012-10-11 13:43:53.675744 7f4402228700 5 journal submit_entry seq 4327 len 682 (0x23c7fc0) -776> 2012-10-11 13:43:53.675746 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -775> 2012-10-11 13:43:53.675748 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -774> 2012-10-11 13:43:53.675759 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.c7) v3 -- ?+0 0x309e1c0 -773> 2012-10-11 13:43:53.675785 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.c7 0x2468650)/0x2468650 -772> 2012-10-11 13:43:53.675789 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -771> 2012-10-11 13:43:53.675791 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -770> 2012-10-11 13:43:53.675793 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4328 0x2ab1f30 -769> 2012-10-11 13:43:53.675796 7f4402228700 5 journal submit_entry seq 4328 len 682 (0x31a1a80) -768> 2012-10-11 13:43:53.675799 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -767> 2012-10-11 13:43:53.675801 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -766> 2012-10-11 13:43:53.675811 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.c7) v3 -- ?+0 0x2a27c40 -765> 2012-10-11 13:43:53.675837 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.c7 0x2e38650)/0x2e38650 -764> 2012-10-11 13:43:53.675842 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -763> 2012-10-11 13:43:53.675843 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -762> 2012-10-11 13:43:53.675845 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4329 0x2ab1bd0 -761> 2012-10-11 13:43:53.675849 7f4402228700 5 journal submit_entry seq 4329 len 682 (0x32358d0) -760> 2012-10-11 13:43:53.675851 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -759> 2012-10-11 13:43:53.675853 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -758> 2012-10-11 13:43:53.675864 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.c6) v3 -- ?+0 0x2a27000 -757> 2012-10-11 13:43:53.675890 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.c6 0x2468450)/0x2468450 -756> 2012-10-11 13:43:53.675894 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -755> 2012-10-11 13:43:53.675896 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -754> 2012-10-11 13:43:53.675898 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4330 0x2ab1750 -753> 2012-10-11 13:43:53.675902 7f4402228700 5 journal submit_entry seq 4330 len 682 (0x2238ae0) -752> 2012-10-11 13:43:53.675904 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -751> 2012-10-11 13:43:53.675906 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -750> 2012-10-11 13:43:53.675917 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.bd) v3 -- ?+0 0x2e62380 -749> 2012-10-11 13:43:53.675943 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.bd 0x2468370)/0x2468370 -748> 2012-10-11 13:43:53.675948 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -747> 2012-10-11 13:43:53.675949 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -746> 2012-10-11 13:43:53.675955 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4331 0x2ab1360 -745> 2012-10-11 13:43:53.675959 7f4402228700 5 journal submit_entry seq 4331 len 682 (0x3339a80) -744> 2012-10-11 13:43:53.675961 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -743> 2012-10-11 13:43:53.675963 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -742> 2012-10-11 13:43:53.675974 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.d) v3 -- ?+0 0x3009e00 -741> 2012-10-11 13:43:53.676000 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.d 0x1d71560)/0x1d71560 -740> 2012-10-11 13:43:53.676005 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -739> 2012-10-11 13:43:53.676006 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -738> 2012-10-11 13:43:53.676008 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4332 0x31cb090 -737> 2012-10-11 13:43:53.676012 7f4402228700 5 journal submit_entry seq 4332 len 679 (0x2f58f60) -736> 2012-10-11 13:43:53.676015 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -735> 2012-10-11 13:43:53.676017 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 679 -734> 2012-10-11 13:43:53.676028 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.c) v3 -- ?+0 0x2ca7a80 -733> 2012-10-11 13:43:53.676053 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.c 0x27a1560)/0x27a1560 -732> 2012-10-11 13:43:53.676058 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -731> 2012-10-11 13:43:53.676060 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -730> 2012-10-11 13:43:53.676061 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4333 0x31cb240 -729> 2012-10-11 13:43:53.676065 7f4402228700 5 journal submit_entry seq 4333 len 679 (0x2ab5030) -728> 2012-10-11 13:43:53.676068 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -727> 2012-10-11 13:43:53.676070 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 679 -726> 2012-10-11 13:43:53.676081 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.b) v3 -- ?+0 0x1f928c0 -725> 2012-10-11 13:43:53.676107 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b 0x3176390)/0x3176390 -724> 2012-10-11 13:43:53.676111 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -723> 2012-10-11 13:43:53.676113 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -722> 2012-10-11 13:43:53.676115 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4334 0x31cbea0 -721> 2012-10-11 13:43:53.676119 7f4402228700 5 journal submit_entry seq 4334 len 679 (0x3419240) -720> 2012-10-11 13:43:53.676121 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -719> 2012-10-11 13:43:53.676123 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 679 -718> 2012-10-11 13:43:53.676134 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.4) v3 -- ?+0 0x274ba80 -717> 2012-10-11 13:43:53.676160 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.4 0x27a12e0)/0x27a12e0 -716> 2012-10-11 13:43:53.676168 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -715> 2012-10-11 13:43:53.676170 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -714> 2012-10-11 13:43:53.676175 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4335 0x31cbab0 -713> 2012-10-11 13:43:53.676179 7f4402228700 5 journal submit_entry seq 4335 len 679 (0x322edb0) -712> 2012-10-11 13:43:53.676181 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -711> 2012-10-11 13:43:53.676183 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 679 -710> 2012-10-11 13:43:53.676194 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.1) v3 -- ?+0 0x21411c0 -709> 2012-10-11 13:43:53.676220 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.1 0x3176300)/0x3176300 -708> 2012-10-11 13:43:53.676224 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -707> 2012-10-11 13:43:53.676226 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -706> 2012-10-11 13:43:53.676228 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4336 0x22b9a20 -705> 2012-10-11 13:43:53.676232 7f4402228700 5 journal submit_entry seq 4336 len 679 (0x322ef00) -704> 2012-10-11 13:43:53.676234 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -703> 2012-10-11 13:43:53.676236 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 679 -702> 2012-10-11 13:43:53.676247 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.be) v3 -- ?+0 0x21418c0 -701> 2012-10-11 13:43:53.676275 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.be 0x2e38400)/0x2e38400 -700> 2012-10-11 13:43:53.676280 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -699> 2012-10-11 13:43:53.676281 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -698> 2012-10-11 13:43:53.676283 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4337 0x2a26ea0 -697> 2012-10-11 13:43:53.676287 7f4402228700 5 journal submit_entry seq 4337 len 682 (0x21c7900) -696> 2012-10-11 13:43:53.676289 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -695> 2012-10-11 13:43:53.676292 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -694> 2012-10-11 13:43:53.676303 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.5) v3 -- ?+0 0x27a2000 -693> 2012-10-11 13:43:53.676330 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.5 0x1d713b0)/0x1d713b0 -692> 2012-10-11 13:43:53.676334 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -691> 2012-10-11 13:43:53.676336 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -690> 2012-10-11 13:43:53.676338 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4338 0x2f21cf0 -689> 2012-10-11 13:43:53.676342 7f4402228700 5 journal submit_entry seq 4338 len 679 (0x2553030) -688> 2012-10-11 13:43:53.676344 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -687> 2012-10-11 13:43:53.676346 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 679 -686> 2012-10-11 13:43:53.676357 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.2) v3 -- ?+0 0x27a2e00 -685> 2012-10-11 13:43:53.676383 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.2 0x27a1340)/0x27a1340 -684> 2012-10-11 13:43:53.676387 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -683> 2012-10-11 13:43:53.676389 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -682> 2012-10-11 13:43:53.676393 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4339 0x2aa3d80 -681> 2012-10-11 13:43:53.676398 7f4402228700 5 journal submit_entry seq 4339 len 679 (0x2553540) -680> 2012-10-11 13:43:53.676400 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -679> 2012-10-11 13:43:53.676402 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 679 -678> 2012-10-11 13:43:53.676412 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.3) v3 -- ?+0 0x2cc5540 -677> 2012-10-11 13:43:53.676438 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.3 0x1d71340)/0x1d71340 -676> 2012-10-11 13:43:53.676443 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -675> 2012-10-11 13:43:53.676444 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -674> 2012-10-11 13:43:53.676446 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4340 0x2aa3c60 -673> 2012-10-11 13:43:53.676450 7f4402228700 5 journal submit_entry seq 4340 len 679 (0x320b810) -672> 2012-10-11 13:43:53.676453 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -671> 2012-10-11 13:43:53.676455 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 679 -670> 2012-10-11 13:43:53.676465 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.3) v3 -- ?+0 0x2cc5c40 -669> 2012-10-11 13:43:53.676491 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.3 0x31762a0)/0x31762a0 -668> 2012-10-11 13:43:53.676496 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -667> 2012-10-11 13:43:53.676497 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -666> 2012-10-11 13:43:53.676499 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4341 0x301dd80 -665> 2012-10-11 13:43:53.676503 7f4402228700 5 journal submit_entry seq 4341 len 679 (0x29c6a80) -664> 2012-10-11 13:43:53.676505 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -663> 2012-10-11 13:43:53.676507 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 679 -662> 2012-10-11 13:43:53.676523 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.f4) v3 -- ?+0 0x2499000 -661> 2012-10-11 13:43:53.676553 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.f4 0x27a11e0)/0x27a11e0 -660> 2012-10-11 13:43:53.676557 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -659> 2012-10-11 13:43:53.676559 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -658> 2012-10-11 13:43:53.676561 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4342 0x2bd6750 -657> 2012-10-11 13:43:53.676565 7f4402228700 5 journal submit_entry seq 4342 len 682 (0x32ef7b0) -656> 2012-10-11 13:43:53.676567 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -655> 2012-10-11 13:43:53.676569 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -654> 2012-10-11 13:43:53.676580 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.f3) v3 -- ?+0 0x2499c40 -653> 2012-10-11 13:43:53.676606 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.f3 0x2e38e10)/0x2e38e10 -652> 2012-10-11 13:43:53.676610 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -651> 2012-10-11 13:43:53.676612 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -650> 2012-10-11 13:43:53.676617 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4343 0x311e090 -649> 2012-10-11 13:43:53.676621 7f4402228700 5 journal submit_entry seq 4343 len 682 (0x2202900) -648> 2012-10-11 13:43:53.676623 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -647> 2012-10-11 13:43:53.676625 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -646> 2012-10-11 13:43:53.676636 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.e1) v3 -- ?+0 0x3257e00 -645> 2012-10-11 13:43:53.676663 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.e1 0x25cf230)/0x25cf230 -644> 2012-10-11 13:43:53.676667 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -643> 2012-10-11 13:43:53.676669 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -642> 2012-10-11 13:43:53.676670 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4344 0x311ee10 -641> 2012-10-11 13:43:53.676674 7f4402228700 5 journal submit_entry seq 4344 len 682 (0x2202bd0) -640> 2012-10-11 13:43:53.676677 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -639> 2012-10-11 13:43:53.676679 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -638> 2012-10-11 13:43:53.676689 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.bf) v3 -- ?+0 0x3257c40 -637> 2012-10-11 13:43:53.676715 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.bf 0x24687d0)/0x24687d0 -636> 2012-10-11 13:43:53.676719 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -635> 2012-10-11 13:43:53.676720 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -634> 2012-10-11 13:43:53.676722 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4345 0x311e900 -633> 2012-10-11 13:43:53.676726 7f4402228700 5 journal submit_entry seq 4345 len 682 (0x32efcc0) -632> 2012-10-11 13:43:53.676728 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -631> 2012-10-11 13:43:53.676731 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -630> 2012-10-11 13:43:53.676741 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.bd) v3 -- ?+0 0x3257a80 -629> 2012-10-11 13:43:53.676767 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.bd 0x2468430)/0x2468430 -628> 2012-10-11 13:43:53.676771 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -627> 2012-10-11 13:43:53.676773 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -626> 2012-10-11 13:43:53.676774 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4346 0x2357d80 -625> 2012-10-11 13:43:53.676778 7f4402228700 5 journal submit_entry seq 4346 len 682 (0x33b0060) -624> 2012-10-11 13:43:53.676781 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -623> 2012-10-11 13:43:53.676783 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -622> 2012-10-11 13:43:53.676793 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.f2) v3 -- ?+0 0x304e380 -621> 2012-10-11 13:43:53.676819 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.f2 0x2468c60)/0x2468c60 -620> 2012-10-11 13:43:53.676824 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -619> 2012-10-11 13:43:53.676826 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -618> 2012-10-11 13:43:53.676831 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4347 0x24bc090 -617> 2012-10-11 13:43:53.676835 7f4402228700 5 journal submit_entry seq 4347 len 682 (0x2719db0) -616> 2012-10-11 13:43:53.676837 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -615> 2012-10-11 13:43:53.676840 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -614> 2012-10-11 13:43:53.676850 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.e2) v3 -- ?+0 0x304e700 -613> 2012-10-11 13:43:53.676876 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.e2 0x2e38d40)/0x2e38d40 -612> 2012-10-11 13:43:53.676880 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -611> 2012-10-11 13:43:53.676882 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -610> 2012-10-11 13:43:53.676884 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4348 0x3250ea0 -609> 2012-10-11 13:43:53.676888 7f4402228700 5 journal submit_entry seq 4348 len 682 (0x2ec0f30) -608> 2012-10-11 13:43:53.676890 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -607> 2012-10-11 13:43:53.676892 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -606> 2012-10-11 13:43:53.676904 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.e3) v3 -- ?+0 0x304ec40 -605> 2012-10-11 13:43:53.676931 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.e3 0x2468d10)/0x2468d10 -604> 2012-10-11 13:43:53.676935 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -603> 2012-10-11 13:43:53.676937 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -602> 2012-10-11 13:43:53.676939 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4349 0x32506c0 -601> 2012-10-11 13:43:53.676943 7f4402228700 5 journal submit_entry seq 4349 len 682 (0x29b9c30) -600> 2012-10-11 13:43:53.676945 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -599> 2012-10-11 13:43:53.676947 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -598> 2012-10-11 13:43:53.678525 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.e3) v3 -- ?+0 0x3043000 -597> 2012-10-11 13:43:53.679185 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 176 (71692 -> 71868) -596> 2012-10-11 13:43:53.679288 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.e3 0x2468d90)/0x2468d90 -595> 2012-10-11 13:43:53.679315 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -594> 2012-10-11 13:43:53.679328 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -593> 2012-10-11 13:43:53.679341 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4350 0x3250900 -592> 2012-10-11 13:43:53.679361 7f4402228700 5 journal submit_entry seq 4350 len 682 (0x34194b0) -591> 2012-10-11 13:43:53.679374 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -590> 2012-10-11 13:43:53.679387 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -589> 2012-10-11 13:43:53.679412 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.e8) v3 -- ?+0 0x3043e00 -588> 2012-10-11 13:43:53.679458 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.e8 0x2468b60)/0x2468b60 -587> 2012-10-11 13:43:53.679474 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -586> 2012-10-11 13:43:53.679486 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -585> 2012-10-11 13:43:53.679498 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4351 0x3250360 -584> 2012-10-11 13:43:53.679513 7f4402228700 5 journal submit_entry seq 4351 len 682 (0x27ab7b0) -583> 2012-10-11 13:43:53.679527 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -582> 2012-10-11 13:43:53.679539 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -581> 2012-10-11 13:43:53.679566 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.dc) v3 -- ?+0 0x3043c40 -580> 2012-10-11 13:43:53.679607 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.dc 0x2e38a60)/0x2e38a60 -579> 2012-10-11 13:43:53.679624 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -578> 2012-10-11 13:43:53.679636 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -577> 2012-10-11 13:43:53.679647 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4352 0x3157c60 -576> 2012-10-11 13:43:53.679708 7f4402228700 5 journal submit_entry seq 4352 len 682 (0x22026c0) -575> 2012-10-11 13:43:53.679725 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -574> 2012-10-11 13:43:53.679738 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -573> 2012-10-11 13:43:53.679764 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.dd) v3 -- ?+0 0x3043540 -572> 2012-10-11 13:43:53.679843 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.dd 0x2468a30)/0x2468a30 -571> 2012-10-11 13:43:53.679861 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -570> 2012-10-11 13:43:53.679873 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -569> 2012-10-11 13:43:53.679885 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4353 0x3157ab0 -568> 2012-10-11 13:43:53.679901 7f4402228700 5 journal submit_entry seq 4353 len 682 (0x27ab630) -567> 2012-10-11 13:43:53.679914 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -566> 2012-10-11 13:43:53.679926 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -565> 2012-10-11 13:43:53.679950 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.ea) v3 -- ?+0 0x3043380 -564> 2012-10-11 13:43:53.679993 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.ea 0x2468fc0)/0x2468fc0 -563> 2012-10-11 13:43:53.680010 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -562> 2012-10-11 13:43:53.680022 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -561> 2012-10-11 13:43:53.680034 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4354 0x3157900 -560> 2012-10-11 13:43:53.680051 7f4402228700 5 journal submit_entry seq 4354 len 682 (0x2f51c90) -559> 2012-10-11 13:43:53.680065 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -558> 2012-10-11 13:43:53.680077 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -557> 2012-10-11 13:43:53.680101 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.dc) v3 -- ?+0 0x2b66540 -556> 2012-10-11 13:43:53.680141 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.dc 0x2468a60)/0x2468a60 -555> 2012-10-11 13:43:53.680157 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -554> 2012-10-11 13:43:53.680169 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -553> 2012-10-11 13:43:53.680181 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4355 0x31577e0 -552> 2012-10-11 13:43:53.680196 7f4402228700 5 journal submit_entry seq 4355 len 682 (0x322ee40) -551> 2012-10-11 13:43:53.680210 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -550> 2012-10-11 13:43:53.680222 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -549> 2012-10-11 13:43:53.680237 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.e9) v3 -- ?+0 0x2b66c40 -548> 2012-10-11 13:43:53.680267 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.e9 0x2e38ff0)/0x2e38ff0 -547> 2012-10-11 13:43:53.680273 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 253754 > 104857600 -546> 2012-10-11 13:43:53.681117 7f4402a29700 -1 *** Caught signal (Aborted) ** in thread 7f4402a29700 ceph version 0.52 (commit:e48859474c4944d4ff201ddc9f5fd400e8898173) 1: /usr/bin/ceph-osd() [0x71d86a] 2: (()+0xfcb0) [0x7f441372acb0] 3: (gsignal()+0x35) [0x7f4412304445] 4: (abort()+0x17b) [0x7f4412307bab] 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f4412c5469d] 6: (()+0xb5846) [0x7f4412c52846] 7: (()+0xb5873) [0x7f4412c52873] 8: (()+0xb596e) [0x7f4412c5296e] 9: (object_info_t::decode(ceph::buffer::list::iterator&)+0x5f1) [0x827ef1] 10: (object_info_t::object_info_t(ceph::buffer::list&)+0x184) [0x58ac44] 11: (ReplicatedPG::get_object_context(hobject_t const&, object_locator_t const&, bool)+0x145) [0x554fb5] 12: (ReplicatedPG::recover_object_replicas(hobject_t const&, eversion_t)+0xf0) [0x563ae0] 13: (ReplicatedPG::wait_for_degraded_object(hobject_t const&, std::tr1::shared_ptr)+0x17b) [0x564ffb] 14: (ReplicatedPG::do_op(std::tr1::shared_ptr)+0x9c0) [0x573d10] 15: (PG::do_request(std::tr1::shared_ptr)+0x140) [0x6460d0] 16: (OSD::dequeue_op(PG*)+0x2b2) [0x5ad642] 17: (ThreadPool::worker()+0x4da) [0x7b9aea] 18: (ThreadPool::WorkThread::entry()+0xd) [0x5ec7ed] 19: (()+0x7e9a) [0x7f4413722e9a] 20: (clone()+0x6d) [0x7f44123c1dbd] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. -545> 2012-10-11 13:43:53.689363 7f4409337700 5 filestore(/data/osd.0) _journaled_ahead 0x33238c0 seq 4303 osr(0.b7 0x2468550) 0x2bd6990 -544> 2012-10-11 13:43:53.689384 7f4409337700 5 filestore(/data/osd.0) queue_op 0x33238c0 seq 4303 osr(0.b7 0x2468550) 60 bytes (queue has 500 ops and 253077 bytes) -543> 2012-10-11 13:43:53.689399 7f440a339700 5 throttle(filestore_ops 0x1dc5328) put 1 (0xb7c748 -> 52) -542> 2012-10-11 13:43:53.689403 7f440a339700 5 throttle(filestore_bytes 0x1dc53a8) put 65 (0xb7c748 -> 34343) -541> 2012-10-11 13:43:53.689405 7f440a339700 5 journal put_throttle finished 1 ops and 65 bytes, now 52 ops and 34343 bytes -540> 2012-10-11 13:43:53.691979 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3060eb0 seq 3858 osr(2.7b 0x2130880)/0x2130880 start -539> 2012-10-11 13:43:53.692036 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.bb 0x2468490)/0x2468490 -538> 2012-10-11 13:43:53.692047 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -537> 2012-10-11 13:43:53.692049 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -536> 2012-10-11 13:43:53.692050 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4356 0x2d17900 -535> 2012-10-11 13:43:53.692054 7f4401226700 5 journal submit_entry seq 4356 len 65 (0x2d194e0) -534> 2012-10-11 13:43:53.692057 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -533> 2012-10-11 13:43:53.692059 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -532> 2012-10-11 13:43:53.692080 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 253615 > 104857600 -531> 2012-10-11 13:43:53.692795 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x25dbf00 seq 3859 osr(0.d1 0x2468870)/0x2468870 start -530> 2012-10-11 13:43:53.692799 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -529> 2012-10-11 13:43:53.692817 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -528> 2012-10-11 13:43:53.692825 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4357 0x24b6ab0 -527> 2012-10-11 13:43:53.692836 7f4402228700 5 journal submit_entry seq 4357 len 682 (0x3339660) -526> 2012-10-11 13:43:53.692844 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -525> 2012-10-11 13:43:53.692851 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -524> 2012-10-11 13:43:53.692874 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.e4) v3 -- ?+0 0x2b66e00 -523> 2012-10-11 13:43:53.692960 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.e4 0x2e38ce0)/0x2e38ce0 -522> 2012-10-11 13:43:53.692973 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 253371 > 104857600 -521> 2012-10-11 13:43:53.693468 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2045870 seq 3860 osr(2.8d 0x2130b00)/0x2130b00 start -520> 2012-10-11 13:43:53.693537 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -519> 2012-10-11 13:43:53.693541 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.cb 0x2468990)/0x2468990 -518> 2012-10-11 13:43:53.693552 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -517> 2012-10-11 13:43:53.693551 7f4401226700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 253232 > 104857600 -516> 2012-10-11 13:43:53.693565 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4358 0x24b6d80 -515> 2012-10-11 13:43:53.693576 7f4402228700 5 journal submit_entry seq 4358 len 682 (0x210bb10) -514> 2012-10-11 13:43:53.693585 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -513> 2012-10-11 13:43:53.693592 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -512> 2012-10-11 13:43:53.693612 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.e5) v3 -- ?+0 0x2b668c0 -511> 2012-10-11 13:43:53.693649 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.e5 0x2468cb0)/0x2468cb0 -510> 2012-10-11 13:43:53.693659 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 253849 > 104857600 -509> 2012-10-11 13:43:53.694283 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27658c0 seq 3861 osr(2.92 0x2130c40)/0x2130c40 start -508> 2012-10-11 13:43:53.694330 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -507> 2012-10-11 13:43:53.694337 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -506> 2012-10-11 13:43:53.694339 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4359 0x2d17f30 -505> 2012-10-11 13:43:53.694344 7f4401226700 5 journal submit_entry seq 4359 len 65 (0x1e96360) -504> 2012-10-11 13:43:53.694347 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -503> 2012-10-11 13:43:53.694349 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -502> 2012-10-11 13:43:53.694363 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 252988 > 104857600 -501> 2012-10-11 13:43:53.695122 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27650a0 seq 3862 osr(2.97 0x2130ee0)/0x2130ee0 start -500> 2012-10-11 13:43:53.695126 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -499> 2012-10-11 13:43:53.695145 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -498> 2012-10-11 13:43:53.695152 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4360 0x24b6cf0 -497> 2012-10-11 13:43:53.695164 7f4402228700 5 journal submit_entry seq 4360 len 682 (0x2922960) -496> 2012-10-11 13:43:53.695172 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -495> 2012-10-11 13:43:53.695183 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -494> 2012-10-11 13:43:53.695204 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.bc) v3 -- ?+0 0x2b66700 -493> 2012-10-11 13:43:53.695275 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.bc 0x2e38460)/0x2e38460 -492> 2012-10-11 13:43:53.695288 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 252744 > 104857600 -491> 2012-10-11 13:43:53.695922 7f4408335700 5 filestore(/data/osd.0) _do_op 0x25b09b0 seq 3863 osr(2.24 0x1d717e0)/0x1d717e0 start -490> 2012-10-11 13:43:53.695927 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -489> 2012-10-11 13:43:53.695939 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -488> 2012-10-11 13:43:53.695942 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4361 0x24b6f30 -487> 2012-10-11 13:43:53.695947 7f4402228700 5 journal submit_entry seq 4361 len 682 (0x1e3f480) -486> 2012-10-11 13:43:53.695949 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -485> 2012-10-11 13:43:53.695950 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -484> 2012-10-11 13:43:53.695966 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.b8) v3 -- ?+0 0x2b661c0 -483> 2012-10-11 13:43:53.696036 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.b8 0x2e38520)/0x2e38520 -482> 2012-10-11 13:43:53.696041 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 252500 > 104857600 -481> 2012-10-11 13:43:53.696724 7f4408335700 5 filestore(/data/osd.0) _do_op 0x27655a0 seq 3864 osr(2.13 0x1d715e0)/0x1d715e0 start -480> 2012-10-11 13:43:53.696736 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -479> 2012-10-11 13:43:53.696744 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -478> 2012-10-11 13:43:53.696745 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4362 0x2ac9480 -477> 2012-10-11 13:43:53.696751 7f4402228700 5 journal submit_entry seq 4362 len 682 (0x32ef8d0) -476> 2012-10-11 13:43:53.696753 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -475> 2012-10-11 13:43:53.696755 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -474> 2012-10-11 13:43:53.696769 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.b9) v3 -- ?+0 0x309a000 -473> 2012-10-11 13:43:53.696839 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.b9 0x24684f0)/0x24684f0 -472> 2012-10-11 13:43:53.696845 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 252256 > 104857600 -471> 2012-10-11 13:43:53.698778 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323820 seq 3865 osr(0.26 0x1d71a60)/0x1d71a60 start -470> 2012-10-11 13:43:53.698801 7f43ff821700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 33 (71868 -> 71901) -469> 2012-10-11 13:43:53.698836 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -468> 2012-10-11 13:43:53.698846 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -467> 2012-10-11 13:43:53.698847 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4363 0x2ac9360 -466> 2012-10-11 13:43:53.698854 7f4402228700 5 journal submit_entry seq 4363 len 682 (0x1f46270) -465> 2012-10-11 13:43:53.698857 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -464> 2012-10-11 13:43:53.698859 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -463> 2012-10-11 13:43:53.698874 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.bb) v3 -- ?+0 0x309aa80 -462> 2012-10-11 13:43:53.698940 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.bb 0x24682e0)/0x24682e0 -461> 2012-10-11 13:43:53.698948 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 251969 > 104857600 -460> 2012-10-11 13:43:53.699792 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -459> 2012-10-11 13:43:53.699803 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -458> 2012-10-11 13:43:53.699805 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4364 0x2ac9a20 -457> 2012-10-11 13:43:53.699810 7f4402228700 5 journal submit_entry seq 4364 len 682 (0x3235e10) -456> 2012-10-11 13:43:53.699813 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -455> 2012-10-11 13:43:53.699815 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -454> 2012-10-11 13:43:53.699837 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.b7) v3 -- ?+0 0x309a1c0 -453> 2012-10-11 13:43:53.699905 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.b7 0x24685c0)/0x24685c0 -452> 2012-10-11 13:43:53.699924 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 251725 > 104857600 -451> 2012-10-11 13:43:53.699935 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323870 seq 3866 osr(1.25 0x27a18b0)/0x27a18b0 start -450> 2012-10-11 13:43:53.700829 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -449> 2012-10-11 13:43:53.700841 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -448> 2012-10-11 13:43:53.700848 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4365 0x2ac9b40 -447> 2012-10-11 13:43:53.700859 7f4402228700 5 journal submit_entry seq 4365 len 682 (0x27ab960) -446> 2012-10-11 13:43:53.700868 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -445> 2012-10-11 13:43:53.700875 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -444> 2012-10-11 13:43:53.700901 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.ad) v3 -- ?+0 0x309ae00 -443> 2012-10-11 13:43:53.700969 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.ad 0x3176e40)/0x3176e40 -442> 2012-10-11 13:43:53.700988 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 251481 > 104857600 -441> 2012-10-11 13:43:53.701000 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323690 seq 3867 osr(0.1b 0x1d71710)/0x1d71710 start -440> 2012-10-11 13:43:53.703666 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -439> 2012-10-11 13:43:53.703679 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -438> 2012-10-11 13:43:53.703686 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4366 0x2ac9c60 -437> 2012-10-11 13:43:53.703705 7f4402228700 5 journal submit_entry seq 4366 len 682 (0x21c7c30) -436> 2012-10-11 13:43:53.703714 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -435> 2012-10-11 13:43:53.703721 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -434> 2012-10-11 13:43:53.703741 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.ae) v3 -- ?+0 0x31d1700 -433> 2012-10-11 13:43:53.703825 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ae 0x2e38300)/0x2e38300 -432> 2012-10-11 13:43:53.703839 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 251237 > 104857600 -431> 2012-10-11 13:43:53.703849 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323730 seq 3868 osr(2.19 0x1d71680)/0x1d71680 start -430> 2012-10-11 13:43:53.705337 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -429> 2012-10-11 13:43:53.705345 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -428> 2012-10-11 13:43:53.705347 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4367 0x2ac9510 -427> 2012-10-11 13:43:53.705352 7f4402228700 5 journal submit_entry seq 4367 len 682 (0x2b5d3f0) -426> 2012-10-11 13:43:53.705354 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -425> 2012-10-11 13:43:53.705355 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -424> 2012-10-11 13:43:53.705372 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.af) v3 -- ?+0 0x331a000 -423> 2012-10-11 13:43:53.705397 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.af 0x24682d0)/0x24682d0 -422> 2012-10-11 13:43:53.705400 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 250993 > 104857600 -421> 2012-10-11 13:43:53.705512 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323640 seq 3869 osr(1.1a 0x27a16c0)/0x27a16c0 start -420> 2012-10-11 13:43:53.708556 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -419> 2012-10-11 13:43:53.708564 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -418> 2012-10-11 13:43:53.708566 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4368 0x2ac9090 -417> 2012-10-11 13:43:53.708572 7f4402228700 5 journal submit_entry seq 4368 len 682 (0x23c7630) -416> 2012-10-11 13:43:53.708574 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -415> 2012-10-11 13:43:53.708575 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -414> 2012-10-11 13:43:53.708593 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.ac) v3 -- ?+0 0x256e8c0 -413> 2012-10-11 13:43:53.708619 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.ac 0x2468360)/0x2468360 -412> 2012-10-11 13:43:53.708625 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 250749 > 104857600 -411> 2012-10-11 13:43:53.708733 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323960 seq 3870 osr(0.19 0x1d71770)/0x1d71770 start -410> 2012-10-11 13:43:53.709671 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323a00 seq 3871 osr(1.18 0x27a1720)/0x27a1720 start -409> 2012-10-11 13:43:53.709678 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -408> 2012-10-11 13:43:53.709686 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -407> 2012-10-11 13:43:53.709690 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4369 0x2ac9750 -406> 2012-10-11 13:43:53.709696 7f4402228700 5 journal submit_entry seq 4369 len 682 (0x2b5dfc0) -405> 2012-10-11 13:43:53.709698 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -404> 2012-10-11 13:43:53.709701 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -403> 2012-10-11 13:43:53.709715 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.ab) v3 -- ?+0 0x2ac7000 -402> 2012-10-11 13:43:53.709741 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.ab 0x2e38390)/0x2e38390 -401> 2012-10-11 13:43:53.709746 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 250505 > 104857600 -400> 2012-10-11 13:43:53.711132 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -399> 2012-10-11 13:43:53.711140 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -398> 2012-10-11 13:43:53.711141 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4370 0x2ac97e0 -397> 2012-10-11 13:43:53.711146 7f4402228700 5 journal submit_entry seq 4370 len 682 (0x2f51e40) -396> 2012-10-11 13:43:53.711149 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -395> 2012-10-11 13:43:53.711151 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -394> 2012-10-11 13:43:53.711164 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.aa) v3 -- ?+0 0x2ac7380 -393> 2012-10-11 13:43:53.711191 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.aa 0x3176ed0)/0x3176ed0 -392> 2012-10-11 13:43:53.711194 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 250261 > 104857600 -391> 2012-10-11 13:43:53.711284 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323a50 seq 3872 osr(0.18 0x1d717a0)/0x1d717a0 start -390> 2012-10-11 13:43:53.712151 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323aa0 seq 3873 osr(2.14 0x3176490)/0x3176490 start -389> 2012-10-11 13:43:53.712154 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -388> 2012-10-11 13:43:53.712183 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -387> 2012-10-11 13:43:53.712191 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4371 0x2ac9ea0 -386> 2012-10-11 13:43:53.712199 7f4402228700 5 journal submit_entry seq 4371 len 682 (0x29c6120) -385> 2012-10-11 13:43:53.712202 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -384> 2012-10-11 13:43:53.712204 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -383> 2012-10-11 13:43:53.712234 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.a5) v3 -- ?+0 0x2ac7700 -382> 2012-10-11 13:43:53.712260 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.a5 0x24680f0)/0x24680f0 -381> 2012-10-11 13:43:53.712264 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 250017 > 104857600 -380> 2012-10-11 13:43:53.713281 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323af0 seq 3874 osr(0.16 0x1d71670)/0x1d71670 start -379> 2012-10-11 13:43:53.713287 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -378> 2012-10-11 13:43:53.713294 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -377> 2012-10-11 13:43:53.713295 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4372 0x2ac95a0 -376> 2012-10-11 13:43:53.713303 7f4402228700 5 journal submit_entry seq 4372 len 682 (0x2a16cc0) -375> 2012-10-11 13:43:53.713306 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -374> 2012-10-11 13:43:53.713308 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -373> 2012-10-11 13:43:53.713334 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.a6) v3 -- ?+0 0x2ac78c0 -372> 2012-10-11 13:43:53.713360 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.a6 0x2e38080)/0x2e38080 -371> 2012-10-11 13:43:53.713365 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 249773 > 104857600 -370> 2012-10-11 13:43:53.714501 7f4408335700 5 filestore(/data/osd.0) _do_op 0x3323b40 seq 3875 osr(1.17 0x27a1750)/0x27a1750 start -369> 2012-10-11 13:43:53.714564 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -368> 2012-10-11 13:43:53.714572 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -367> 2012-10-11 13:43:53.714573 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4373 0x2ac9240 -366> 2012-10-11 13:43:53.714580 7f4402228700 5 journal submit_entry seq 4373 len 682 (0x2ab5cc0) -365> 2012-10-11 13:43:53.714582 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -364> 2012-10-11 13:43:53.714584 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -363> 2012-10-11 13:43:53.714595 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.94 epoch 8 query_epoch 8) v3 -- ?+0 0x2935a00 -362> 2012-10-11 13:43:53.714625 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.a7) v3 -- ?+0 0x2ac7a80 -361> 2012-10-11 13:43:53.714645 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a7 0x2468050)/0x2468050 -360> 2012-10-11 13:43:53.714649 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 249529 > 104857600 -359> 2012-10-11 13:43:53.715503 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3323b90 seq 3876 osr(2.17 0x3176400)/0x3176400 start -358> 2012-10-11 13:43:53.716332 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3323be0 seq 3877 osr(1.15 0x27a17b0)/0x27a17b0 start -357> 2012-10-11 13:43:53.717091 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3323c30 seq 3878 osr(2.16 0x3176430)/0x3176430 start -356> 2012-10-11 13:43:53.717961 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3323c80 seq 3879 osr(2.95 0x3176c60)/0x3176c60 start -355> 2012-10-11 13:43:53.718762 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3323cd0 seq 3880 osr(1.96 0x2adbf80)/0x2adbf80 start -354> 2012-10-11 13:43:53.719537 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3323d20 seq 3881 osr(0.97 0x2130ff0)/0x2130ff0 start -353> 2012-10-11 13:43:53.720296 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x3323d70 seq 3882 osr(2.94 0x3176c90)/0x3176c90 start -352> 2012-10-11 13:43:53.721052 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x23d5b40 seq 3883 osr(0.9a 0x2130f60)/0x2130f60 start -351> 2012-10-11 13:43:53.722573 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 549 (71901 -> 72450) -350> 2012-10-11 13:43:53.729545 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.d1 0x2468870)/0x2468870 -349> 2012-10-11 13:43:53.729557 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -348> 2012-10-11 13:43:53.729559 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -347> 2012-10-11 13:43:53.729560 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4374 0x2062900 -346> 2012-10-11 13:43:53.729564 7f4401226700 5 journal submit_entry seq 4374 len 65 (0x1e96660) -345> 2012-10-11 13:43:53.729566 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -344> 2012-10-11 13:43:53.729568 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -343> 2012-10-11 13:43:53.729618 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -342> 2012-10-11 13:43:53.729620 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -341> 2012-10-11 13:43:53.729622 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4375 0x2ac91b0 -340> 2012-10-11 13:43:53.729627 7f4402228700 5 journal submit_entry seq 4375 len 682 (0x21c7ab0) -339> 2012-10-11 13:43:53.729628 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -338> 2012-10-11 13:43:53.729630 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -337> 2012-10-11 13:43:53.729652 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.a0) v3 -- ?+0 0x2ac7540 -336> 2012-10-11 13:43:53.729683 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.a0 0x3176cb0)/0x3176cb0 -335> 2012-10-11 13:43:53.729686 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -334> 2012-10-11 13:43:53.729687 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -333> 2012-10-11 13:43:53.729688 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4376 0x250eb40 -332> 2012-10-11 13:43:53.729691 7f4402228700 5 journal submit_entry seq 4376 len 682 (0x322ee10) -331> 2012-10-11 13:43:53.729693 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -330> 2012-10-11 13:43:53.729694 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -329> 2012-10-11 13:43:53.729721 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.a2) v3 -- ?+0 0x2ac7c40 -328> 2012-10-11 13:43:53.729738 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.a2 0x2468140)/0x2468140 -327> 2012-10-11 13:43:53.729741 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -326> 2012-10-11 13:43:53.729742 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -325> 2012-10-11 13:43:53.729743 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4377 0x2ac92d0 -324> 2012-10-11 13:43:53.729746 7f4402228700 5 journal submit_entry seq 4377 len 682 (0x292e360) -323> 2012-10-11 13:43:53.729748 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -322> 2012-10-11 13:43:53.729749 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -321> 2012-10-11 13:43:53.729765 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.a1) v3 -- ?+0 0x2a33000 -320> 2012-10-11 13:43:53.729782 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.a1 0x2e38170)/0x2e38170 -319> 2012-10-11 13:43:53.729785 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -318> 2012-10-11 13:43:53.729786 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -317> 2012-10-11 13:43:53.729787 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4378 0x2a32900 -316> 2012-10-11 13:43:53.729790 7f4402228700 5 journal submit_entry seq 4378 len 682 (0x292e330) -315> 2012-10-11 13:43:53.729791 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -314> 2012-10-11 13:43:53.729793 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -313> 2012-10-11 13:43:53.729802 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:2.99) v3 -- ?+0 0x2a33380 -312> 2012-10-11 13:43:53.729819 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.99 0x2130fd0)/0x2130fd0 -311> 2012-10-11 13:43:53.729821 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -310> 2012-10-11 13:43:53.729822 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -309> 2012-10-11 13:43:53.729823 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4379 0x2a327e0 -308> 2012-10-11 13:43:53.729826 7f4402228700 5 journal submit_entry seq 4379 len 682 (0x2e18a50) -307> 2012-10-11 13:43:53.729828 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -306> 2012-10-11 13:43:53.729829 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -305> 2012-10-11 13:43:53.729852 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.9a) v3 -- ?+0 0x2a33540 -304> 2012-10-11 13:43:53.729869 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.9a 0x2adbec0)/0x2adbec0 -303> 2012-10-11 13:43:53.729872 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -302> 2012-10-11 13:43:53.729873 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -301> 2012-10-11 13:43:53.729874 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4380 0x2a32120 -300> 2012-10-11 13:43:53.729877 7f4402228700 5 journal submit_entry seq 4380 len 682 (0x316d750) -299> 2012-10-11 13:43:53.729878 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -298> 2012-10-11 13:43:53.729880 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -297> 2012-10-11 13:43:53.729888 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.9b) v3 -- ?+0 0x2a33700 -296> 2012-10-11 13:43:53.729903 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.9b 0x2130f30)/0x2130f30 -295> 2012-10-11 13:43:53.729906 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -294> 2012-10-11 13:43:53.729907 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -293> 2012-10-11 13:43:53.729908 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4381 0x3039510 -292> 2012-10-11 13:43:53.729911 7f4402228700 5 journal submit_entry seq 4381 len 682 (0x32e8c30) -291> 2012-10-11 13:43:53.729912 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -290> 2012-10-11 13:43:53.729914 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -289> 2012-10-11 13:43:53.729929 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:1.98) v3 -- ?+0 0x2a338c0 -288> 2012-10-11 13:43:53.729945 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.98 0x2adbf20)/0x2adbf20 -287> 2012-10-11 13:43:53.729948 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247682 > 104857600 -286> 2012-10-11 13:43:53.731659 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -285> 2012-10-11 13:43:53.731666 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -284> 2012-10-11 13:43:53.731668 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4382 0x2e55750 -283> 2012-10-11 13:43:53.731673 7f4402228700 5 journal submit_entry seq 4382 len 682 (0x2e18810) -282> 2012-10-11 13:43:53.731675 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -281> 2012-10-11 13:43:53.731676 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -280> 2012-10-11 13:43:53.731699 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.1 149.165.228.10:6805/1098 -- pg_info(1 pgs e8:0.99) v3 -- ?+0 0x20a01c0 -279> 2012-10-11 13:43:53.731724 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.99 0x2130f90)/0x2130f90 -278> 2012-10-11 13:43:53.731727 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247395 > 104857600 -277> 2012-10-11 13:43:53.731764 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x23d5730 seq 3884 osr(0.9f 0x24681d0)/0x24681d0 start -276> 2012-10-11 13:43:53.732725 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -275> 2012-10-11 13:43:53.732731 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -274> 2012-10-11 13:43:53.732733 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4383 0x2e55900 -273> 2012-10-11 13:43:53.732737 7f4402228700 5 journal submit_entry seq 4383 len 682 (0x322e720) -272> 2012-10-11 13:43:53.732744 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -271> 2012-10-11 13:43:53.732745 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 682 -270> 2012-10-11 13:43:53.732820 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.50 epoch 8 query_epoch 8) v3 -- ?+0 0x2773000 -269> 2012-10-11 13:43:53.732856 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.50 0x2130000)/0x2130000 -268> 2012-10-11 13:43:53.732860 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247395 > 104857600 -267> 2012-10-11 13:43:53.732866 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x23d5690 seq 3885 osr(0.a8 0x2468020)/0x2468020 start -266> 2012-10-11 13:43:53.733691 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -265> 2012-10-11 13:43:53.733697 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -264> 2012-10-11 13:43:53.733698 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4384 0x2e551b0 -263> 2012-10-11 13:43:53.733703 7f4402228700 5 journal submit_entry seq 4384 len 969 (0x1e86330) -262> 2012-10-11 13:43:53.733705 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -261> 2012-10-11 13:43:53.733706 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -260> 2012-10-11 13:43:53.733740 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.51 epoch 8 query_epoch 8) v3 -- ?+0 0x2773500 -259> 2012-10-11 13:43:53.733772 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.51 0x21302a0)/0x21302a0 -258> 2012-10-11 13:43:53.733776 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247395 > 104857600 -257> 2012-10-11 13:43:53.733783 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x23d5b90 seq 3886 osr(0.b2 0x2468240)/0x2468240 start -256> 2012-10-11 13:43:53.735186 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -255> 2012-10-11 13:43:53.735194 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -254> 2012-10-11 13:43:53.735195 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4385 0x2e55e10 -253> 2012-10-11 13:43:53.735200 7f4402228700 5 journal submit_entry seq 4385 len 969 (0x2876d50) -252> 2012-10-11 13:43:53.735202 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -251> 2012-10-11 13:43:53.735203 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -250> 2012-10-11 13:43:53.735247 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.54 epoch 8 query_epoch 8) v3 -- ?+0 0x2773a00 -249> 2012-10-11 13:43:53.735278 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.54 0x2130210)/0x2130210 -248> 2012-10-11 13:43:53.735281 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247395 > 104857600 -247> 2012-10-11 13:43:53.735289 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1f3f550 seq 3887 osr(0.b5 0x24685b0)/0x24685b0 start -246> 2012-10-11 13:43:53.736094 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -245> 2012-10-11 13:43:53.736100 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -244> 2012-10-11 13:43:53.736101 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4386 0x3250cf0 -243> 2012-10-11 13:43:53.736106 7f4402228700 5 journal submit_entry seq 4386 len 969 (0x2e65060) -242> 2012-10-11 13:43:53.736108 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -241> 2012-10-11 13:43:53.736110 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -240> 2012-10-11 13:43:53.736144 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.55 epoch 8 query_epoch 8) v3 -- ?+0 0x2772000 -239> 2012-10-11 13:43:53.736180 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.55 0x21301e0)/0x21301e0 -238> 2012-10-11 13:43:53.736184 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247395 > 104857600 -237> 2012-10-11 13:43:53.736346 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -236> 2012-10-11 13:43:53.736351 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -235> 2012-10-11 13:43:53.736352 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4387 0x3250b40 -234> 2012-10-11 13:43:53.736357 7f4402228700 5 journal submit_entry seq 4387 len 969 (0x28632a0) -233> 2012-10-11 13:43:53.736359 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -232> 2012-10-11 13:43:53.736360 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -231> 2012-10-11 13:43:53.736393 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.8d epoch 8 query_epoch 8) v3 -- ?+0 0x2772500 -230> 2012-10-11 13:43:53.736426 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.8d 0x2130e90)/0x2130e90 -229> 2012-10-11 13:43:53.736430 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247438 > 104857600 -228> 2012-10-11 13:43:53.736504 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1e17050 seq 3889 osr(0.da 0x2468ac0)/0x2468ac0 start -227> 2012-10-11 13:43:53.737267 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1f3f230 seq 3888 osr(0.c1 0x2468770)/0x2468770 start -226> 2012-10-11 13:43:53.738191 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -225> 2012-10-11 13:43:53.738198 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -224> 2012-10-11 13:43:53.738199 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4388 0x3250750 -223> 2012-10-11 13:43:53.738204 7f4402228700 5 journal submit_entry seq 4388 len 969 (0x2863900) -222> 2012-10-11 13:43:53.738206 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -221> 2012-10-11 13:43:53.738207 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -220> 2012-10-11 13:43:53.738243 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.98 epoch 8 query_epoch 8) v3 -- ?+0 0x2772a00 -219> 2012-10-11 13:43:53.738277 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.98 0x2130fc0)/0x2130fc0 -218> 2012-10-11 13:43:53.738281 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247438 > 104857600 -217> 2012-10-11 13:43:53.738378 7f4408335700 5 filestore(/data/osd.0) _do_op 0x1e186e0 seq 3890 osr(0.db 0x2468a90)/0x2468a90 start -216> 2012-10-11 13:43:53.739272 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -215> 2012-10-11 13:43:53.739279 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -214> 2012-10-11 13:43:53.739280 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4389 0x24b6bd0 -213> 2012-10-11 13:43:53.739285 7f4402228700 5 journal submit_entry seq 4389 len 969 (0x22023c0) -212> 2012-10-11 13:43:53.739287 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -211> 2012-10-11 13:43:53.739289 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -210> 2012-10-11 13:43:53.739328 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.50 epoch 8 query_epoch 8) v3 -- ?+0 0x2f66000 -209> 2012-10-11 13:43:53.739362 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.50 0x2adb0a0)/0x2adb0a0 -208> 2012-10-11 13:43:53.739366 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247438 > 104857600 -207> 2012-10-11 13:43:53.739466 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -206> 2012-10-11 13:43:53.739472 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -205> 2012-10-11 13:43:53.739473 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4390 0x24b6b40 -204> 2012-10-11 13:43:53.739478 7f4402228700 5 journal submit_entry seq 4390 len 969 (0x1f50810) -203> 2012-10-11 13:43:53.739480 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -202> 2012-10-11 13:43:53.739485 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -201> 2012-10-11 13:43:53.739522 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.53 epoch 8 query_epoch 8) v3 -- ?+0 0x2f66500 -200> 2012-10-11 13:43:53.739555 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.53 0x2adb010)/0x2adb010 -199> 2012-10-11 13:43:53.739559 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247438 > 104857600 -198> 2012-10-11 13:43:53.739648 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e19820 seq 3892 osr(1.a7 0x2e38050)/0x2e38050 start -197> 2012-10-11 13:43:53.740593 7f4408335700 5 filestore(/data/osd.0) _do_op 0x28ef460 seq 3891 osr(1.9e 0x2adbe00)/0x2adbe00 start -196> 2012-10-11 13:43:53.741439 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -195> 2012-10-11 13:43:53.741446 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -194> 2012-10-11 13:43:53.741448 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4391 0x24b6480 -193> 2012-10-11 13:43:53.741453 7f4402228700 5 journal submit_entry seq 4391 len 969 (0x28764b0) -192> 2012-10-11 13:43:53.741454 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -191> 2012-10-11 13:43:53.741456 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -190> 2012-10-11 13:43:53.741491 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.54 epoch 8 query_epoch 8) v3 -- ?+0 0x2bbc500 -189> 2012-10-11 13:43:53.741524 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.54 0x2adb3e0)/0x2adb3e0 -188> 2012-10-11 13:43:53.741528 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247307 > 104857600 -187> 2012-10-11 13:43:53.741623 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e19320 seq 3893 osr(1.b1 0x2e38270)/0x2e38270 start -186> 2012-10-11 13:43:53.742449 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -185> 2012-10-11 13:43:53.742456 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -184> 2012-10-11 13:43:53.742458 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4392 0x20627e0 -183> 2012-10-11 13:43:53.742462 7f4402228700 5 journal submit_entry seq 4392 len 969 (0x320b690) -182> 2012-10-11 13:43:53.742464 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -181> 2012-10-11 13:43:53.742466 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -180> 2012-10-11 13:43:53.742501 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.55 epoch 8 query_epoch 8) v3 -- ?+0 0x2bbba00 -179> 2012-10-11 13:43:53.742536 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.55 0x2adb3b0)/0x2adb3b0 -178> 2012-10-11 13:43:53.742540 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247307 > 104857600 -177> 2012-10-11 13:43:53.744265 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -176> 2012-10-11 13:43:53.744272 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -175> 2012-10-11 13:43:53.744274 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4393 0x2f4d000 -174> 2012-10-11 13:43:53.744279 7f4402228700 5 journal submit_entry seq 4393 len 969 (0x20ad6f0) -173> 2012-10-11 13:43:53.744281 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -172> 2012-10-11 13:43:53.744283 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -171> 2012-10-11 13:43:53.744328 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.8c epoch 8 query_epoch 8) v3 -- ?+0 0x2c29000 -170> 2012-10-11 13:43:53.744365 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.8c 0x2adbd60)/0x2adbd60 -169> 2012-10-11 13:43:53.744369 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247307 > 104857600 -168> 2012-10-11 13:43:53.744468 7f4408335700 5 filestore(/data/osd.0) _do_op 0x21ff500 seq 3895 osr(1.c0 0x2e387a0)/0x2e387a0 start -167> 2012-10-11 13:43:53.745403 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x1e1a7d0 seq 3894 osr(1.b4 0x2e385e0)/0x2e385e0 start -166> 2012-10-11 13:43:53.746259 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -165> 2012-10-11 13:43:53.746269 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -164> 2012-10-11 13:43:53.746270 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4394 0x2f4d240 -163> 2012-10-11 13:43:53.746275 7f4402228700 5 journal submit_entry seq 4394 len 969 (0x2e132d0) -162> 2012-10-11 13:43:53.746277 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -161> 2012-10-11 13:43:53.746279 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -160> 2012-10-11 13:43:53.746322 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.97 epoch 8 query_epoch 8) v3 -- ?+0 0x2c29500 -159> 2012-10-11 13:43:53.746356 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.97 0x2adbf50)/0x2adbf50 -158> 2012-10-11 13:43:53.746360 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247307 > 104857600 -157> 2012-10-11 13:43:53.746408 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2bbe7d0 seq 3896 osr(2.37 0x31766a0)/0x31766a0 start -156> 2012-10-11 13:43:53.747319 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -155> 2012-10-11 13:43:53.747326 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -154> 2012-10-11 13:43:53.747327 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4395 0x2f4d3f0 -153> 2012-10-11 13:43:53.747332 7f4402228700 5 journal submit_entry seq 4395 len 969 (0x2202450) -152> 2012-10-11 13:43:53.747334 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -151> 2012-10-11 13:43:53.747335 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -150> 2012-10-11 13:43:53.747372 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(1.99 epoch 8 query_epoch 8) v3 -- ?+0 0x2c29a00 -149> 2012-10-11 13:43:53.747405 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(1.99 0x2adbef0)/0x2adbef0 -148> 2012-10-11 13:43:53.747409 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247350 > 104857600 -147> 2012-10-11 13:43:53.753977 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -146> 2012-10-11 13:43:53.753986 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -145> 2012-10-11 13:43:53.753987 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4396 0x2a32480 -144> 2012-10-11 13:43:53.753993 7f4402228700 5 journal submit_entry seq 4396 len 969 (0x2202180) -143> 2012-10-11 13:43:53.753995 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -142> 2012-10-11 13:43:53.753997 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -141> 2012-10-11 13:43:53.754046 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.52 epoch 8 query_epoch 8) v3 -- ?+0 0x2d47500 -140> 2012-10-11 13:43:53.754083 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.52 0x2130130)/0x2130130 -139> 2012-10-11 13:43:53.754088 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247350 > 104857600 -138> 2012-10-11 13:43:53.754150 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x26fe140 seq 3898 osr(1.d9 0x2e38af0)/0x2e38af0 start -137> 2012-10-11 13:43:53.755050 7f4408335700 5 filestore(/data/osd.0) _do_op 0x263b5a0 seq 3897 osr(0.d2 0x2468840)/0x2468840 start -136> 2012-10-11 13:43:53.755194 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -135> 2012-10-11 13:43:53.755200 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -134> 2012-10-11 13:43:53.755202 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4397 0x2a32750 -133> 2012-10-11 13:43:53.755207 7f4402228700 5 journal submit_entry seq 4397 len 969 (0x210be40) -132> 2012-10-11 13:43:53.755209 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -131> 2012-10-11 13:43:53.755210 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -130> 2012-10-11 13:43:53.755249 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.53 epoch 8 query_epoch 8) v3 -- ?+0 0x2a82000 -129> 2012-10-11 13:43:53.755283 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.53 0x2130110)/0x2130110 -128> 2012-10-11 13:43:53.755287 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247350 > 104857600 -127> 2012-10-11 13:43:53.755328 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x2bbe050 seq 3899 osr(2.3c 0x1d71c20)/0x1d71c20 start -126> 2012-10-11 13:43:53.756203 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -125> 2012-10-11 13:43:53.756210 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -124> 2012-10-11 13:43:53.756211 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4398 0x2a32f30 -123> 2012-10-11 13:43:53.756216 7f4402228700 5 journal submit_entry seq 4398 len 969 (0x2876390) -122> 2012-10-11 13:43:53.756218 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -121> 2012-10-11 13:43:53.756219 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -120> 2012-10-11 13:43:53.756265 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(2.96 epoch 8 query_epoch 8) v3 -- ?+0 0x2633500 -119> 2012-10-11 13:43:53.756300 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(2.96 0x3176210)/0x3176210 -118> 2012-10-11 13:43:53.756303 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247393 > 104857600 -117> 2012-10-11 13:43:53.756347 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x288ad20 seq 3900 osr(2.98 0x2130f20)/0x2130f20 start -116> 2012-10-11 13:43:53.757233 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -115> 2012-10-11 13:43:53.757240 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -114> 2012-10-11 13:43:53.757241 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4399 0x2a32a20 -113> 2012-10-11 13:43:53.757246 7f4402228700 5 journal submit_entry seq 4399 len 969 (0x22023f0) -112> 2012-10-11 13:43:53.757255 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -111> 2012-10-11 13:43:53.757257 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -110> 2012-10-11 13:43:53.757463 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.29 epoch 8 query_epoch 8) v3 -- ?+0 0x2633000 -109> 2012-10-11 13:43:53.757504 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.29 0x1d719d0)/0x1d719d0 -108> 2012-10-11 13:43:53.757509 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247393 > 104857600 -107> 2012-10-11 13:43:53.757607 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x21ff690 seq 3901 osr(2.40 0x1d71e70)/0x1d71e70 start -106> 2012-10-11 13:43:53.758426 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -105> 2012-10-11 13:43:53.758433 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -104> 2012-10-11 13:43:53.758434 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4400 0x2aa32d0 -103> 2012-10-11 13:43:53.758439 7f4402228700 5 journal submit_entry seq 4400 len 969 (0x314e5d0) -102> 2012-10-11 13:43:53.758441 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -101> 2012-10-11 13:43:53.758442 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -100> 2012-10-11 13:43:53.758478 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.31 epoch 8 query_epoch 8) v3 -- ?+0 0x2a2fa00 -99> 2012-10-11 13:43:53.758511 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.31 0x1d71c90)/0x1d71c90 -98> 2012-10-11 13:43:53.758515 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247436 > 104857600 -97> 2012-10-11 13:43:53.758555 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x263b410 seq 3902 osr(0.de 0x2468a00)/0x2468a00 start -96> 2012-10-11 13:43:53.802142 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2a17690 seq 3903 osr(2.9d 0x2130d50)/0x2130d50 start -95> 2012-10-11 13:43:53.802201 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.d2 0x2468840)/0x2468840 -94> 2012-10-11 13:43:53.802215 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -93> 2012-10-11 13:43:53.802217 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -92> 2012-10-11 13:43:53.802218 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4401 0x25f2b40 -91> 2012-10-11 13:43:53.802222 7f4401226700 5 journal submit_entry seq 4401 len 65 (0x2ec0300) -90> 2012-10-11 13:43:53.802224 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -89> 2012-10-11 13:43:53.802226 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -88> 2012-10-11 13:43:53.802243 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247297 > 104857600 -87> 2012-10-11 13:43:53.802977 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2a17190 seq 3904 osr(2.a6 0x2468130)/0x2468130 start -86> 2012-10-11 13:43:53.802982 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -85> 2012-10-11 13:43:53.802992 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -84> 2012-10-11 13:43:53.802994 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4402 0x2d17750 -83> 2012-10-11 13:43:53.803000 7f4402228700 5 journal submit_entry seq 4402 len 969 (0x296f750) -82> 2012-10-11 13:43:53.803002 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -81> 2012-10-11 13:43:53.803004 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -80> 2012-10-11 13:43:53.803067 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.36 epoch 8 query_epoch 8) v3 -- ?+0 0x244e500 -79> 2012-10-11 13:43:53.803110 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.36 0x1d71ba0)/0x1d71ba0 -78> 2012-10-11 13:43:53.803114 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247297 > 104857600 -77> 2012-10-11 13:43:53.803803 7f4408335700 5 filestore(/data/osd.0) _do_op 0x21ff320 seq 3905 osr(2.42 0x1d71f00)/0x1d71f00 start -76> 2012-10-11 13:43:53.803812 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -75> 2012-10-11 13:43:53.803819 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -74> 2012-10-11 13:43:53.803821 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4403 0x308f870 -73> 2012-10-11 13:43:53.803826 7f4402228700 5 journal submit_entry seq 4403 len 969 (0x2a691e0) -72> 2012-10-11 13:43:53.803828 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -71> 2012-10-11 13:43:53.803829 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -70> 2012-10-11 13:43:53.803864 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.37 epoch 8 query_epoch 8) v3 -- ?+0 0x244ea00 -69> 2012-10-11 13:43:53.803898 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.37 0x1d71dc0)/0x1d71dc0 -68> 2012-10-11 13:43:53.803902 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247297 > 104857600 -67> 2012-10-11 13:43:53.804679 7f4408335700 5 filestore(/data/osd.0) _do_op 0x2497280 seq 3906 osr(2.48 0x1d71e10)/0x1d71e10 start -66> 2012-10-11 13:43:53.805522 7f4408335700 5 filestore(/data/osd.0) _do_op 0x269e140 seq 3907 osr(0.df 0x2468dd0)/0x2468dd0 start -65> 2012-10-11 13:43:53.809970 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (72450 -> 72921) -64> 2012-10-11 13:43:53.810007 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (72921 -> 73392) -63> 2012-10-11 13:43:53.810022 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (73392 -> 73863) -62> 2012-10-11 13:43:53.810035 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (73863 -> 74334) -61> 2012-10-11 13:43:53.810048 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (74334 -> 74805) -60> 2012-10-11 13:43:53.810061 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (74805 -> 75276) -59> 2012-10-11 13:43:53.810074 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (75276 -> 75747) -58> 2012-10-11 13:43:53.810090 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (75747 -> 76218) -57> 2012-10-11 13:43:53.810650 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -56> 2012-10-11 13:43:53.810658 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -55> 2012-10-11 13:43:53.810660 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4404 0x308f5a0 -54> 2012-10-11 13:43:53.810667 7f4402228700 5 journal submit_entry seq 4404 len 969 (0x1ee51b0) -53> 2012-10-11 13:43:53.810670 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -52> 2012-10-11 13:43:53.810672 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -51> 2012-10-11 13:43:53.810716 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.3b epoch 8 query_epoch 8) v3 -- ?+0 0x3252000 -50> 2012-10-11 13:43:53.810755 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.3b 0x1d71d00)/0x1d71d00 -49> 2012-10-11 13:43:53.810761 7f4402228700 5 throttle(filestore_ops 0x1dc5328) wait -48> 2012-10-11 13:43:53.810763 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) wait -47> 2012-10-11 13:43:53.810764 7f4402228700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4405 0x308f750 -46> 2012-10-11 13:43:53.810767 7f4402228700 5 journal submit_entry seq 4405 len 969 (0x2a16750) -45> 2012-10-11 13:43:53.810769 7f4402228700 5 throttle(filestore_ops 0x1dc5328) take 1 -44> 2012-10-11 13:43:53.810770 7f4402228700 5 throttle(filestore_bytes 0x1dc53a8) take 969 -43> 2012-10-11 13:43:53.810797 7f4402228700 1 -- 149.165.228.10:6802/338 --> osd.2 149.165.228.10:6808/1657 -- pg_log(0.3d epoch 8 query_epoch 8) v3 -- ?+0 0x3252500 -42> 2012-10-11 13:43:53.810832 7f4402228700 5 filestore(/data/osd.0) queue_transactions existing osr(0.3d 0x1d71ca0)/0x1d71ca0 -41> 2012-10-11 13:43:53.810836 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247383 > 104857600 -40> 2012-10-11 13:43:53.816000 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x269efa0 seq 3908 osr(0.e0 0x2468da0)/0x2468da0 start -39> 2012-10-11 13:43:53.816621 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.de 0x2468a00)/0x2468a00 -38> 2012-10-11 13:43:53.816633 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -37> 2012-10-11 13:43:53.816635 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -36> 2012-10-11 13:43:53.816636 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4406 0x25f2ea0 -35> 2012-10-11 13:43:53.816640 7f4401226700 5 journal submit_entry seq 4406 len 65 (0x2ec0090) -34> 2012-10-11 13:43:53.816642 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -33> 2012-10-11 13:43:53.816644 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -32> 2012-10-11 13:43:53.816664 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247244 > 104857600 -31> 2012-10-11 13:43:53.823210 7f4408335700 5 filestore(/data/osd.0) _do_op 0x269ee10 seq 3909 osr(0.e4 0x2468ce0)/0x2468ce0 start -30> 2012-10-11 13:43:53.823233 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.df 0x2468dd0)/0x2468dd0 -29> 2012-10-11 13:43:53.823242 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -28> 2012-10-11 13:43:53.823243 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -27> 2012-10-11 13:43:53.823245 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4407 0x1f95b40 -26> 2012-10-11 13:43:53.823248 7f4401226700 5 journal submit_entry seq 4407 len 65 (0x2ec0060) -25> 2012-10-11 13:43:53.823250 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -24> 2012-10-11 13:43:53.823252 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -23> 2012-10-11 13:43:53.823267 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 247105 > 104857600 -22> 2012-10-11 13:43:53.873652 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (76218 -> 76689) -21> 2012-10-11 13:43:53.873694 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (76689 -> 77160) -20> 2012-10-11 13:43:53.873709 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (77160 -> 77631) -19> 2012-10-11 13:43:53.873722 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (77631 -> 78102) -18> 2012-10-11 13:43:53.873737 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (78102 -> 78573) -17> 2012-10-11 13:43:53.873753 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (78573 -> 79044) -16> 2012-10-11 13:43:53.873766 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (79044 -> 79515) -15> 2012-10-11 13:43:53.873779 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (79515 -> 79986) -14> 2012-10-11 13:43:53.873792 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (79986 -> 80457) -13> 2012-10-11 13:43:53.873805 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (80457 -> 80928) -12> 2012-10-11 13:43:53.886599 7f4408b36700 5 filestore(/data/osd.0) _do_op 0x26fe7d0 seq 3910 osr(0.e6 0x2468c80)/0x2468c80 start -11> 2012-10-11 13:43:53.886649 7f4401226700 5 filestore(/data/osd.0) queue_transactions existing osr(0.e0 0x2468da0)/0x2468da0 -10> 2012-10-11 13:43:53.886660 7f4401226700 5 throttle(filestore_ops 0x1dc5328) wait -9> 2012-10-11 13:43:53.886662 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) wait -8> 2012-10-11 13:43:53.886663 7f4401226700 5 filestore(/data/osd.0) queue_transactions (writeahead) 4408 0x1d86c60 -7> 2012-10-11 13:43:53.886667 7f4401226700 5 journal submit_entry seq 4408 len 65 (0x2ec0030) -6> 2012-10-11 13:43:53.886669 7f4401226700 5 throttle(filestore_ops 0x1dc5328) take 1 -5> 2012-10-11 13:43:53.886672 7f4401226700 5 throttle(filestore_bytes 0x1dc53a8) take 65 -4> 2012-10-11 13:43:53.886688 7f4402228700 2 filestore(/data/osd.0) op_queue_reserve_throttle waiting: 501 > 500 ops || 246966 > 104857600 -3> 2012-10-11 13:43:53.912962 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (80928 -> 81399) -2> 2012-10-11 13:43:53.913005 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (81399 -> 81870) -1> 2012-10-11 13:43:53.913021 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (81870 -> 82341) 0> 2012-10-11 13:43:53.913035 7f43ff41d700 5 throttle(msgr_dispatch_throttler-cluster 0x1d9b088) get 471 (82341 -> 82812) --- logging levels --- 0/ 5 none 0/ 5 lockdep 0/ 5 context 1/ 5 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 0 buffer 0/ 5 timer 0/ 5 filer 0/ 0 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 0/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 5 filestore 1/ 5 journal 0/ 5 ms 1/ 5 mon 0/ 5 monc 0/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 hadoop 1/ 5 asok 1/ 5 throttle 99/99 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000000 log_file /var/log/ceph/osd.0.log --- end dump of recent events ---