Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Don't pass 0 to multiprocessing.Pipe.poll(). | Linus Nordberg | 2016-11-28 | 1 | -2/+2 |
| | | | | Documentation says to pass nothing for no blocking. | ||||
* | Dedup log initialisation code. | Linus Nordberg | 2016-11-28 | 1 | -7/+2 |
| | |||||
* | Fix a crash bug; improve IPC; use cycle(). | Linus Nordberg | 2016-11-27 | 1 | -40/+40 |
| | | | | | | | | | Workers: - Consume all messages each round, just as control process does. Control process: - Use itertools.cycle for the circular list. - Fix bug where an entry could be fetched multiple times, crashing when updating fetch_dict. | ||||
* | Improve two comments. | Linus Nordberg | 2016-11-26 | 1 | -2/+6 |
| | |||||
* | Add back chunking for get_entries in parallelised merge_fetch. | Linus Nordberg | 2016-11-26 | 1 | -10/+9 |
| | | | | | Even if it's not important for parallelism on the merge node, it's not a bad idea to keep the requests from growing. | ||||
* | Remove old assertion used for testing. | Linus Nordberg | 2016-11-26 | 1 | -2/+0 |
| | |||||
* | Bug fixes from map. | Linus Nordberg | 2016-11-26 | 1 | -5/+4 |
| | |||||
* | merge_fetch: Write to chainsdb in controlling process. | Linus Nordberg | 2016-11-25 | 1 | -73/+74 |
| | | | | | | | Multiple writers won't work when using permdb. Also, improve throughput by polling worker processes with timeout 0 and read all messages at once. | ||||
* | Manual rebase onto master with map/robust-distribution. | Linus Nordberg | 2016-11-25 | 1 | -28/+219 |
| | |||||
* | Add a bit of documentation. | Linus Nordberg | 2016-11-25 | 1 | -1/+4 |
| | |||||
* | Use sessions in merge_fetch | Magnus Ahltorp | 2016-11-18 | 1 | -14/+16 |
| | |||||
* | Added permdb support to merge | Magnus Ahltorp | 2016-07-11 | 1 | -4/+5 |
| | |||||
* | Remove debug printouts from merge programs. | Linus Nordberg | 2015-11-20 | 1 | -1/+1 |
| | |||||
* | Fix _args -> args since we now use it. | Linus Nordberg | 2015-11-10 | 1 | -1/+1 |
| | |||||
* | Print the string "timing" and the name of the program in merge timing info. | Linus Nordberg | 2015-11-10 | 1 | -1/+1 |
| | |||||
* | Print timing information in merge_fetch too. | Linus Nordberg | 2015-11-10 | 1 | -0/+4 |
| | |||||
* | Merge is now run by shell script tools/merge. | Linus Nordberg | 2015-11-10 | 1 | -12/+36 |
| | | | | | | | tools/merge run merge_fetch.py, merge_backup.py, merge_sth.py and merge_dist.py sequentially. TODO: test backupquorum != 0 | ||||
* | Split merge.py into three pieces. | Linus Nordberg | 2015-11-10 | 1 | -0/+97 |