summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Increase timeouts waiting for merge.Linus Nordberg2016-12-011-3/+3
| | | | | | | Increase from 15 to 40 seconds. In theory, it should never be more than 20 seconds plus actual time to do the job with a merge interval of 10 seconds. Max wait times are 3+1 seconds in fetch, 3s in backup, 10s in sth and 3s in dist.
* Increase merge timeouts.Linus Nordberg2016-11-301-3/+3
|
* Parallelise merge_dist.Linus Nordberg2016-11-303-60/+97
| | | | Also deduplicate some code.
* Clean up a bit.Linus Nordberg2016-11-281-17/+3
|
* If any backup process failed, try again.Linus Nordberg2016-11-281-3/+7
| | | | | | Try again without waiting for an update of the fetched file, which won't happen in the tests (but probably will happen in real life, masking this bug).
* Do remove process from procs dict when they fail too.Linus Nordberg2016-11-281-4/+4
|
* Don't pass 0 to multiprocessing.Pipe.poll().Linus Nordberg2016-11-281-2/+2
| | | | Documentation says to pass nothing for no blocking.
* Dedup log initialisation code.Linus Nordberg2016-11-285-27/+16
|
* Parallelise merge_backup.Linus Nordberg2016-11-271-45/+94
| | | | | We're still failing the tests when the merge secondary goes away, sometimes.
* Fix a crash bug; improve IPC; use cycle().Linus Nordberg2016-11-271-40/+40
| | | | | | | | | Workers: - Consume all messages each round, just as control process does. Control process: - Use itertools.cycle for the circular list. - Fix bug where an entry could be fetched multiple times, crashing when updating fetch_dict.
* Improve two comments.Linus Nordberg2016-11-261-2/+6
|
* Add back chunking for get_entries in parallelised merge_fetch.Linus Nordberg2016-11-261-10/+9
| | | | | Even if it's not important for parallelism on the merge node, it's not a bad idea to keep the requests from growing.
* Remove old assertion used for testing.Linus Nordberg2016-11-261-2/+0
|
* Log simple web request logging on level infoMagnus Ahltorp2016-11-261-2/+6
| | | | This change was lost in 616be2a.
* Added back support for R16Magnus Ahltorp2016-11-261-0/+10
| | | | This change was lost in 616be2a.
* Don't need this bc don't do locking anymore.Linus Nordberg2016-11-261-1/+0
| | | | Also, it collides with permdb.
* Bug fixes from map.Linus Nordberg2016-11-261-5/+4
|
* merge_fetch: Write to chainsdb in controlling process.Linus Nordberg2016-11-252-104/+74
| | | | | | | Multiple writers won't work when using permdb. Also, improve throughput by polling worker processes with timeout 0 and read all messages at once.
* Sleep less in tests.Linus Nordberg2016-11-253-28/+39
|
* Do import datetime even more.Linus Nordberg2016-11-253-5/+8
|
* Manual rebase onto master with map/robust-distribution.Linus Nordberg2016-11-2519-210/+718
|
* Do import datetime.Linus Nordberg2016-11-251-1/+2
| | | | How did this ever work?
* Add a bit of documentation.Linus Nordberg2016-11-255-7/+19
|
* Merge remote-tracking branch 'refs/remotes/map/robust-distribution'Linus Nordberg2016-11-2513-199/+379
|\
| * Add session capability to unauth web requestsMagnus Ahltorp2016-11-221-6/+9
| |
| * Change hard coded paths to use variablesMagnus Ahltorp2016-11-221-8/+8
| |
| * Log simple web request logging on level infoMagnus Ahltorp2016-11-221-2/+6
| |
| * Added back support for R16Magnus Ahltorp2016-11-221-0/+10
| |
| * parsebench: change from table to div:sMagnus Ahltorp2016-11-221-4/+4
| |
| * Only allocate one color per stageMagnus Ahltorp2016-11-191-13/+36
| |
| * Use sessions in merge_fetchMagnus Ahltorp2016-11-182-16/+18
| |
| * Change algorithm for merge backup and merge distMagnus Ahltorp2016-11-024-149/+185
| |
| * Added performance testsMagnus Ahltorp2016-11-024-8/+90
| |
| * Send list of entries to frontendMagnus Ahltorp2016-11-023-30/+50
| | | | | | | | Handle connection error
* | Move version numbers to head of file.Linus Nordberg2016-11-171-3/+7
|/ | | | Easier to spot here.
* Remove unused code from test Makefile.Magnus Ahltorp2016-10-182-30/+1
| | | | Fix parsing bug in compileconfig.
* Test failing merge backupMagnus Ahltorp2016-10-1411-46/+94
| | | | Refactor tests
* Make tests run independently from cwdMagnus Ahltorp2016-10-1315-147/+180
|
* Specify where to source test.shvars from ('./').Linus Nordberg2016-10-0610-10/+10
| | | | For people without '.' in PATH.
* Move test preparation to separate shell scriptMagnus Ahltorp2016-10-052-47/+89
|
* Move tests to shell scriptsMagnus Ahltorp2016-10-0511-162/+264
|
* Move tests to test/MakefileMagnus Ahltorp2016-10-055-224/+225
| | | | Tests only touch the catlfish/tests directory.
* Remove formatupgrade testsMagnus Ahltorp2016-10-051-57/+0
|
* Don't use erlang:timestamp/0 on R17.Linus Nordberg2016-09-151-1/+1
|
* Allow permdb on non-merge nodes.Magnus Ahltorp2016-08-191-3/+9
| | | | Disallow permdb for multi-node configs.
* Support R18 wrt detoxing precerts.CATLFISH-80Linus Nordberg2016-08-192-4/+11
| | | | Fixes CATLFISH-80.
* Use erlang:timestamp/0 instead of deprecated now/0.Linus Nordberg2016-08-181-1/+1
|
* Rename module compat -> catlfish_compat.Linus Nordberg2016-08-182-3/+3
| | | | Can't have two modules with the same name in a release.
* It's a string, not an integer.Linus Nordberg2016-08-181-6/+4
|
* Add compatibility layer for digging around in non-public data structures.Linus Nordberg2016-08-182-5/+31
|
generated by cgit v1.1 at 2024-12-27 05:32:47 +0000