Bradlee Speice
d8f32d8128
Test that we can create 10000 Mongo targets simultaneously
2016-09-03 09:40:12 -04:00
Bradlee Speice
1ebebd6404
And include XLRD in the dependencies. Oops.
2016-09-01 14:52:55 -04:00
Bradlee Speice
086e893054
Add State Street holdings to the EquitiesFlow
...
I mean, I know it's all ETF's, but they have a lot of equities!
2016-09-01 14:44:06 -04:00
Bradlee Speice
d48649c565
Add initial State Street holdings functionality
2016-09-01 14:22:58 -04:00
Bradlee Speice
52049b7d0f
Fix a bad test-case (again)
2016-08-30 09:26:16 -04:00
Bradlee Speice
4bc3f53081
Fix a bad test-case
2016-08-30 08:53:23 -04:00
Bradlee Speice
84d8103c29
Add tainted mode so I can try and restore the data that I destroyed while unit-testing.
2016-08-30 08:36:02 -04:00
Bradlee Speice
529375e10b
Guard against improper drops
...
I have destroyed a good bit of data so far because unit tests (correctly) dropped databases when they were done, but the config told it to drop the live database (incorrectly)
2016-08-30 08:32:23 -04:00
Bradlee Speice
2232283ec5
Fix an issue with Py2-3 compatibility in the test
...
The actual code is still running fine.
2016-08-29 23:17:54 -04:00
Bradlee Speice
905fb6092c
Initial tests for merging script
2016-08-29 23:05:35 -04:00
Bradlee Speice
e88547c47d
Initial fixes, bump the version
2016-08-29 19:02:08 -04:00
Bradlee Speice
7d56d68728
Add a merge command to do a simple left-right merge
...
I'm running this off a RPi at the moment, this is needed to get around the 2GB limit on a 32-bit MongoDB
2016-08-29 19:02:08 -04:00
bspeice
1eb3a120b2
No longer using pyquery
2016-08-27 20:08:29 -04:00
Bradlee Speice
76193599d0
Be more stingy with connections
...
I think the act of spinning up ~4000 MongoTargets for the Equities caused things to blow up; this way connections will only by created/used when operations are being performed. This is theoretically less efficient, but from what I've read in the documentation Mongo should have some pooling tricks to not sacrifice performance.
2016-08-25 23:17:35 -04:00
Bradlee Speice
4536278383
Widen the search for bad quotes
2016-08-25 17:56:03 -04:00
Bradlee Speice
1375669888
Make the test a bit more lenient
...
If it's not 'fast' enough that's OK, we're mostly trying to make sure we don't go too fast
2016-08-25 17:49:25 -04:00
Bradlee Speice
003a0024a0
Handle empty quotes in Tradeking
2016-08-25 17:47:36 -04:00
Bradlee Speice
117f4d60b2
Make sure records are actually saveable
...
MongoDB doesn't like the pure `date` type.
2016-08-25 17:08:37 -04:00
Bradlee Speice
0733725728
Update version code because I forgot.
2016-08-25 09:09:47 -04:00
Bradlee Speice
ef10dfac58
Add tradeking into the Equities flow
2016-08-25 09:02:38 -04:00
Bradlee Speice
9fdacd65aa
And update the config for the new package_data
2016-08-25 07:45:09 -04:00
Bradlee Speice
a1e71e3ecd
Add the default config to the distributed files
2016-08-25 07:44:51 -04:00
Bradlee Speice
d3c9e10031
Remove cron string test
2016-08-25 07:41:11 -04:00
Bradlee Speice
8fb5fa9c32
Another update to the cron scripts
2016-08-24 22:47:11 -04:00
Bradlee Speice
1ba75cab31
Fix map between Py2/3
2016-08-24 17:52:52 -04:00
Bradlee Speice
6e50cd5540
Fix install path for the encrypted settings
2016-08-24 17:48:08 -04:00
Bradlee Speice
0d249af584
Add Tradeking functionality
...
Yet to be integrated with the Equities flow, hold your horses.
2016-08-24 17:43:11 -04:00
Bradlee Speice
65de3a782a
Fix one last import
2016-08-24 16:09:54 -04:00
Bradlee Speice
af847c16c3
Make sure the MongoTarget is using config correctly
2016-08-24 16:05:00 -04:00
Bradlee Speice
82590f9d3a
Use the ConfigParser I'm supposed to...
2016-08-24 15:56:32 -04:00
Bradlee Speice
ce71c4bc94
Switch the configuration system
...
I like this one much better.
2016-08-24 15:52:07 -04:00
Bradlee Speice
7e81f78a6d
Make sure there's a newline for the cron jobs
2016-08-24 07:09:43 -04:00
Bradlee Speice
0eb0966729
And make sure that we return a schedule
...
Rather than just create it.
2016-08-23 22:47:13 -04:00
Bradlee Speice
53407dad5c
Add Equities into the flows
...
Woops, should've done this earlier.
2016-08-23 22:39:32 -04:00
Bradlee Speice
12bb7427e4
Fix a test using the wrong collection
2016-08-23 22:34:27 -04:00
Bradlee Speice
4d36403c59
Add initial rate-limit functionality
...
Likely needs more tests, but that's all I'm getting done tonight.
2016-08-23 22:23:35 -04:00
Bradlee Speice
d1d58a1bd7
Add NASDAQ processing
2016-08-23 19:13:06 -04:00
Bradlee Speice
49953e9da4
Switch live to a BoolParameter
...
Instead of constructor argument
2016-08-23 19:01:09 -04:00
Bradlee Speice
495a491096
Reduce the NASDAQ test threshold
...
Not sure why it dropped, but is corroborated by the NASDAQ site
2016-08-23 16:56:46 -04:00
Bradlee Speice
ba479389bd
Fix printing one more time
2016-08-23 16:47:05 -04:00
Bradlee Speice
fd20fa574f
Update the version so the upgrades take
2016-08-23 16:43:49 -04:00
Bradlee Speice
8af4330f45
Also make sure listing flows works correctly
2016-08-23 16:38:54 -04:00
Bradlee Speice
f2390ba34f
Get command-line tools up and running
...
I now have something that actually gets stuff done.
2016-08-22 21:34:54 -04:00
Bradlee Speice
96c503a106
str -> bytes fixes
2016-08-19 22:09:18 -04:00
Bradlee Speice
88c4401960
Add NASDAQ Company and ETF lists
2016-08-19 22:02:19 -04:00
Bradlee Speice
c42f5a6980
Remove Histdata; too many nonces, not worth it
2016-08-16 21:44:03 -04:00
Bradlee Speice
5cf75ebc47
Histdata won't work out, I just want a record that I did something.
2016-08-16 21:40:27 -04:00
Bradlee Speice
3753670a56
Switch default timezone when dateutil can't parse
2016-08-16 17:39:13 -04:00
Bradlee Speice
a049c7da62
Turns out Travis needs the TZ set
2016-08-16 17:38:30 -04:00
Bradlee Speice
cfa33db624
Remove Bloomberg
...
Planning to get data from other locations
2016-08-16 17:34:53 -04:00
