sartography/cr-connect-workflow
1
0
Fork 0
mirror of https://github.com/sartography/cr-connect-workflow.git synced 2025-02-20 11:48:16 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,110 Commits 14 Branches 0 Tags 9 MiB
Commit Graph

1203 Commits

Author SHA1 Message Date
Dan
187221537b fixing a corner case around file_data attributes. 2021-06-25 16:18:28 -04:00
Dan
628a587d97 We weren't committing to the database in the correct spot, so the delete wasn't sticking, and we were ending up with test workflows showing up in the main interface. 2021-06-23 16:39:58 -04:00
Dan Funk
48bf721b23
Merge pull request #331 from sartography/bug/356_duplicate_workflow 
Bug/356 duplicate workflow
 2021-06-22 17:42:24 -04:00
Dan
92ca506c8e Calls to eval no longer return the data, rather it will accept and return a key, allowing the front end to cache similar queries and not re-execute them. 2021-06-22 17:23:18 -04:00
Dan
61ad371680 Clean up the file api so we don't have a bunch of extra stuff in there. Just include the raw data from the document spraedsheet if it is available. 2021-06-22 15:08:08 -04:00
Dan
1f3febe2df Fix the panda warnings, which means we only support xlsx files now. 
Include the document details when reutnring a file from the file model.
Improve the validation of file form elements.
 2021-06-22 14:58:52 -04:00
NWalker4483
369b518384 Removed WorkflowService.delete_test_data() 2021-06-22 11:29:00 -04:00
Dan
07eb3f9ca8 Moving metrics into SpiffWorkflow so we can run the performance metrics deeply across both systems simultaniously. 
Upgrading libraries.
Fixing deprication issue with Pandas and numpy.
We can only process xlsx files now, plain oldschool xls is fully removed.
 2021-06-18 16:41:55 -04:00
NWalker4483
4ca94b39ce Merge branch 'dev' of https://github.com/sartography/cr-connect-workflow into partial_testing 2021-06-17 15:12:28 -04:00
Dan Funk
19d63e2aa2
Merge pull request #328 from sartography/restart-workflow-programmatically-347 
Restart workflow programmatically #347
 2021-06-17 10:36:46 -04:00
Dan
a4caae8d64 when validating, we need to take every step to remove the workflows we create during the validation. 2021-06-16 14:40:20 -04:00
Dan
acae6030f5 The API for evaluating python expressions should not raise an error, it can simply return a result of false, and provide an error to explain the problem. In this way the front end doesn't error out when it's running the script tasks but doesn't have enough information to get a valid response back. 
The validation should take into account that repeating sections must be evaluated in the context of the data within the repeating section, not outside of it.
 2021-06-15 16:17:15 -04:00
mike cullerton
02949dc6e2 WorkflowProcessor handles this error 2021-06-15 11:12:50 -04:00
NWalker4483
5c5b966bc4 Merge branch 'dev' of https://github.com/sartography/cr-connect-workflow into partial_testing 2021-06-15 09:11:18 -04:00
mike cullerton
c8f8888c17 Script to reset workflow. Requires workflow spec name. 2021-06-14 14:51:16 -04:00
Dan
738a984dcd Merge branch 'dev' of github.com:sartography/cr-connect-workflow into dev 2021-06-11 17:21:47 -04:00
Dan
879d6e1df3 missed a critical change on the backend with the recent file updates, this assures that we properly handle repeating sections during the post process, 
and we update the file doc code in those repeating sections.
 2021-06-11 17:20:25 -04:00
Dan
7282419174 modified the tools api to return the expression and data with the result, making it easier to cash results on the front end, This should help drastically reduce the calls to the python_eval from the front end. 
The post processors for form submissions needs to take repeating sections into account, or it won't find the files it is looking for.
 2021-06-11 08:27:50 -04:00
Kelly McDonald
394906d840 Add refresh_waiting_tasks to the processor do_engine_steps so that if we have a waiting task that has met its condition prior to the scheduler running, it will go ahead and proceed 2021-06-10 08:33:24 -04:00
NWalker4483
e1a4a79b03 Added Partial Workflow spec 2021-06-09 15:21:21 -04:00
NWalker4483
2364c240b2 Error Text Changed 2021-06-09 14:54:43 -04:00
NWalker4483
338fe30984 Merge branch 'dev' of https://github.com/sartography/cr-connect-workflow into partial_testing 2021-06-09 14:32:01 -04:00
NWalker4483
17077be701 exit at task 2021-06-09 12:40:38 -04:00
Kelly McDonald
5f722d675f Add a function that gets runs via a background scheduler to look for any workflows that are in a 'waiting' state - it runs the update waiting tasks and does do_engine_steps 
We have a test for the function that runs, but an assumption was made that the scheduler module has its own unit tests and we do not need to test that.

fixes #346
 2021-06-09 10:42:34 -04:00
Dan
fce9166c4a Do not require users to be admins for viewing the document directory tab. 2021-06-09 09:51:30 -04:00
Kelly McDonald
0d8d251e8e Temp save to test dev 2021-06-09 09:24:37 -04:00
Dan
286803d10b fixing a big stupid bug I created when merging all the code and making changes to the files. 2021-06-08 14:24:59 -04:00
Dan Funk
586a0f2f1a
Merge pull request #325 from sartography/feature/file_refactor 
Prefer tasks that share a parent over just the the next available tas…
 2021-06-08 11:28:23 -04:00
Dan
8d79fe9d94 Fixing failing tests, and now asserting that we only perform the post_process_form if we actually have a form. 2021-06-08 11:16:10 -04:00
Dan Funk
9c4994581d
Merge pull request #324 from sartography/modify-infinite-loop-312 
Modify infinite loop #312
 2021-06-08 10:30:13 -04:00
Dan Funk
e10b210302
Merge pull request #323 from sartography/shield-test-issue-344 
Shield test issue #344
 2021-06-08 08:59:58 -04:00
Dan Funk
a7b208f50a
Merge pull request #322 from sartography/data-store-refactor-330 
Data store refactor #330
 2021-06-08 08:58:53 -04:00
Dan Funk
6937c33719
Merge pull request #319 from sartography/datastore-file-endpoints-325 
Datastore file endpoints #325
 2021-06-08 08:54:43 -04:00
Dan Funk
37d4e7cc79
Merge pull request #318 from sartography/340-update_study_associate_change 
Add test and fix to make sure that an empty study associates list (or…
 2021-06-08 08:52:44 -04:00
Dan Funk
c4a6fbb516
Merge pull request #317 from sartography/337-Data-Store-IRB-Code 
337 partial fix
 2021-06-08 08:51:09 -04:00
Dan Funk
5881c903ca
Merge pull request #316 from sartography/326-Multi_File_Data_Store 
Make sure we are using the correct script engine
 2021-06-08 08:49:43 -04:00
Dan Funk
710921cfe1
Merge pull request #314 from sartography/deprecate-study-info-protocol-261 
Remove protocol from study_info script #261
 2021-06-08 08:47:43 -04:00
Dan
59f605c3df Prefer tasks that share a parent over just the the next available task when returning the next_task in the workflow processor. 2021-06-08 08:03:14 -04:00
mike cullerton
a3a485dd34 Changed do_task_validate_only so it returns a mocked value, instead of True/False. 
True/False caused problems for workflow validations
 2021-06-04 11:44:55 -04:00
mike cullerton
9a63ab9c4f Change do_task_validate_only in study_info script to call the real do_task. 
We do this so we can seed settings into the workflow for testing different scenarios using the study from validate_study_id
 2021-06-03 14:28:24 -04:00
mike cullerton
c41657301a Modify test_spec and make_test_workflow to accept new optional validate_study_id parameter. 
Modify `make_test_workflow` to use study_id when creating test workflow for validation.
 2021-06-03 14:22:26 -04:00
mike cullerton
0dfc96d7f6 Modified validate_workflow_specification to accept new optional validate_study_id parameter. 
We then pass validate_study_id on to WorkflowService.test_spec
 2021-06-03 14:19:41 -04:00
mike cullerton
d657744816 Added optional validate_study_id parameter to the validation api endpoint. 2021-06-03 14:17:12 -04:00
mike cullerton
7f0d8a131d Import DataStoreBase from service now 2021-06-02 10:00:55 -04:00
mike cullerton
506b84a49a Import DataStoreBase from service now 2021-06-02 10:00:18 -04:00
mike cullerton
e2e35b673d Moved data store code from script to service 2021-06-02 09:59:41 -04:00
mike cullerton
162dee45d3 Unused import 2021-06-01 16:34:21 -04:00
mike cullerton
2e3d8c7343 Fix for DataStoreSchema missing the file_id column. 
The file_id column is a foreign key.
 2021-06-01 13:51:10 -04:00
mike cullerton
1ed144536f New method for file datastore api endpoint 2021-06-01 13:50:04 -04:00
mike cullerton
e9fe555e05 New /datastore/file/{file_id} endpoint definition 2021-06-01 13:49:21 -04:00