9a32fadc2f
Merge branch 'dev' into 346-waiting-task-schedule
...
# Conflicts:
# Pipfile.lock
# crc/services/workflow_service.py
2021-06-30 10:14:37 -04:00
a79ba22410
fixes to get the tests passing. We were missing a dependency in the Pipfile and the data_store had some invalid imports.
2021-06-30 10:06:57 -04:00
187221537b
fixing a corner case around file_data attributes.
2021-06-25 16:18:28 -04:00
628a587d97
We weren't committing to the database in the correct spot, so the delete wasn't sticking, and we were ending up with test workflows showing up in the main interface.
2021-06-23 16:39:58 -04:00
48bf721b23
Merge pull request #331 from sartography/bug/356_duplicate_workflow
...
Bug/356 duplicate workflow
2021-06-22 17:42:24 -04:00
92ca506c8e
Calls to eval no longer return the data, rather it will accept and return a key, allowing the front end to cache similar queries and not re-execute them.
2021-06-22 17:23:18 -04:00
61ad371680
Clean up the file api so we don't have a bunch of extra stuff in there. Just include the raw data from the document spraedsheet if it is available.
2021-06-22 15:08:08 -04:00
1f3febe2df
Fix the panda warnings, which means we only support xlsx files now.
...
Include the document details when reutnring a file from the file model.
Improve the validation of file form elements.
2021-06-22 14:58:52 -04:00
07eb3f9ca8
Moving metrics into SpiffWorkflow so we can run the performance metrics deeply across both systems simultaniously.
...
Upgrading libraries.
Fixing deprication issue with Pandas and numpy.
We can only process xlsx files now, plain oldschool xls is fully removed.
2021-06-18 16:41:55 -04:00
19d63e2aa2
Merge pull request #328 from sartography/restart-workflow-programmatically-347
...
Restart workflow programmatically #347
2021-06-17 10:36:46 -04:00
a4caae8d64
when validating, we need to take every step to remove the workflows we create during the validation.
2021-06-16 14:40:20 -04:00
acae6030f5
The API for evaluating python expressions should not raise an error, it can simply return a result of false, and provide an error to explain the problem. In this way the front end doesn't error out when it's running the script tasks but doesn't have enough information to get a valid response back.
...
The validation should take into account that repeating sections must be evaluated in the context of the data within the repeating section, not outside of it.
2021-06-15 16:17:15 -04:00
02949dc6e2
WorkflowProcessor handles this error
2021-06-15 11:12:50 -04:00
c8f8888c17
Script to reset workflow. Requires workflow spec name.
2021-06-14 14:51:16 -04:00
738a984dcd
Merge branch 'dev' of github.com:sartography/cr-connect-workflow into dev
2021-06-11 17:21:47 -04:00
879d6e1df3
missed a critical change on the backend with the recent file updates, this assures that we properly handle repeating sections during the post process,
...
and we update the file doc code in those repeating sections.
2021-06-11 17:20:25 -04:00
7282419174
modified the tools api to return the expression and data with the result, making it easier to cash results on the front end, This should help drastically reduce the calls to the python_eval from the front end.
...
The post processors for form submissions needs to take repeating sections into account, or it won't find the files it is looking for.
2021-06-11 08:27:50 -04:00
394906d840
Add refresh_waiting_tasks to the processor do_engine_steps so that if we have a waiting task that has met its condition prior to the scheduler running, it will go ahead and proceed
2021-06-10 08:33:24 -04:00
5f722d675f
Add a function that gets runs via a background scheduler to look for any workflows that are in a 'waiting' state - it runs the update waiting tasks and does do_engine_steps
...
We have a test for the function that runs, but an assumption was made that the scheduler module has its own unit tests and we do not need to test that.
fixes #346
2021-06-09 10:42:34 -04:00
fce9166c4a
Do not require users to be admins for viewing the document directory tab.
2021-06-09 09:51:30 -04:00
0d8d251e8e
Temp save to test dev
2021-06-09 09:24:37 -04:00
286803d10b
fixing a big stupid bug I created when merging all the code and making changes to the files.
2021-06-08 14:24:59 -04:00
586a0f2f1a
Merge pull request #325 from sartography/feature/file_refactor
...
Prefer tasks that share a parent over just the the next available tas…
2021-06-08 11:28:23 -04:00
8d79fe9d94
Fixing failing tests, and now asserting that we only perform the post_process_form if we actually have a form.
2021-06-08 11:16:10 -04:00
9c4994581d
Merge pull request #324 from sartography/modify-infinite-loop-312
...
Modify infinite loop #312
2021-06-08 10:30:13 -04:00
e10b210302
Merge pull request #323 from sartography/shield-test-issue-344
...
Shield test issue #344
2021-06-08 08:59:58 -04:00
a7b208f50a
Merge pull request #322 from sartography/data-store-refactor-330
...
Data store refactor #330
2021-06-08 08:58:53 -04:00
6937c33719
Merge pull request #319 from sartography/datastore-file-endpoints-325
...
Datastore file endpoints #325
2021-06-08 08:54:43 -04:00
37d4e7cc79
Merge pull request #318 from sartography/340-update_study_associate_change
...
Add test and fix to make sure that an empty study associates list (or…
2021-06-08 08:52:44 -04:00
c4a6fbb516
Merge pull request #317 from sartography/337-Data-Store-IRB-Code
...
337 partial fix
2021-06-08 08:51:09 -04:00
5881c903ca
Merge pull request #316 from sartography/326-Multi_File_Data_Store
...
Make sure we are using the correct script engine
2021-06-08 08:49:43 -04:00
710921cfe1
Merge pull request #314 from sartography/deprecate-study-info-protocol-261
...
Remove protocol from study_info script #261
2021-06-08 08:47:43 -04:00
59f605c3df
Prefer tasks that share a parent over just the the next available task when returning the next_task in the workflow processor.
2021-06-08 08:03:14 -04:00
a3a485dd34
Changed do_task_validate_only so it returns a mocked value, instead of True/False.
...
True/False caused problems for workflow validations
2021-06-04 11:44:55 -04:00
9a63ab9c4f
Change `do_task_validate_only` in study_info script to call the real do_task.
...
We do this so we can seed settings into the workflow for testing different scenarios using the study from validate_study_id
2021-06-03 14:28:24 -04:00
c41657301a
Modify `test_spec` and `make_test_workflow` to accept new optional `validate_study_id` parameter.
...
Modify `make_test_workflow` to use study_id when creating test workflow for validation.
2021-06-03 14:22:26 -04:00
0dfc96d7f6
Modified `validate_workflow_specification` to accept new optional `validate_study_id` parameter.
...
We then pass validate_study_id on to WorkflowService.test_spec
2021-06-03 14:19:41 -04:00
d657744816
Added optional `validate_study_id` parameter to the validation api endpoint.
2021-06-03 14:17:12 -04:00
7f0d8a131d
Import DataStoreBase from service now
2021-06-02 10:00:55 -04:00
506b84a49a
Import DataStoreBase from service now
2021-06-02 10:00:18 -04:00
e2e35b673d
Moved data store code from script to service
2021-06-02 09:59:41 -04:00
162dee45d3
Unused import
2021-06-01 16:34:21 -04:00
2e3d8c7343
Fix for DataStoreSchema missing the file_id column.
...
The file_id column is a foreign key.
2021-06-01 13:51:10 -04:00
1ed144536f
New method for file datastore api endpoint
2021-06-01 13:50:04 -04:00
e9fe555e05
New `/datastore/file/{file_id}` endpoint definition
2021-06-01 13:49:21 -04:00
8c04e228e9
Add test and fix to make sure that an empty study associates list (or a blank list) will effectively clear the extra study associates
2021-06-01 11:46:43 -04:00
a5d67bb245
337 partial fix
...
if the user calls the file_data_set function for a valid file with the key 'irb_code' and a value of a valid IRB document code, then we should set the irb code on the file.
2021-05-27 12:24:30 -04:00
acccf3b704
Make sure we are using the correct script engine
2021-05-26 10:50:20 -04:00
384da075ef
Removed references to `protocol` from the description
2021-05-20 11:54:12 -04:00
ef7ee284b2
Prefer tasks that share a parent over just the the next available task when returning the next_task in the workflow processor.
2021-05-19 16:26:16 -04:00
Dan
mike cullerton
Kelly McDonald