Commit Graph

1118 Commits

Author SHA1 Message Date
Dan 635a112796 still trying to fix a rogue test. 2022-02-18 10:41:24 -05:00
Dan 6adf1107fe Trying to figure out why these files are not the same on testing. 2022-02-18 10:12:36 -05:00
alicia pritchett 753534c4cd Remove boolean tests
It could only be True or False now. And again this should be a frontend test now
2022-02-18 10:09:24 -05:00
alicia pritchett 55aacae608 more BPMN's 2022-02-18 10:05:46 -05:00
alicia pritchett ad58b67bb6 Delete read only field test
This is really something the frontend should be testing. Perhaps in the libraries test suite
2022-02-18 10:00:15 -05:00
alicia pritchett 7d597a82f4 mostly fixing bpmns 2022-02-18 09:48:02 -05:00
alicia pritchett 06dc20657b Fixing various BPMN's for tests 2022-02-17 17:29:44 -05:00
alicia pritchett a5acd9b07e Merge branch 'dev' into chore/variables-in-forms-550 2022-02-17 15:04:41 -05:00
alicia pritchett 19965d18da Refactor test workflow_enum_value_expression
Same as other commit pretty much
2022-02-17 14:07:41 -05:00
Dan Funk be48f86440
Merge pull request #459 from sartography/bug/619_lookup_tables
Another re-work to fix 619 - and to assure that we aren't rebuilding …
2022-02-17 13:15:37 -05:00
Dan c2dbec1e3f Merge remote-tracking branch 'origin/dev' into bug/619_lookup_tables 2022-02-17 12:51:24 -05:00
Dan e0a8e7300c Merge remote-tracking branch 'origin/dev' into get-erroring-workflows-574 2022-02-17 12:37:34 -05:00
alicia pritchett 218429f196 Refactor test workflow_value_expression
the backend shouldn't try to set a dynamic default value. Instead, the frontend will initialize it to an empty string, then evaluate a default value, then choose to set it. (Basically, move this function from the backend and put the burden on formly)
2022-02-17 12:25:40 -05:00
Dan Funk 9d74ee5790
Merge pull request #458 from sartography/bug/date-field-validation-622
Bug/date field validation #622
2022-02-17 12:18:39 -05:00
Dan Funk 484b9a9c7c
Merge pull request #457 from sartography/feature/get-spec-script-613
Feature/get spec script #613
2022-02-17 12:17:12 -05:00
Dan Funk b91372171c
Merge pull request #454 from sartography/git-integration-fixes-596
Git integration fixes #596
2022-02-17 12:15:13 -05:00
Dan Funk 5def436602
Merge branch 'dev' into get-erroring-workflows-574 2022-02-17 12:12:42 -05:00
Dan b72ecb8375 Another re-work to fix 619 - and to assure that we aren't rebuilding the lookup tables too frequently. 2022-02-17 11:59:48 -05:00
mike cullerton d3883323f9 Simplified test workflow 2022-02-17 11:51:33 -05:00
mike cullerton 92eb8e9cb9 test for date field validation 2022-02-17 11:48:31 -05:00
Dan f2b6008e5f Fixes 619 - look up models were being built incorrectly, and repeatedly, and sometimes bombed out all together.
bonus: resond with a valid error message when an invalid task_id is requested (don't just 500)
2022-02-17 11:04:50 -05:00
mike cullerton e74e44e8e5 Test for new script 2022-02-16 15:54:56 -05:00
Dan 0ad9843569 Dealing with some changes in SpiffWorkflow's latest release. I think this gets all tests passing again, and behaving as expected. 2022-02-16 10:46:46 -05:00
Dan 093741fa90 By default the system will start up the scheduled tasks, which is usually what you want, but in development
it can be kind of irritating for this stuff to be spinning up when you are trying to debug something, so just set
PROCESS_WAITING_TASKS to false in instance/config.py and voila!!
2022-02-15 14:07:09 -05:00
mike cullerton 63de48ccb6 Merge branch 'feature/spec_files_wthout_db' into git-integration-fixes-596 2022-02-11 12:57:57 -05:00
mike cullerton bf3a75cfbb Added test 2022-02-11 12:17:48 -05:00
Dan e9cf095810 Fixing a stupid mistake in the tests. 2022-02-11 11:54:46 -05:00
Dan 648383f2ea for some reason jenkins doesn't like the spec_category_reorder test, so just doing it a different way. 2022-02-11 11:37:25 -05:00
Dan 7a99859108 fixing some failing test 2022-02-11 11:00:42 -05:00
Dan 4f2602c2f8 Assure sync_file_root can be set from an environment variable. 2022-02-11 10:19:25 -05:00
Dan 1b993ea227 updating readme 2022-02-11 09:47:49 -05:00
Dan 9a9e90dc30 Assure the import test has reference files. 2022-02-10 10:49:15 -05:00
Dan df3f67601c performance improvements. and last rements of load_example_data() 2022-02-09 23:29:39 -05:00
Dan 788e40a998 death to load_example_data() !!!!! 2022-02-09 22:13:02 -05:00
Dan f12c4aba52 Refactor the workflow_spec_service so it doesn't cache anything, it always reads what it needs from the file system. 2022-02-09 21:06:55 -05:00
Dan cf71f68ad9 all tests passing!!!!!!!!!!!!! 2022-02-09 15:30:07 -05:00
Dan 2cc20d4b9d really need to avoid any kind of caching in the WorkflowSpecService 2022-02-09 14:43:32 -05:00
mike cullerton b2d2491b72 Now, we have a list of strings, so get the value directly 2022-02-09 13:59:31 -05:00
mike cullerton 3b6f217443 specs, not workflows 2022-02-09 13:51:49 -05:00
Dan 89e02c6207 really need to avoid any kind of caching in the WorkflowSpecService 2022-02-09 13:37:57 -05:00
mike cullerton aaf20a4de7 specs, not workflows 2022-02-09 13:06:33 -05:00
Dan 7e7821a5e7 more test passing 2022-02-09 13:01:26 -05:00
Dan db93f9be4e fixing the test_spec_files 2022-02-09 12:44:54 -05:00
Dan 02e496b0ef Merge branch 'feature/spec_files_wthout_db' of github.com:sartography/cr-connect-workflow into feature/spec_files_wthout_db 2022-02-09 12:36:21 -05:00
Dan 5773eb99f3 fixing study status. 2022-02-09 12:36:16 -05:00
mike cullerton 881ee78e68 Merge branch 'feature/spec_files_wthout_db' of https://github.com/sartography/cr-connect-workflow into feature/spec_files_wthout_db 2022-02-09 12:14:57 -05:00
mike cullerton d46dfdec40 Fixed the bad order test 2022-02-09 12:14:37 -05:00
Dan e9fd76ed99 lookup service tests passing, but I need to revist this. 2022-02-09 12:11:51 -05:00
Dan de6d7eee84 nearly all study tests work. 2022-02-09 12:03:45 -05:00
Dan 8e7c8c87c3 down to just 38 failed tests 2022-02-09 11:37:54 -05:00
mike cullerton 9576089e84 Reorder categories 2022-02-09 10:55:02 -05:00
mike cullerton b2824286f0 Merge branch 'feature/spec_files_wthout_db' of https://github.com/sartography/cr-connect-workflow into feature/spec_files_wthout_db 2022-02-09 08:52:46 -05:00
mike cullerton 20ca31dd4d category to category_id 2022-02-09 08:51:50 -05:00
Dan cc915ac25a refactoring the study service. 2022-02-09 08:50:00 -05:00
mike cullerton 0a4f63f048 category back to category_id 2022-02-08 16:39:31 -05:00
mike cullerton 5396226b0f Fix reorder spec tests 2022-02-08 16:35:36 -05:00
mike cullerton ccfb4b4cda self was BaseTest in base_test and the test class in the actual test, so we couldn't find workflow_spec_service 2022-02-08 16:35:15 -05:00
Dan 25ecc1593a test_workflow_spec_api passing. 2022-02-08 13:35:27 -05:00
alicia pritchett 112226e9b0 libraries on a spec are now just strings in a list 2022-02-08 11:38:43 -05:00
Dan 6c0e38c0a5 Merge branch 'feature/spec_files_wthout_db' of github.com:sartography/cr-connect-workflow into feature/spec_files_wthout_db 2022-02-08 11:31:56 -05:00
Dan dc040f190e got one more test to work. 2022-02-08 11:30:13 -05:00
mike cullerton 3f856355e2 Merge branch 'git-integration-596' into feature/spec_files_wthout_db
# Conflicts:
#	config/testing.py
#	crc/services/lookup_service.py
2022-02-08 10:38:03 -05:00
mike cullerton dfb05764db *** WIP ***
Committing to merge in the git integration code
2022-02-08 10:27:48 -05:00
alicia pritchett a4fb00b0ed remove bad imports 2022-02-07 15:28:52 -05:00
Dan f40fb26a8f a few more tests passing 2022-02-07 15:17:32 -05:00
Dan 4b8d193fb9 a few more tests passing 2022-02-07 14:58:25 -05:00
mike cullerton 5c3ab9a035 Move copy_files_to_file_system to base_test 2022-02-07 13:43:20 -05:00
Dan d64853fa5b two passing tests around the WorkflowSpecService 2022-02-07 13:34:13 -05:00
Dan 056f901f9a WIP - its just caos right now. 2022-02-07 12:59:48 -05:00
Dan ad095aaaf5 don't try to load the workflowspecservice too early. 2022-02-07 12:38:00 -05:00
Dan abc17a8aff load the workflow_spec_service from app to avoid frequent file scans. 2022-02-07 12:30:20 -05:00
Dan 1c384a78e9 the tests kind of try and run now ... 2022-02-07 12:18:32 -05:00
Dan ff9b2694ae Fix migrations that depend on removed models. 2022-02-07 11:56:22 -05:00
Dan ed07907ee2 at least allow the tests to spin up, even if they all fail. 2022-02-07 11:00:19 -05:00
Dan 2383c7d76d WIP - lots of random changes, trying to swtich over 2022-02-04 14:50:31 -05:00
mike cullerton 9a98b10073 Three tests; get_repo, _get_repo, and push_to_remote 2022-02-04 14:04:52 -05:00
Dan 6765afbd02 WIP - Move the categories and specifications out of the database. 2022-02-04 13:51:39 -05:00
Dan 4ec6e403f5 1. Created a UserFileService, so it's clear what we use when for File Services, UserFiles, SpecFiles, and ReferenceFiles each function differently.
2. Reference Files and Spec Files are written to disk, they do not exist in the database at all.
2022-02-02 12:59:56 -05:00
mike cullerton 070c3cfd5d *** WIP ***
New API endpoints, and associated methods.
Services for the new endpoints
Minimal test
2022-02-01 10:49:35 -05:00
mike cullerton c9b7d95a83 *** WIP ***
Beginning of Git integration
- added gitpython to Pipfile
- started additions for api, model, service, and a test
2022-01-28 16:11:36 -05:00
Dan 4c00a5762f partial commit - new spec_file_service, and new spec_file_api endpoints that use spec and file name, not file id.
removed worklow_sync
cleaned up file and workflow models
most of the test are broken.
2022-01-28 06:42:37 -05:00
Dan Funk 97c29bf77c
Merge pull request #449 from sartography/files-to-filesystem-572
Files to filesystem 572
2022-01-26 10:11:26 -05:00
mike cullerton d82367ab2a Move temp_migration_service code into migration 7225d990740e
Delete test_files_to_filesystem and test_files_from_filesystem--they were only used to give me access to the migration methods
2022-01-26 09:58:46 -05:00
Dan 8529465322 Removed the method get_spec_data_files completly - using get_spec_files and get_spec_data to get this information instead.
Only load the spec data files if you are creating a new workflow, otherwise just deserialize the json.
Removed the stuff about calculaing the version of the spec, as we don't use it.
2022-01-25 16:10:54 -05:00
mike cullerton 4e7f05e9dc Added description to the test. 2022-01-25 12:22:32 -05:00
mike cullerton 467d99f698 Test for processing erroring workflows.
This only tests that we have good information in the message, not whether the message was sent.
2022-01-25 12:19:32 -05:00
Dan Funk 58b3378fbf
Merge pull request #448 from sartography/get-spec-from-workflow-id-589
Get spec from workflow id #589
2022-01-24 16:40:53 -05:00
mike cullerton 209ea49962 Test for new script 2022-01-24 12:41:08 -05:00
mike cullerton 6f31a26772 Better description 2022-01-24 11:06:01 -05:00
mike cullerton 2ecf6cdf86 Validation is the right way to test this. 2022-01-24 11:03:49 -05:00
mike cullerton 73e250a54c Test for missing library hint in the error message 2022-01-24 10:35:11 -05:00
mike cullerton 91fa44b2ab ** WIP **
Committing so I can work on another ticket.
2022-01-21 14:37:11 -05:00
mike cullerton 68820c67cb Removed (almost) all references to WorkflowSpecDependencyFile
(There is still a call in the lookup service, but we need to decide how to fix that)
2022-01-19 16:12:54 -05:00
mike cullerton 16a9a18c5b Fixed get reference file info, and added test 2022-01-19 15:17:35 -05:00
mike cullerton 091d71eb0f Cleaned up code around differences between file info and file data
Cleaned up some api code around differences between file, spec_file, and reference_file
Cleaned up some api code around differences between file info and file data
Fixed some tests for file api
2022-01-19 13:47:14 -05:00
mike cullerton 68ac056457 Merge branch 'dev' into files-to-filesystem-572 2022-01-18 08:18:14 -05:00
mike cullerton 6da6e05171 *** WIP ***
code for updating spec files
some cleanup

tests pass, but we don't have all the tests we need.
2022-01-13 15:24:29 -05:00
mike cullerton 7e5f2a7d6a We no longer use versioning for spec files 2022-01-12 15:09:03 -05:00
mike cullerton ca58b0d2d2 added TODO comments 2022-01-12 15:08:34 -05:00
mike cullerton 88a8c96bd6 The reference document is already created in load_example_data
This lead to a failing test after cleaning up the way we add/update files
2022-01-12 15:07:57 -05:00
mike cullerton b99ed73951 Remove unused imports 2022-01-12 15:00:26 -05:00
mike cullerton cfa9f00bf3 *** WIP ***
Moved reference files to their own service
2022-01-12 14:37:33 -05:00
mike cullerton b0cf11c8c0 We won't do workflow sync this way anymore.
We need to add code for the new way.
These tests fail, so commenting for now, in case some of it is useful.
2022-01-12 13:17:52 -05:00
mike cullerton b6b9482a64 *** WIP ***
Incremental commit. Mainly cleaning up failing tests.
2022-01-12 13:16:09 -05:00
Dan d346589e07 1. added the ability to filter on level and user.
2. added a total to the response, so you can see what the total count of users is.
3. adding user_uid to the task_log table.
2022-01-12 08:58:50 -05:00
mike cullerton 4b2319b0da *** WIP ***
Removing debug print statements
2022-01-11 15:55:58 -05:00
mike cullerton 4df2ed6ce4 *** WIP ***
Failing tests, and missing functionality.
Committing to get stuff on Github.
2022-01-11 15:30:22 -05:00
Dan 962d05c875 1. Created a TaskLoggingService to encapsulate what we are doing with Task Logging through BPMN Script calls and API calls from the front end.
2. Added two api endpoints that will allow us to get all the logs for a specific workflow or study.
3. Assured that requests for logs are paginated, sortable, and can be limited to a specific code if needed.
4. Assure that we only use logging levels that match the log levels of Python.
2022-01-10 13:16:54 -05:00
mike cullerton f537fd7fbf *** WIP *** 2022-01-07 15:58:23 -05:00
mike cullerton dc27f795c8 *** WIP ***
Committing because it is Friday afternoon, and my computer is acting flaky
2022-01-07 15:34:51 -05:00
mike cullerton 86a6039dc8 *** WIP ***
**Many** tests are failing!

Committing so I can merge dev into this branch
2022-01-06 11:46:54 -05:00
mike cullerton 2cd0f84a47 Merge branch 'dev' into files-to-filesystem-572 2022-01-03 08:06:17 -05:00
Dan 212be423f7 bumping spiffworkflow to support transcations and cancels properly. 2021-12-30 13:01:38 -05:00
Dan 3480e1c8ab use a signal, in addition to firing off a cancel notify when a workflow is restarted. 2021-12-23 15:30:09 -05:00
Dan c83b047881 Fixing some bugs I introduced with the latest fix. 2021-12-21 16:22:41 -05:00
Dan e715980bca bumping SpiffWorkflow to account for an issue when dealing with a subprocess immediately before a looping back to a previous task. 2021-12-21 15:01:07 -05:00
Dan f129509802 Looks like reording the deletes allows us to remove workflow specs a little easier. Tested this with libraries, and seems to work ok. 2021-12-20 14:36:45 -05:00
mike cullerton 5c90ce01a6 *** WIP ***
Temp services `ToFilesystemService` and `FromFilesystemService` for migrating files To and From the filesystem - Not sure where these classes will end up
Tests to call the two services.
upgrade method in migration that writes workflow spec files and metadata to filesystem
2021-12-16 14:22:37 -05:00
mike cullerton 338352017b *** WIP ***
Moving files to the filesystem
Tools for reading/writing metadata for categories and specs
2021-12-16 08:41:49 -05:00
Dan 421e4fd9aa Fixes related to resent commit to SpiffWorkflow that provides better handling for workflows that loop back on themselves. 2021-12-15 16:00:31 -05:00
Dan c46800171d Merge remote-tracking branch 'origin/dev' into bug/fix-task-data 2021-12-13 13:18:00 -05:00
mike cullerton acbb8898e4 Merge branch 'more-study-statuses-562' into waiting-workflow-errors-566 2021-12-10 16:52:07 -05:00
mike cullerton daef419993 Tests and workflow for the changes 2021-12-10 16:18:05 -05:00
mike cullerton 4d832891c9 Set progress_status for new studies in BaseTest 2021-12-10 16:17:23 -05:00
mike cullerton 61975093f9 Renamed some files to include the word `progress` 2021-12-10 15:47:34 -05:00
alicia pritchett cacd57ce6f fix this bpmn 2021-12-10 12:31:35 -05:00
alicia pritchett 0e28d2c5f5 Fix a test 2021-12-10 12:16:39 -05:00
mike cullerton 52baf25459 In `WorkflowService.do_waiting`, if a workflow causes an exception, change its status from `waiting` to `erroring` so we don't continue to call it in `do_waiting`. 2021-12-09 15:33:39 -05:00
mike cullerton 49ba36c95e Use one of the new statuses in the test.
Fix bug in validation test
2021-12-09 13:33:20 -05:00
Dan Funk 23fa28bc23
Merge pull request #434 from sartography/bug/ldap_service_rollback_expoded_the_world
The LDAP service didn't do a good enough check to see if the record w…
2021-12-09 06:42:02 -05:00
Dan 412290f2ab The LDAP service didn't do a good enough check to see if the record was already in the database. This caused an error, which left the workflow in a waiting state. And that waiting state meant the error would just happen a million times over again until we pushed up this code change. 2021-12-09 06:33:30 -05:00
Dan Funk 0cfa59bfea
Merge pull request #429 from sartography/chore/clear-form-data-553
Fixes #553 - Don't load Form data
2021-12-08 10:37:44 -05:00
Dan Funk b28ddef842
Merge pull request #430 from sartography/study-status-scripts-556
Study status scripts #556
2021-12-08 10:36:53 -05:00
Dan ffafc1674a assure we don't overwrite task data with a previous form submission if that data already exists. 2021-12-07 17:04:20 -05:00
mike cullerton 4ea3682dd6 Updated for new ProtocolBuilderCreatorStudy model and schema
Removed unused imports
2021-12-06 14:43:07 -05:00
mike cullerton 9785a2fe5a Updated for new ProtocolBuilderCreatorStudy model and schema
Added with `session.no_autoflush` to stop rollback during test
2021-12-06 14:42:34 -05:00
mike cullerton d08b2a8562 Updated for new ProtocolBuilderCreatorStudy model and schema
Removed unused imports
2021-12-06 14:40:56 -05:00
mike cullerton d0ddc7a00f Updated to match new UVA API endpoint 2021-12-06 14:39:49 -05:00
alicia pritchett 22320efad4 test for this ticket 2021-12-03 12:23:57 -05:00
mike cullerton 7ca7de177e Removed print statements 2021-12-03 11:55:35 -05:00
mike cullerton fa61aa0354 Tests for set_study_status 2021-12-03 11:45:39 -05:00
mike cullerton 1ed76bf534 test for get_study_status 2021-12-02 15:31:14 -05:00
Dan cf3f8ce444 Missing the bpmns for a test. 2021-11-30 13:29:31 -05:00
Dan 676321c2e2 Fixing a test. 2021-11-30 12:55:52 -05:00
Dan ad93b5fae6 We were not correctly handing the possibility of there only being a waiting task (and no ready tasks).
We also had a problem with the validator throwing a 500 when it was trying tell us it would never finish validation.
2021-11-30 12:44:35 -05:00
Mike Cullerton ec9d8f8a5c
Merge pull request #425 from sartography/bug/slow_ldap
Remove wild-card from uid search, it performs very badly.  Add a bit …
2021-11-30 11:09:42 -05:00
Dan Funk 8c30df011b
Merge pull request #427 from sartography/workflow-status-script-548
Workflow status script #548
2021-11-30 10:51:57 -05:00
Dan Funk c8c8c8b244
Merge pull request #424 from sartography/xls-xlsx-issue-540
Xls xlsx issue #540
2021-11-30 10:50:33 -05:00
mike cullerton 0f1ccd7db5 New script to check workflow status.
Includes test and test workflow
2021-11-30 08:54:15 -05:00
Dan b9c936da38 Fix the test. 2021-11-29 11:25:45 -05:00