sartography/cr-connect-workflow
1
0
Fork 0
mirror of https://github.com/sartography/cr-connect-workflow.git synced 2025-02-24 13:48:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,482 Commits 14 Branches 0 Tags 9 MiB
Commit Graph

88 Commits

Author SHA1 Message Date
mike cullerton
ca54b850cd UNDO my previous commit regarding get_files needs to have workflow_spec_id 
We need to call `get_spec_files` instead now
 2022-01-20 14:57:32 -05:00
Dan
f815add699 1. Add a default directory for the location of SYNC files. 
2. Added a last_updated column to the lookup table
3. The Lookup service now uses the above, and compares it to the actual file date, we can then rebuild the lookup if needed.
4. That 755 migration loads up the models, so when you change the models, the migration starts to fail.  Not really sure what to do here, but modify the migration while we are in process.
 2022-01-20 13:05:58 -05:00
mike cullerton
9ea1399578 get_files needs to have workflow_spec_id 2022-01-20 09:54:22 -05:00
mike cullerton
b99ed73951 Remove unused imports 2022-01-12 15:00:26 -05:00
mike cullerton
b6b9482a64 *** WIP *** 
Incremental commit. Mainly cleaning up failing tests.
 2022-01-12 13:16:09 -05:00
mike cullerton
9cc91f92c3 *** WIP *** 
cleanup - removing commented code
 2022-01-11 15:55:08 -05:00
mike cullerton
dc27f795c8 *** WIP *** 
Committing because it is Friday afternoon, and my computer is acting flaky
 2022-01-07 15:34:51 -05:00
mike cullerton
86a6039dc8 *** WIP *** 
**Many** tests are failing!

Committing so I can merge dev into this branch
 2022-01-06 11:46:54 -05:00
mike cullerton
6073412d82 Clean up imports 2021-12-17 12:03:45 -05:00
mike cullerton
5c90ce01a6 *** WIP *** 
Temp services `ToFilesystemService` and `FromFilesystemService` for migrating files To and From the filesystem - Not sure where these classes will end up
Tests to call the two services.
upgrade method in migration that writes workflow spec files and metadata to filesystem
 2021-12-16 14:22:37 -05:00
mike cullerton
338352017b *** WIP *** 
Moving files to the filesystem
Tools for reading/writing metadata for categories and specs
 2021-12-16 08:41:49 -05:00
mike cullerton
7722b89faa If a file was archived, users could not update the file. 
In some situations, this kept users from re-uploading files that were previously deleted.
We now allow an archived file to be updated and unarchived.
 2021-10-29 11:52:27 -04:00
mike cullerton
29798f1ba6 turned it on 2021-09-28 10:16:47 -04:00
mike cullerton
c91e81e356 Clean up file data. Always keep at least 1 version. Do not delete if in lookup or dependency tables 2021-09-27 17:15:53 -04:00
mike cullerton
ce1af73d6e Remove unused import 2021-09-07 15:44:15 -04:00
mike cullerton
21987cf1f1 Remove old root definition. 
We now use the 2019 spec
 2021-09-07 15:38:53 -04:00
mike cullerton
e630aeb94e Add DMNDI section. 
Without it, the configurator could not parse the XML
 2021-09-07 14:27:15 -04:00
mike cullerton
6e7b549136 Change root element to use 2019 spec 2021-09-07 12:11:27 -04:00
mike cullerton
93e8015ddd Read the spreadsheet data sent from the front end. This allows pandas to see it as a file type object. 
Fixed bug where column_count wouldn't get set if there isn't an Annotation column
 2021-09-03 10:37:06 -04:00
mike cullerton
4fa68bd4c0 Move business logic to FileService 2021-09-02 09:52:58 -04:00
mike cullerton
506157d58a Add task_spec_name to FileService.add_workflow_file, and script that calls it. 2021-08-26 10:40:47 -04:00
Leashys
032aad9bc4 Fixes #383 - Timestamp on files is UTC? 
also this includes the shield test thing for the boolean_type property whoopsie
 2021-08-17 13:04:24 -04:00
Kelly McDonald
960d302c03 Finish #367 - Make sure that we only use a primary_id if it is in the workflow that we are currently working on - otherwise it is a library and might have its own primary id. 2021-08-10 09:15:38 -04:00
mike cullerton
b0cf74fa3d Merge branch 'dev' into add-by-user-61 
# Conflicts:
#	tests/files/test_files_api.py
 2021-07-07 10:46:50 -04:00
mike cullerton
894377a607 Add user_uid to FileDataModel calls 2021-07-06 17:09:00 -04:00
Dan
1b1a994360 Refactoring Reference files to use the lookup table, rather than parsing the results directly out of the spreadsheet, or attempting to cache them. 
Adding a DocumentService to clean up the FileService, and get Documents well seperated, as it seems likely be pulled out or seperated in the future, there is now a Documents api file as well, for the same reason.
Some other minor changes are just fixing white space to assure our code is linting correctly.
I removed _create_study_workflow_approvals from the base test, as we don't use approvals like this anymore.
 2021-07-06 13:10:20 -04:00
Dan
07eb3f9ca8 Moving metrics into SpiffWorkflow so we can run the performance metrics deeply across both systems simultaniously. 
Upgrading libraries.
Fixing deprication issue with Pandas and numpy.
We can only process xlsx files now, plain oldschool xls is fully removed.
 2021-06-18 16:41:55 -04:00
Dan Funk
586a0f2f1a
Merge pull request #325 from sartography/feature/file_refactor 
Prefer tasks that share a parent over just the the next available tas…
 2021-06-08 11:28:23 -04:00
Dan
59f605c3df Prefer tasks that share a parent over just the the next available task when returning the next_task in the workflow processor. 2021-06-08 08:03:14 -04:00
Kelly McDonald
a5d67bb245 337 partial fix 
if the user calls the file_data_set function for a valid file with the key 'irb_code' and a value of a valid IRB document code, then we should set the irb code on the file.
 2021-05-27 12:24:30 -04:00
Dan
5a79b80f32 fixes #322, do not error out deleting files that have assocaited data stores, just remove the data store. 2021-05-05 20:21:33 -04:00
Dan Funk
34759a2f3d
Merge branch 'dev' into feature/performance-refactor 2021-05-04 11:30:13 -04:00
Dan
a719cf4bf9 When retrieving the study, only update the status of underlying workflows if specifically requested. 
Record the size of a file in the database for quick access (this helps with a frontend refactor, so it isn't downloading the file just to see it's size)
Cleaning up the timing/performance metric reporting to make it easier to read.
Fixing a bug that prevented non-admins for getting the document-directory
 2021-04-30 11:55:12 -04:00
Kelly McDonald
2b9cee6b89 Update database to include timezone and change all points where we set the time on an event to be utc time. If we get something in the database with a timezone, it will display properly on the front end, but by default everything will be put in the database in UTC 2021-04-29 10:25:28 -04:00
Kelly McDonald
e2197ddab9 Changes to support the frontend data pane 
fixes #277 and requires frontend branch 277-document-pane
 2021-04-20 08:12:27 -04:00
Kelly McDonald
f1ca44a0e1 Add primitive cache on the fileservice is_review, halves the time of loading the list on the primary dashboard 2021-03-23 10:17:48 -04:00
Kelly McDonald
da0af14724 Changes to enable front-end changes 
Added a human readable name to created user

added last updated task time and name,

added is_review on the workflow which is triggered by a swimlane with a name present.

Notably - it does NOT update or change any of the performance concerns that we were having with this.
 2021-02-10 11:58:19 -05:00
mike cullerton
c9a4a9685f Users cannot upload a workflow_spec_file that already exists. We raise an error that is displayed on the fron end. 2021-01-04 15:47:45 -05:00
Dan
6cfce839c1 Validation now assures that we won't encounter errors when generating navigation lists. 
Fixing workflow sync paths that were incorrect.
Repairing a suddenly failing test in files, that just don't make no sense.
Bumping spiffworkflow that contains a fix for issue #155
 2020-12-28 17:33:38 -05:00
Dan
fd4b881416 upgrading the pip libraries. 2020-12-14 10:30:10 -05:00
Kelly McDonald
8b23cdc05c commit changes before switching branches 2020-10-09 08:46:14 -04:00
Carlos Lopez
2bd906e96d Update github routines to use branches 2020-08-14 11:04:22 -06:00
Aaron Louie
c8881cbf91 Merge branch 'dev' into feature/approvals_dashboard_prototype 2020-07-31 12:17:22 -04:00
Dan Funk
300026cbc8 Expanding the task events endpoint to accept workflow and study ids as additional filters. 
Removing events from the study endpoint, too noisy.
 2020-07-28 10:16:48 -04:00
Carlos Lopez
73400ed6c7 Adding proper tests for files publishing 2020-07-17 16:59:25 -06:00
Dan Funk
150117587e Merge branch 'dev' into feature/parallel_multiinstance_tasks 2020-06-25 23:20:38 -04:00
Aaron Louie
c3ceda4c2f Replaces xml.etree with lxml.etree 2020-06-25 14:02:16 -04:00
Carlos Lopez
e9e805b2c9 Storing emails in database 2020-06-09 22:57:56 -06:00
Dan Funk
fed6e86f92 Trying to fix LDAP issues on production. Changing LDAP to static only methods, caching the connection and calling bind before all connection requests. 
Also assuring we don't load the documents.xls file over and over again.
 2020-06-04 14:59:36 -04:00
Dan Funk
bbcbfef1ba Fixing the migrations so I don't break the universe. 2020-06-04 10:09:36 -04:00