Commit Graph

162 Commits

Author SHA1 Message Date
jasquat fecbb3f040 added new column to bpmn process definition to store the full bpmn process hash digest w/ burnettk 2023-04-17 12:01:36 -04:00
jasquat 0ae74f8f35 removed spiff step details w/ burnettk 2023-03-23 16:33:30 -04:00
jasquat 034201b01c pyl 2023-03-21 13:34:59 -04:00
jasquat bc58de809e use task table for process instance show page. spiff steps are not working yet and neither is data w/ burnettk 2023-03-20 16:51:29 -04:00
jasquat 50acac8160 some more index updates and a new migration for it w/ burnettk 2023-03-17 16:52:05 -04:00
jasquat 3ca165bb94 recreated migrations to remove spiff logging w/ burnettk 2023-03-17 15:50:05 -04:00
jasquat 3782864dc9 added event logs for skipping and manually editing a task 2023-03-17 13:51:56 -04:00
jasquat 88df3bd5c3 added process instance event table 2023-03-17 13:20:06 -04:00
jasquat 363428df09 added bpmn_name columns to definition tables and added test for simple logs as well 2023-03-17 10:00:59 -04:00
jasquat d3393fc6d0 added bpmn process definition to bpmn process w/ burnettk 2023-03-16 16:59:37 -04:00
jasquat 80d9fa8ad6 merged in save_to_task_data branch and pyl with some cleanup w/ burnettk 2023-03-16 12:50:52 -04:00
jasquat bbdac3c586 some initial code to use tasks for logs 2023-03-16 09:30:25 -04:00
jasquat 96989c676e fixed up tests and ran pyl w/ burnettk 2023-03-15 16:10:23 -04:00
jasquat bc619af0a0 check data when running main spiff test w/ burnettk 2023-03-15 15:38:58 -04:00
jasquat 2e9fa0e4b4 pyl and cleaned up debug code w/ burnettk 2023-03-15 12:15:48 -04:00
jasquat ceca4d1333 unit tests are passing w/ burnettk 2023-03-15 11:25:15 -04:00
jbirddog 764eb35d1b Move process instance locking to new queue table (#177) 2023-03-14 13:12:01 -04:00
jasquat 87bacbdaaf added some timestamp fields to bpmn process tables w/ burnettk 2023-03-07 10:41:54 -05:00
jasquat 4ee7b299f2 pyl and fixed cypress tests w/ burnettk 2023-03-06 11:59:33 -05:00
jasquat 96ef81af34 merged in main and resolved conflicts w/ burnettk 2023-03-06 11:15:16 -05:00
jasquat e55485bd4a removed process instance data and serialized bpmn definition models w/ burnettk 2023-03-06 11:13:53 -05:00
jasquat 2cdacfa03b some stuff is passing but still needs the process_instance_data w/ burnettk 2023-03-03 16:51:24 -05:00
burnettk 14e12645c4 get longblob on mysql, reset migrations since we are going to do that anyway in hours 2023-03-03 14:04:02 -05:00
jasquat 4eef585136 recreated migration from new one in main 2023-03-03 13:08:30 -05:00
jasquat 40a3515d4e Merge remote-tracking branch 'origin/main' into feature/split_up_bpmn_json 2023-03-03 13:04:26 -05:00
jbirddog b4546e86e6 Special case file data during user form submission (#164) 2023-03-03 12:24:18 -05:00
jasquat f7c46cd945 recreated branch migration w/ burnettk 2023-03-03 12:08:36 -05:00
jasquat 8c60080663 set the collation on the db directly and not in the models w/ burnettk 2023-03-03 12:05:12 -05:00
jasquat 276e6d5f37 recreate migrations to set case sensitive columns for mysql w/ burnettk 2023-03-03 11:41:34 -05:00
jasquat d7f4c8ba95 clean up bpmn process definition save code a bit w/ burnettk 2023-03-03 11:24:28 -05:00
jasquat 0c6e9a63ba unit tests are passing with the new spec tables 2023-03-03 10:08:14 -05:00
jasquat 8d67e8cc87 we can save the top level spec to the database with its tasks w/ burnettk 2023-03-02 17:28:31 -05:00
jasquat 716986a483 prefer the bpmn process name over the identifier on the logs list page w/ burnettk 2023-03-01 16:28:42 -05:00
jasquat 6521998a54 fixed the downgrade in new migration w/ burnettk 2023-03-01 15:54:50 -05:00
jasquat 59c5ed296d removed old branch migrations and created single one for this branch w/ burnettk 2023-03-01 15:40:17 -05:00
jasquat e2891425fc store the process instance data id on the process instance and not the other way around w/ burnettk 2023-03-01 11:39:03 -05:00
jasquat f74ce0f568 some logic to attempt to use the new bpmn json tables w/ burnettk 2023-02-28 17:46:14 -05:00
jasquat d5acd5a16d added new table and some notes on how to get a delta w/ burnettk jbirddog 2023-02-28 16:30:52 -05:00
burnettk a5c6d262b8 slam migrations file one last-ish time, increase task_name column length 2023-02-27 22:03:42 -05:00
burnettk a1ec494ab3 let env var work on windows and fixing typing issue on python 3.9 w/ messaging stuff 2023-02-27 19:16:06 -05:00
jasquat 45feb38168 recreated all migrations to resolve postgres migration failures w/ burnettk 2023-02-27 17:27:53 -05:00
jasquat 7c12709fdd fixed conflict with db migrations w/ burnettk 2023-02-27 14:33:55 -05:00
jasquat dfac872606 Merge remote-tracking branch 'origin/main' into feature/script_get_last_user_completing_task 2023-02-27 14:28:23 -05:00
jasquat 9f84564457 script to get last user completing a task is working w/ burnettk 2023-02-27 12:08:07 -05:00
burnettk e9b3ababc1 wip for get_last_user_completing_task script task 2023-02-25 23:31:23 -05:00
Dan 0dc2bc3316 # SpiffWorkflow:
1) Type Safe checking on correlation properties (no more str())
2) A running workflows Correlations are once again at the key level.

# Backend
1) Both send and receive messages can have correlation_keys - and we compare these to each other to quickly assure a match (if they both exist - otherwise we fall back to comparing the properties on the receive to the sending messages payload)
2) Cleaned up the migrations to just one file
2023-02-24 14:53:22 -05:00
Dan 5a3b4b8792 BPMN Parser was returning all retrieval expressions, rather than the ones specific to a correlation property, as was intended.
Adding a correlation cache - so we have a reference of all the messages and properties (though still lacking a description of keys)
Adding yet another migration, maybe should squash em.
2023-02-23 16:36:32 -05:00
Dan 8466d823c2 Adding Migration. 2023-02-23 14:42:00 -05:00
Dan 0030a46938 run_pyl 2023-02-23 14:17:22 -05:00
Dan 5f6a61c93f * SpiffWorkflow event_definitions wanted to return a message event's correlation properties mested within correlation keys. But messages are directly related to properties, not to keys - and it forced a number of conversions that made for tricky code. So Messages now contain a dictionary of correlation properties only.
* SpiffWorkflow did not serialize correlations - so they were lost between save and retrieve.

* When comparing Correlation Property values - we are storing these values as strings in the database and can't convert them back to integers later, so I'm changing everying everywhere to compare after conversion to a string.  Don't feel great about this one.
* By using an SQL Alchemy join table, there is a lot of db queries we don't need to write.
* A few handy fucntions on db models to make it easier to work with correlations.
* Updated tests because I changed some of the BPMN models we were testing against.
* Database migration to use the new constraint names with the alternate form of the join table between correlation mesages to instance messages.
2023-02-20 11:50:35 -05:00
Dan 8e257600af work in progress -
* Link between message instance and correlations is now a link table and many-to-many relationships as recommended by SQLAlchemy
* Use the correlation keys, not the process id when accepting api messages.
2023-02-17 10:45:01 -05:00
jasquat 012d2bd367 tasks and subprocesses can are setting the task states properly now when getting task data w/ burnettk jbirddog 2023-02-09 15:29:45 -05:00
jasquat df5451685f updated controller to use spiff step details to find correct task data to show w/ burnettk 2023-02-08 17:31:20 -05:00
jasquat 1d4a7a9b94 added additional columns to spiff_step_details w/ burnettk jbirddog 2023-02-08 12:43:30 -05:00
burnettk 67667828c2 if there are tenant specific fields in the config, transfer them from openid token to db 2023-02-04 00:03:32 -05:00
jasquat 4e0ddc7ea5 removed uniqueness constraint from human task so we can loopback to a previous task with a gateway w/ burnettk 2023-01-24 11:03:55 -05:00
jasquat 102413326a added locking system for process instances so hopefully background jobs will not take instances currently being run by the user w/ burnettk 2023-01-23 16:45:07 -05:00
jasquat 809c4b055a added uniqueness constraint to spiff step details w/ burnettk 2023-01-23 11:03:17 -05:00
jbirddog 0aaf503c3f Make list available to script tasks (#86) 2022-12-28 17:04:47 -05:00
jasquat b62d9f8867 delete human tasks when process instance is deleted w/ burnettk 2022-12-28 14:02:39 -05:00
burnettk 5a73ba20c1 lint and regen schema 2022-12-22 21:15:10 -05:00
jasquat 92258c6f9a pyl w/ burnettk 2022-12-20 15:47:30 -05:00
jasquat 5a6e181a99 merged in main and resolved conflicts w/ burnettk 2022-12-20 15:06:34 -05:00
jasquat 98cc8fec61 added remaining filter tests w/ burnettk 2022-12-20 14:39:04 -05:00
jasquat 96e14817fa some initial changes to refactor report filters w/ burnettk 2022-12-20 11:16:06 -05:00
jasquat 2a73e23b3c renamed active task to human task since we are no longer deleting them w/ burnettk 2022-12-19 16:23:02 -05:00
jasquat 389c919d99 merged in main and resolved conflicts w/ burnettk 2022-12-19 14:51:54 -05:00
jasquat aec0416eed do not allow editing task data for process instances that are not suspended and some code cleanup w/ burnettk 2022-12-19 11:54:22 -05:00
jasquat bb5a4add1f added updated and created at columns on user w/ burnettk 2022-12-19 11:25:21 -05:00
burnettk cb41cf7cc7 fix tests 2022-12-17 23:25:47 -05:00
jasquat 66c5272766 added completed column to active task w/ burnettk 2022-12-16 16:51:49 -05:00
Dan de6558fea0 Updated migrations. 2022-12-15 14:43:09 -05:00
Dan 160e19bb8c When loading permissions and the user does not exist, add records to the UserGroupAssignmentWaiting table that can be picked up later.
Request "profile" scope over OpenID so we can get a few more bits of information when avilable.
Add a "clear_perissions" script
Add an "add_permissions" script
Add an "add_permissions" script
When logging in for the first time, check for any awaiting permissions and assign them.
Add "enumerate" as a whitelisted function to React Schema
Add a "display_name" to the user table

Add a test for adding a new permission
Add a test for adding a user to group
Adding a test for deleting all permissions.
Adding a display name for the user table
2022-12-15 14:40:31 -05:00
Dan 4a8b07e98d Removing two fields from user table that were not used (uid, name)
Request email from open id clients, as this would provide a handy way to uniquely reference users when assigning to groups.
During Login do a lookup on email if possible -- so that permissions assignments based on email can be connected when sigining in through openid.
Don't use "open_id" for the service name on user accounts, use the iss string provided through open id,  this will allow us to support more than one open id platform.
Update the KeyCloak configuration so it is able to return email addresses for users -- which will make permission assignment easier in the future.
Removed several unused commands in the user_service class.
2022-12-12 15:43:19 -05:00
Dan bab489fa7b Merge branch 'main' into feature/create_containers 2022-12-06 18:06:09 -05:00
Dan e8cbe1df84 A little cleanup of the ui
Don't check authorization on static assets
Do not require unique username on user table (uniqueness check is on the service and service id composite.)
2022-12-01 12:12:37 -05:00
jasquat abffccedbd added correlations to message list table w/ burnettk 2022-11-30 15:08:04 -05:00
jasquat 2fc44907e8 added api to get list of process report columns 2022-11-29 17:32:29 -05:00
jasquat 0eeb096d43 added script to save process instance metadata and fixed permissions issue w/ burnettk cullerton 2022-11-28 15:26:50 -05:00
burnettk fa92943317 lint 2022-11-25 00:46:43 -05:00
burnettk 2c751a7825 remove column 2022-11-24 12:28:53 -05:00
burnettk 2eb3ef6aa3 renames 2022-11-24 12:00:26 -05:00
burnettk bfae6ac63d start adding display name and removing garbage 2022-11-24 11:51:31 -05:00
burnettk 0712f7a4e8 lint 2022-11-21 09:03:35 -05:00
burnettk e98aec7c56 Merge commit '9275b67b0dddac9628342741278c89f6f2bd3620' 2022-11-20 19:55:00 -05:00
mike cullerton 576d60e41d precommit 2022-11-18 15:50:20 -05:00
Dan 9755356279 Fixing a bug in SpiffWorkflow (new version in poetry.lock)
Don't explode when back-filling process models and hitting and error
Assure processes are executable when setting them as the default primary process.
The SpecReferenceCache now uses a unique constraint across two fields. (requires a new db)
2022-11-15 14:50:41 -05:00
burnettk d748f019e8 run_pyl 2022-11-15 10:11:26 -05:00
Dan a9df1ed23f Merge remote-tracking branch 'origin/main' into feature/call_activity_selection 2022-11-15 09:55:02 -05:00
Dan 22d1186236 Adding a very simple api endpoint that just returns a list of every process known to the system. 2022-11-14 21:54:13 -05:00
jasquat b9e7b5271e more refactoring for process instance list w/ burnettk 2022-11-14 17:35:04 -05:00
jasquat e6db091ba1 refactored pagination table to allow prefixing page options w/ burnettk 2022-11-14 16:29:04 -05:00
Dan d740518e75 Mostly a name change from BpmnProcessIdLookup to SpecReferenceCache. I landed on this unfortunate name because:
1. It's not just processes, it contains the list of all DMN Decisions as well.
2. It is closely linked to the SpecReference object that can be generated by looking through all the Spec files to find the processes and decisions they contain.
3. It is a cache of information, the file system is the source of truth.  Seems likely we will cache more things in the future -- so setting things up this way made sense.
2022-11-14 15:23:37 -05:00
Dan 0d0235ec70 Adding a display name to the BPMN Process ID Lookup Table
Removing (very nearly, except for script unit tests) all the XML Parsing we were doing, see related PR on SpiffWorkflow
Moved the Custom Parser into its own file to solve some circular import issues
2022-11-12 12:36:07 -05:00
mike cullerton b13bfe0489 Delete groups now checks for running instances in nested models
also, pyl
2022-11-10 16:44:27 -05:00
jbirddog 2b92a6afef Bulk insert spiff logs and step details (#26) 2022-11-09 15:43:12 -05:00
jbirddog 5b01c50d6a Move to Python 3.11 (#27) 2022-11-09 13:45:16 -05:00
jasquat 06e5d05d51 fixed some acceptance tests w/ burnettk cullerton 2022-11-08 17:20:17 -05:00
jbirddog 8b47cf49fb First pass at custom report/perspective for Process Instance List (#23) 2022-11-08 09:26:42 -05:00
jbirddog 09ac38291e From the logs, allow viewing a diagram in a previous state (#15)
Co-authored-by: Elizabeth Esswein <elizabeth.esswein@gmail.com>
2022-11-02 14:34:59 -04:00