Commit Graph

1175 Commits

Author SHA1 Message Date
jasquat 854b41378f WIP trying to get resetting to a task within a subprocess working w/ burnettk 2023-03-30 16:30:34 -04:00
jasquat c73c0dcad1 fixed some failing tests except for test_send_event 2023-03-30 15:25:44 -04:00
jasquat b4b54f3fff do not save predicted tasks to the db w/ burnettk 2023-03-30 12:41:42 -04:00
jasquat e3b8653296 added an init method to task service and move a lot of code from workflow execution to it and fixed up the task running test to check things more thoroughly 2023-03-30 11:15:27 -04:00
jasquat edc0ea83fa Merge remote-tracking branch 'origin/main' into feature/fix_process_instance_rewind 2023-03-30 07:51:05 -04:00
jasquat 1ee8ba252e check if data file value is a string before returning it w/ burnettk 2023-03-29 16:49:33 -04:00
jasquat 7bb7543a42 import missing lib w/ burnettk 2023-03-29 16:03:45 -04:00
burnettk cdf5fc313a use text for sql 2023-03-29 15:51:04 -04:00
jasquat a7521cba65 run snyk on backend and added marshmallow dep to remove warning w/ burnettk 2023-03-28 16:55:13 -04:00
jasquat 32029a644b Merge pull request #198 from sartography/feature/safety
Feature/safety
2023-03-28 16:32:58 -04:00
jasquat 14927c5271 remove unnecessary libs from pyproject in root of arena w/ burnettk 2023-03-28 16:12:27 -04:00
Elizabeth Esswein 2cb07478c4 Merge pull request #196 from sartography/bugfix/use-spiff-business-rule-task
import parser from spiff package
2023-03-28 16:02:56 -04:00
jasquat e7fef5b6c4 updated sqlalchemy to 2.0 due to safety complaints w/ burnettk 2023-03-28 15:56:00 -04:00
jasquat 1ee6753c28 Merge remote-tracking branch 'origin/main' into feature/fix_process_instance_rewind 2023-03-28 15:07:36 -04:00
jasquat 9a3f50d5fc some more debugging 2023-03-28 15:07:31 -04:00
burnettk fa5ded0f26 get backend working with new spiff 2023-03-28 10:33:53 -04:00
burnettk 01f8bc0f87 fix all sonar bugs 2023-03-28 10:05:29 -04:00
jasquat fdd6d92506 resolved merge conflicts 2023-03-28 08:24:53 -04:00
jasquat 3ce25bba7e some more attempts to get reset working 2023-03-28 08:23:09 -04:00
burnettk 21a97fb4cf lint 2023-03-28 08:04:42 -04:00
burnettk e6cb06c4a3 Merge remote-tracking branch 'origin/main' into feature/fix_process_instance_rewind 2023-03-27 20:27:19 -04:00
burnettk 151cb13255 task_guid is a str, thanks, typeguard 2023-03-27 20:22:12 -04:00
burnettk 4a092a8e2a tests have been broken in ci, and this should fix it 2023-03-27 17:02:29 -04:00
Elizabeth Esswein 7e32c800ac import parser from spiff package 2023-03-27 16:13:17 -04:00
jasquat 2df8d3eabb Merge remote-tracking branch 'origin/main' into feature/fix_process_instance_rewind 2023-03-27 16:10:26 -04:00
jbirddog f0681aec28 Handle the multiple single file upload widget case (#195) 2023-03-27 16:03:22 -04:00
jasquat 1ae29c1599 process children and tasks of parent subprocesses instead of looking for all tasks with a given state w/ burnettk 2023-03-27 10:37:31 -04:00
burnettk 54927ef62c filter report column list by process_model_identifier if any 2023-03-24 17:54:37 -04:00
jasquat 0ae74f8f35 removed spiff step details w/ burnettk 2023-03-23 16:33:30 -04:00
jasquat 94cd732ebd save timestamps when manually completing a task and some cleanup w/ burnettk 2023-03-23 16:07:25 -04:00
jasquat 3f49f912ea pyl passes w/ burnettk 2023-03-23 15:16:39 -04:00
jasquat 77ae760586 fixed editing task data and skipping tasks, moved task and task data methods from process_api_blueprint to tasks_controller, and updated to favor task_guid over task_id in some places 2023-03-23 14:28:20 -04:00
jasquat f45f2c1cc6 added link to go back to most recent 2023-03-23 13:55:16 -04:00
jasquat 7a14a58518 commented out reset process code and added comment and raise until we get it actually working and fixed issue with viewing at completed task where it was not including the tasks for the parent bpmn processes 2023-03-23 10:44:09 -04:00
burnettk 152be789ec another take on metrics 2023-03-22 22:40:56 -04:00
jasquat 722680a5ac some more debugging for resetting a process to specific task w/ burnettk 2023-03-22 14:39:04 -04:00
jasquat 61da3d6b6f updated manual task with subprocess bpmn w/ burnettk 2023-03-22 10:45:40 -04:00
jasquat 26af07befd resetting tasks somewhat work 2023-03-22 09:44:13 -04:00
jasquat 034201b01c pyl 2023-03-21 13:34:59 -04:00
jasquat 3bf1c49a75 Merge remote-tracking branch 'origin/main' into feature/remove_spif_step_details 2023-03-21 12:17:52 -04:00
burnettk a1f546ba16 add SPIFFWORKFLOW_BACKEND_SENTRY_ENV_IDENTIFIER config 2023-03-21 11:29:14 -04:00
jasquat 8baa38d22b use consistent types for tasks in webui instance show page and mark the to task guid task as ready in backend 2023-03-21 10:45:10 -04:00
jbirddog 992648f087 Optimisticly skip locking/background processing (#190) 2023-03-21 09:37:10 -04:00
jasquat b1e9e8fabe Merge remote-tracking branch 'origin/main' into feature/remove_spif_step_details 2023-03-21 09:05:03 -04:00
Dan f9a7b3cb71 checking for "falsy" lists in python will return false if the list is empty -- but we want to clear out the columns and filters if they are empty lists. 2023-03-20 17:47:52 -04:00
jasquat 94caddf9de send to task guid to signify how far to go with the tasks w/ burnettk 2023-03-20 17:29:53 -04:00
jasquat b957954d30 get task data from json data table now w/ burnettk 2023-03-20 17:05:15 -04:00
jasquat bc58de809e use task table for process instance show page. spiff steps are not working yet and neither is data w/ burnettk 2023-03-20 16:51:29 -04:00
jasquat 9765f74bc0 some more updates w/ burnettk 2023-03-20 12:04:22 -04:00
jasquat 50e4d27dbd Merge remote-tracking branch 'origin/main' into feature/remove_spif_step_details 2023-03-20 11:06:02 -04:00
jbirddog 0640836b39 Refresh process_instance after obtaining the background lock (#189) 2023-03-20 10:58:43 -04:00
jasquat 7a891c786d check if process initiator exists before running a process instance report w/ burnettk 2023-03-20 10:53:23 -04:00
jasquat 4c891903c4 some basic changes to test using tasks instead of spiff step details 2023-03-20 09:49:07 -04:00
jasquat 50acac8160 some more index updates and a new migration for it w/ burnettk 2023-03-17 16:52:05 -04:00
jasquat b6ddf3db3a added indexes to foreign key fields w/ burnettk 2023-03-17 16:26:35 -04:00
jasquat bc00f91570 some updates to db indexes w/ burnettk 2023-03-17 16:15:09 -04:00
jasquat f8856db032 removed spiff_logging w/ burnettk 2023-03-17 15:49:16 -04:00
jasquat 77e97d7a57 tasks can be skipped and manually executed w/ burnettk 2023-03-17 15:35:27 -04:00
jasquat 6a8676281c fixed tests 2023-03-17 14:03:21 -04:00
jasquat 3782864dc9 added event logs for skipping and manually editing a task 2023-03-17 13:51:56 -04:00
jasquat 88df3bd5c3 added process instance event table 2023-03-17 13:20:06 -04:00
jasquat 3461056beb Merge remote-tracking branch 'origin/main' into feature/use_tasks_as_logs 2023-03-17 12:40:26 -04:00
jbirddog 90aed76e21 UAT bug fix: suspended/terminated instances automagically resume (#186) 2023-03-17 11:55:11 -04:00
jasquat e0dbb6a768 updated log list view in frontend w/ burnettk 2023-03-17 10:30:29 -04:00
jasquat 363428df09 added bpmn_name columns to definition tables and added test for simple logs as well 2023-03-17 10:00:59 -04:00
burnettk 6bfce59fe3 lint 2023-03-16 22:59:42 -04:00
burnettk c4acbab343 fix all deprecation warnings 2023-03-16 22:42:35 -04:00
jasquat 4b96a0c453 add in missing fields to logs 2023-03-16 17:58:43 -04:00
jasquat d3393fc6d0 added bpmn process definition to bpmn process w/ burnettk 2023-03-16 16:59:37 -04:00
jasquat d75d66c33f pyl w/ burnettk 2023-03-16 16:18:02 -04:00
jasquat 5c0d72ab91 tests are now passing w/ burnettk 2023-03-16 16:14:41 -04:00
jbirddog ab75215a15 Retry locked user input submissions (#185) 2023-03-16 14:38:00 -04:00
jasquat 80d9fa8ad6 merged in save_to_task_data branch and pyl with some cleanup w/ burnettk 2023-03-16 12:50:52 -04:00
burnettk c305fa90a8 Merge remote-tracking branch 'origin/main' into feature/save_to_task_data 2023-03-16 12:12:31 -04:00
jasquat b0656f961f use box script engine to save everything into task data for time being w/ burnettk 2023-03-16 11:17:21 -04:00
Dan c565491936 don't overwrite the current user variable (passed as an argument to the function) with the initiator these values should be kept separate. 2023-03-16 11:07:56 -04:00
jasquat e3513073e9 some more test stuff w/ burnettk 2023-03-16 10:29:15 -04:00
jasquat bbdac3c586 some initial code to use tasks for logs 2023-03-16 09:30:25 -04:00
burnettk 4ae54958c9 lint 2023-03-16 00:07:39 -04:00
burnettk dc355e90e9 try to fix postgres and mysql group by 2023-03-16 00:02:02 -04:00
jasquat e305b22b5a increase line length from 88 to 119 for black w/ burnettk 2023-03-15 16:24:08 -04:00
jasquat a0eb492cd5 Merge remote-tracking branch 'origin/main' into feature/add_task_definition_to_task 2023-03-15 16:11:57 -04:00
jasquat 96989c676e fixed up tests and ran pyl w/ burnettk 2023-03-15 16:10:23 -04:00
jasquat bc619af0a0 check data when running main spiff test w/ burnettk 2023-03-15 15:38:58 -04:00
burnettk eb763342ce Merge remote-tracking branch 'origin/main' into feature/remove-loop-reset 2023-03-15 14:14:50 -04:00
burnettk 3b0135efe9 lint 2023-03-15 14:14:45 -04:00
jbirddog 12f0dc5315 Smaller locking window for the background processor (#183) 2023-03-15 12:32:55 -04:00
jasquat 2e9fa0e4b4 pyl and cleaned up debug code w/ burnettk 2023-03-15 12:15:48 -04:00
jasquat 14fc7debc1 all tests are passing w/ burnettk 2023-03-15 11:56:00 -04:00
jasquat ceca4d1333 unit tests are passing w/ burnettk 2023-03-15 11:25:15 -04:00
Elizabeth Esswein 7dd1747da7 remove ununsed variable 2023-03-15 11:10:02 -04:00
jbirddog 72d9ef9ad4 Provide more details in process instance locking errors (#181) 2023-03-15 10:52:06 -04:00
Elizabeth Esswein 2ba583577a Merge branch 'main' into feature/remove-loop-reset 2023-03-15 10:36:11 -04:00
jbirddog 569995aa46 Safe asserts (#180) 2023-03-14 20:22:57 -04:00
burnettk 1f2845962c exclude connexion logging even in debug mode 2023-03-14 18:10:49 -04:00
burnettk a38aa139a6 put back spiff step details for today 2023-03-14 17:54:20 -04:00
Dan Funk e16bcc055b Merge pull request #179 from sartography/bug/uat_fixes
Bug/uat fixes
2023-03-14 14:40:09 -04:00
Dan d7e7ee823b Remove nav from task show page 2023-03-14 13:24:12 -04:00
jbirddog 764eb35d1b Move process instance locking to new queue table (#177) 2023-03-14 13:12:01 -04:00
jasquat 7cd645846f do not write spiff step details to see how that changes performance 2023-03-14 10:51:12 -04:00
burnettk 620832e374 oops, meant to use info 2023-03-13 22:37:49 -04:00
burnettk 8bbacc2259 log connector 2023-03-13 22:25:30 -04:00
burnettk 90f0b5ff85 remove comment 2023-03-13 17:53:29 -04:00
jasquat d35c2a9f2d pyl w/ burnettk 2023-03-13 17:36:58 -04:00
jasquat 15784c0ea3 attempt to support on conflict inserts for postgres as well w/ burnettk 2023-03-13 17:35:03 -04:00
jasquat 2169fc598b works with mysql currently w/ burnettk 2023-03-13 17:25:21 -04:00
Dan Funk e196295c77 Merge pull request #174 from sartography/bug/filter_on_users
Bug/filter on users
2023-03-13 15:35:44 -04:00
jasquat 6a38328904 avoid additional db calls to get tasks and json data w/ burnettk 2023-03-13 15:23:12 -04:00
jasquat 80b9d4190a some updates to comments w/ burnettk 2023-03-13 14:42:39 -04:00
jasquat 285767bf5a pyl w/ burnettk 2023-03-13 14:04:03 -04:00
jasquat 1a25fbff88 our main test is passing w/ burnettk 2023-03-13 13:49:55 -04:00
Dan 75910bcb8d run_pyl 2023-03-13 11:53:42 -04:00
Dan ce3ce4fb45 select intiator in filters when you don't have permission to search users. 2023-03-13 11:50:18 -04:00
jasquat bc4a199248 load tasks all at once when instantiating a process instance w/ burnettk 2023-03-13 10:59:18 -04:00
burnettk c591dbfefe no op cipher for testing 2023-03-12 18:20:29 -04:00
jasquat 812e93047c fixed tests and added some comments for future fixes we will need with spiff without loop reset 2023-03-11 13:22:30 -05:00
burnettk 90fa5e50d3 undo much of our performance improvement, though hopefully using children will be more precise 2023-03-10 18:17:25 -05:00
burnettk 3855f168a4 set permissions does not run without this 2023-03-10 17:58:31 -05:00
jasquat 55c7100c50 removed print statement w/ burnettk 2023-03-10 16:56:21 -05:00
jasquat 7806e6c460 tests are now passing w/ burnettk 2023-03-10 16:52:57 -05:00
jasquat e13e703825 check task data on spiff tasks 2023-03-10 13:29:23 -05:00
jasquat 6d5c03a3d0 moved add_bpmn_process to task_service w/ burnettk 2023-03-10 12:23:27 -05:00
jasquat 66a6c0449a added subprocess and call activity to task data bpmn file and the test is passing now 2023-03-10 10:46:40 -05:00
burnettk 513871ad21 get bpmn process for spiff task by guid or from the process instance 2023-03-09 22:37:45 -05:00
burnettk eeadd9296f Merge remote-tracking branch 'origin/main' into feature/save_tasks_one_at_a_time 2023-03-09 22:07:11 -05:00
Elizabeth Esswein 83702b6588 update process instance task list 2023-03-09 18:10:24 -05:00
jasquat ec52e85f04 added comment 2023-03-09 17:23:08 -05:00
jasquat 7e44c90fbb the primary test is passing now but subprocesses and call activities are probably broken w/ burnettk 2023-03-09 17:16:44 -05:00
Dan 3879ea4f3a run_pyl 2023-03-09 16:10:31 -05:00
Dan 79a17ec829 Adding a new test for error handing to assure this doesn't break in the future, and cleaning up the message call event.
Will also need to update the error handling BPMN process so it provides correlation keys.  We should add a task that will
alert you when you create a message object without setting correlation keys - as they are required per the specification.
2023-03-09 15:27:35 -05:00
jbirddog 4ce715fec8 Strategy based engine step execution (#168) 2023-03-09 11:38:18 -05:00
Elizabeth Esswein 2ecfecb9b4 Merge branch 'main' into feature/remove-loop-reset 2023-03-09 09:55:52 -05:00
jbirddog abc2e5aac8 Balance lock with unlock (#169) 2023-03-09 08:03:18 -05:00
burnettk 157e0004bd make logging more verbose in debug mode by making all loggers do something, fix cypress 2023-03-09 00:38:29 -05:00
burnettk e1a0d5f9e5 avoid python 3.10 syntax for unions 2023-03-08 17:07:33 -05:00
jasquat 8fb62ba123 do not remove columns when clicking the filter button w/ burnettk 2023-03-08 16:57:12 -05:00
jasquat 65aeca98bc initial changes to remove loop reset with spiff w/ burnettk 2023-03-08 13:06:25 -05:00
burnettk d45b9d1ff5 measure decryption time 2023-03-07 23:50:32 -05:00
jasquat cc57e6c97d added some code get only the most recent tasks for a process and task, get updated times from human tasks instead of the process instance, and show the current value for the notification type w/ burnettk 2023-03-07 17:13:46 -05:00
jasquat 1febfdd024 Merge pull request #166 from sartography/feature/split_up_bpmn_json
Feature/split up bpmn json
2023-03-07 14:11:23 -05:00
jasquat 4344e015ca check if aud has any valid value when authing w/ burnettk 2023-03-07 11:58:59 -05:00
jasquat 0f23a1b4d9 Merge remote-tracking branch 'origin/main' into feature/split_up_bpmn_json 2023-03-07 10:48:37 -05:00
jasquat 762116f258 Merge pull request #167 from sartography/simple_crypt
Encrypt secrets in the db
2023-03-07 10:48:24 -05:00
jasquat 87bacbdaaf added some timestamp fields to bpmn process tables w/ burnettk 2023-03-07 10:41:54 -05:00
Jon Herron c1a9168964 Cleanup 2023-03-07 10:00:16 -05:00
Jon Herron 0fa44d3d80 Don't double encrypt when updating/add if not exists 2023-03-07 09:53:19 -05:00
jasquat adcb5134b6 a little cleanup of comments 2023-03-07 09:28:38 -05:00
jasquat 32e61027dc merged in main and resolved conflicts 2023-03-07 09:19:09 -05:00
jasquat 1cfeb32c3b move common script errors to script so it can keep the error messaging consistent across scripts 2023-03-07 09:17:32 -05:00
jasquat 66e254a3b0 fixed mypy issues 2023-03-07 09:05:06 -05:00
burnettk d5800c5a40 lint and show version control identifier on process model show 2023-03-06 23:23:10 -05:00
Jon Herron ec53ab8717 Fix secret getting reset when decrypted in get_secret 2023-03-06 20:40:08 -05:00
Jon Herron 3cc117dbb6 Getting ./bin/pyl to pass 2023-03-06 19:36:37 -05:00
Jon Herron 6dfb096a5e Encrypt/decrypt secrets 2023-03-06 19:07:08 -05:00
jasquat 3a961753db pyl w/ burnettk 2023-03-06 17:30:35 -05:00
jasquat 240c2372d2 avoid calling task_definition and bpmn_process_definition more than we need to w/ burnettk 2023-03-06 17:24:01 -05:00
Dan bc225fcea8 Just some minor stuff:
1) Don't overwrite the message of all Workflow Task Exceptions to say "Something went wrong"
2) log errors when correlation evaluations fail (just so we are aware something isn't working correctly)
3) Dont make all evaluation fuctions require a current task context to execute -- that should be optional.
2023-03-06 17:07:04 -05:00
jasquat 94776a78b5 some minor tweaks and turn off debug logging for spiff step details w/ burnettk 2023-03-06 16:16:55 -05:00
jasquat 20e083ddc4 Merge remote-tracking branch 'origin/main' into feature/split_up_bpmn_json 2023-03-06 14:29:44 -05:00
jasquat b30ed8f3c1 pyl 2023-03-06 14:28:55 -05:00
jasquat 628dc14d7c make sure we set the subprocesses correctly in the bpmn dict w/ burnettk 2023-03-06 13:03:18 -05:00
Dan dfe0280237 Minor fix to avoid an endless set of error messages if your session times out and you are using the builtin openid. 2023-03-06 12:50:18 -05:00
jasquat 4ee7b299f2 pyl and fixed cypress tests w/ burnettk 2023-03-06 11:59:33 -05:00
jasquat 96ef81af34 merged in main and resolved conflicts w/ burnettk 2023-03-06 11:15:16 -05:00
jasquat e55485bd4a removed process instance data and serialized bpmn definition models w/ burnettk 2023-03-06 11:13:53 -05:00
jasquat 6acd47e67e tests are passing with new db tables w/ burnettk 2023-03-06 11:06:03 -05:00
jasquat 2cdacfa03b some stuff is passing but still needs the process_instance_data w/ burnettk 2023-03-03 16:51:24 -05:00
burnettk 14e12645c4 get longblob on mysql, reset migrations since we are going to do that anyway in hours 2023-03-03 14:04:02 -05:00
jasquat 40a3515d4e Merge remote-tracking branch 'origin/main' into feature/split_up_bpmn_json 2023-03-03 13:04:26 -05:00
jbirddog b4546e86e6 Special case file data during user form submission (#164) 2023-03-03 12:24:18 -05:00
jasquat f7c46cd945 recreated branch migration w/ burnettk 2023-03-03 12:08:36 -05:00
jasquat 8c60080663 set the collation on the db directly and not in the models w/ burnettk 2023-03-03 12:05:12 -05:00
jasquat 276e6d5f37 recreate migrations to set case sensitive columns for mysql w/ burnettk 2023-03-03 11:41:34 -05:00
jasquat d7f4c8ba95 clean up bpmn process definition save code a bit w/ burnettk 2023-03-03 11:24:28 -05:00
jasquat e7950456e9 all tests are passing with new spec tables w/ burnettk 2023-03-03 10:20:26 -05:00
jasquat 0c6e9a63ba unit tests are passing with the new spec tables 2023-03-03 10:08:14 -05:00
jasquat 8d67e8cc87 we can save the top level spec to the database with its tasks w/ burnettk 2023-03-02 17:28:31 -05:00
jasquat 971de5cb7c created models to hold the bpmn_json w/ burnettk 2023-03-02 16:31:21 -05:00
jasquat 6e23a179b7 wait 120 seconds before processing user_input_required process instances w/ burnettk 2023-03-02 12:06:12 -05:00
burnettk 612d63f141 Merge branch 'main' of github.com:sartography/spiff-arena 2023-03-02 10:43:05 -05:00
burnettk 5cbffe2e96 allow open id to come in via env 2023-03-02 10:43:02 -05:00
jasquat 989c0932cd some pyl issues 2023-03-02 10:06:05 -05:00
jasquat cf9b796e1a avoid creating new processors if it is not necessary 2023-03-02 10:00:08 -05:00
Kevin Burnett 64b51a0792 Merge pull request #163 from sartography/feature/process_name_for_log_list
prefer the bpmn process name over the identifier on the logs list pag…
2023-03-01 14:21:37 -08:00
jasquat 695e51a1fb use workflow_spec to match task_spec naming w/ burnettk 2023-03-01 17:21:24 -05:00
jasquat 90b1772215 do not require task to be given to evaluate a task unless that script specifically needs it w/ burnettk 2023-03-01 17:18:58 -05:00
jasquat 716986a483 prefer the bpmn process name over the identifier on the logs list page w/ burnettk 2023-03-01 16:28:42 -05:00
jasquat dcb2a23baa Merge pull request #162 from sartography/feature/move_task_data_into_tables
Feature/move bpmn_json data into separate tables
2023-03-01 15:56:51 -05:00
jasquat 76e654ca60 remove some debug code w/ burnettk 2023-03-01 15:38:05 -05:00
jasquat 53486823b6 always save the serialized bpmn definition for now w/ burnettk 2023-03-01 15:01:29 -05:00
Dan be482ea6bc Don't attempt to gather the augmented methods if no task is provided -- if we aren't working within the context of a task, we are not working in a context where augmented methods can work (at least not all of them). This was causing an error when attepting to use the custom engine to execute extraction expressions on messages. 2023-03-01 13:46:20 -05:00
jasquat d1b8de9ea3 pyl 2023-03-01 12:35:08 -05:00
jasquat b54ace56a2 fixed get call activity task data w/ burnettk 2023-03-01 12:23:04 -05:00
jasquat e2891425fc store the process instance data id on the process instance and not the other way around w/ burnettk 2023-03-01 11:39:03 -05:00
jasquat ab50e7ac03 all backend tests except for report tests are now passing 2023-03-01 10:58:12 -05:00
jasquat 035475f58f unit tests are passing except for test_process_instance_report which cannot work currently 2023-03-01 10:36:11 -05:00
jasquat 6257a402db save full_bpmn_json in a var 2023-03-01 09:55:20 -05:00
jasquat abe21db517 must add data to db 2023-03-01 09:42:41 -05:00
jasquat 950106fe21 most unit tests are passing now and the use of bpmn_json is almost gone in src 2023-03-01 09:22:38 -05:00
jasquat f74ce0f568 some logic to attempt to use the new bpmn json tables w/ burnettk 2023-02-28 17:46:14 -05:00
jasquat d5acd5a16d added new table and some notes on how to get a delta w/ burnettk jbirddog 2023-02-28 16:30:52 -05:00
jasquat 27f3da2458 added config to turn on sentry profiling w/ burnettk 2023-02-28 11:23:50 -05:00
jasquat b00de0d1a7 fixed python 3.9 syntax issue 2023-02-28 08:56:44 -05:00
burnettk 350daf0b3d allow task_name to be long 2023-02-27 22:01:08 -05:00
burnettk a1ec494ab3 let env var work on windows and fixing typing issue on python 3.9 w/ messaging stuff 2023-02-27 19:16:06 -05:00
jasquat 35c93e3f7e do not return human tasks from errored process instances w/ burnettk 2023-02-27 16:11:26 -05:00
jasquat 09a46712d4 added debug logging when adding spiff step details w/ burnettk 2023-02-27 15:53:56 -05:00
jasquat dfac872606 Merge remote-tracking branch 'origin/main' into feature/script_get_last_user_completing_task 2023-02-27 14:28:23 -05:00
jasquat 29ada38904 added script to get process initiator w/ burnettk 2023-02-27 14:28:19 -05:00
Dan f16150b02b Merging main 2023-02-27 14:17:10 -05:00
Dan 150b95070c run_pyl 2023-02-27 14:05:00 -05:00
Dan e060e28c28 Needed an additional check for empty correlation keys - which on a RECEIVE message, should always match anything.
When finding messages to match a send, assure they are RECIEVE messages.

Fix some of the json output for messages sent to the front end
2023-02-27 14:01:21 -05:00
jasquat 9f84564457 script to get last user completing a task is working w/ burnettk 2023-02-27 12:08:07 -05:00
burnettk e9b3ababc1 wip for get_last_user_completing_task script task 2023-02-25 23:31:23 -05:00
jasquat b71419616d removed some unused code from task and fixed the logs table a bit w/ burnettk 2023-02-24 16:18:49 -05:00
Dan ff069cb862 run_pyl 2023-02-24 15:02:03 -05:00
jasquat 425cf3f8c1 skip failing test if postgres and added comment about cause w/ burnettk 2023-02-24 14:57:17 -05:00
Dan 0dc2bc3316 # SpiffWorkflow:
1) Type Safe checking on correlation properties (no more str())
2) A running workflows Correlations are once again at the key level.

# Backend
1) Both send and receive messages can have correlation_keys - and we compare these to each other to quickly assure a match (if they both exist - otherwise we fall back to comparing the properties on the receive to the sending messages payload)
2) Cleaned up the migrations to just one file
2023-02-24 14:53:22 -05:00
jasquat d5712a915c look users up by service and username instead of service_id since usernames have to be unique anyway w/ burnettk 2023-02-24 10:41:57 -05:00
jasquat 7a1e712c14 avoid using task-data endpoint for task data and only use it to get tasks based on spiff step instead 2023-02-24 09:21:21 -05:00
jasquat 4651eaee94 put back the task data code when getting tasks 2023-02-23 18:32:59 -05:00
jasquat 1f95fe7037 Merge remote-tracking branch 'origin/main' into feature/task_data_api_refactor 2023-02-23 17:10:23 -05:00
jasquat d53b79b18a removed commented out code w/ burnettk 2023-02-23 17:09:33 -05:00
jasquat a4c1eb96b5 removed task-data endpoints since we no longer need them w/ burnettk 2023-02-23 17:07:53 -05:00
burnettk 441bd62652 turn off profiling again 2023-02-23 16:54:38 -05:00
Dan 5a3b4b8792 BPMN Parser was returning all retrieval expressions, rather than the ones specific to a correlation property, as was intended.
Adding a correlation cache - so we have a reference of all the messages and properties (though still lacking a description of keys)
Adding yet another migration, maybe should squash em.
2023-02-23 16:36:32 -05:00
jasquat a9694c7678 added api to get task data and do not return from task data list anymore w/ burnettk 2023-02-23 15:59:19 -05:00
Dan 0d468a825a run_pyl (part 2) 2023-02-23 15:09:22 -05:00
jasquat 15b00bcceb Merge branch 'main' of github.com:sartography/spiff-arena 2023-02-23 15:06:27 -05:00
jasquat 68a5fe3f16 added comment about refactoring getting task data w/ burnettk jbirddog 2023-02-23 15:06:23 -05:00
burnettk 973be69df5 add test users 2023-02-23 14:58:14 -05:00
jasquat 49fb41eff9 remove task size check since it can take a long time to run and we do not do anything with it w/ burnettk jbirddog 2023-02-23 14:41:45 -05:00
Dan 7c12dffe41 Merge remote-tracking branch 'origin/main' into feature/message_fixes 2023-02-23 14:26:04 -05:00
Dan 0030a46938 run_pyl 2023-02-23 14:17:22 -05:00
Dan 0f3ef00d72 BPMN.io -- Just show the message names not the ids - to assure we are only exposing the names.
SpiffWorkflow -
    - start_messages function should return message names, not ids.
    - don't catch external thrown messages within the same workflow process
    - add an expected value to the Correlation Property Model so we can use this well defined class as an external communication tool (rather than building an arbitrary dictionary)
    - Added a "get_awaiting_correlations" to an event, so we can get a list of the correlation properties related to the workflows currently defined correlation values.
    - workflows.waiting_events() function now returns the above awaiting correlations as the value on returned message events
 Backend
    - Dropping MessageModel and MessageCorrelationProperties - at least for now.  We don't need them to send / receive messages though we may eventually want to track the messages and correlations defined across the system - these things (which are ever changing) should not be directly connected to the Messages which may be in flux - and the cross relationships between the tables could cause unexpected and unceissary errors.  Commented out the caching logic so we can turn this back on later.
    - Slight improvement to API Errors
    - MessageInstances are no longer in a many-to-many relationship with Correlations - Each message instance has a unique set of message correlations specific to the instance.
    - Message Instances have users, and can be linked through a "counterpart_id" so you can see what send is connected to what recieve.
    - Message Correlations are connected to  recieving message instances.  It is not to a process instance, and not to a message model.  They now include the expected value and retrieval expression required to validate an incoming message.
    - A process instance is not connected to message correlations.
    - Message Instances are not always tied to a process instance (for example, a Send Message from an API)
    - API calls to create a message use the same logic as all other message catching code.
    - Make use of the new waiting_events() method to check for any new recieve messages in the workflow (much easier than
    churning through all of the tasks)
    - One giant mother of a migration.
2023-02-23 13:53:03 -05:00
jasquat 216bd799bf do not call serialize if we can use the cached bpmn_json instead w/ burnettk 2023-02-23 13:48:27 -05:00
jasquat 2bf31fc135 turn on sentry detailed tracing for task-data w/ burnettk 2023-02-23 11:19:22 -05:00
Kevin Burnett c65aeafbe3 Merge pull request #145 from sartography/data_size_script
Data size script
2023-02-22 17:36:31 -08:00
jasquat 9b14510cd1 Merge branch 'main' of github.com:sartography/spiff-arena 2023-02-22 14:42:46 -05:00
jasquat c6b45dbdc3 show help text for textareas as well w/ burnettk 2023-02-22 14:42:43 -05:00
burnettk 9fb490c7f9 why not dict, too 2023-02-22 14:36:26 -05:00
Jon Herron 7fe8955adf Cleanup 2023-02-22 13:42:45 -05:00
Jon Herron 7f2d69163e Getting ./bin/pyl to pass 2023-02-22 13:34:26 -05:00
Jon Herron 488abc03ea Provide info about keys in task data and python env 2023-02-22 13:13:28 -05:00
Jon Herron 2afc19175e Unfactor to fix size calculation/type hint issues 2023-02-22 11:17:23 -05:00
Jon Herron a4c0dd52ae Getting ./bin/pyl to pass 2023-02-22 11:04:07 -05:00
Jon Herron d5fa8eae21 Adding python env size 2023-02-22 10:55:09 -05:00
Jon Herron 2fa4623876 Add cumulative task data size to script 2023-02-22 10:39:35 -05:00
burnettk bb6dd35bbd remove start and end events from simple logs view 2023-02-21 22:43:23 -05:00
burnettk 54248ca568 copy env so we are doing additive stuff rather than completely rewriting it 2023-02-21 22:00:02 -05:00