b4b54f3fff
do not save predicted tasks to the db w/ burnettk
2023-03-30 12:41:42 -04:00
31cb1ab27c
remove pdb w/ burnettk
2023-03-30 11:16:44 -04:00
e3b8653296
added an init method to task service and move a lot of code from workflow execution to it and fixed up the task running test to check things more thoroughly
2023-03-30 11:15:27 -04:00
edc0ea83fa
Merge remote-tracking branch 'origin/main' into feature/fix_process_instance_rewind
2023-03-30 07:51:05 -04:00
1ee8ba252e
check if data file value is a string before returning it w/ burnettk
2023-03-29 16:49:33 -04:00
7bb7543a42
import missing lib w/ burnettk
2023-03-29 16:03:45 -04:00
cdf5fc313a
use text for sql
2023-03-29 15:51:04 -04:00
82ec34e00b
i am terrible
2023-03-29 14:18:37 -04:00
b7d154ff02
delete postgres container if it is there
2023-03-29 14:17:26 -04:00
5844cea958
exact match
2023-03-29 13:47:03 -04:00
a7521cba65
run snyk on backend and added marshmallow dep to remove warning w/ burnettk
2023-03-28 16:55:13 -04:00
32029a644b
Merge pull request #198 from sartography/feature/safety
...
Feature/safety
2023-03-28 16:32:58 -04:00
98a935e222
use session delete branch of sqlalchemy stubs w/ burnettk
2023-03-28 16:28:41 -04:00
14927c5271
remove unnecessary libs from pyproject in root of arena w/ burnettk
2023-03-28 16:12:27 -04:00
a878790393
add back in sqlalchemy stubs w/ burnettk
2023-03-28 16:05:43 -04:00
2cb07478c4
Merge pull request #196 from sartography/bugfix/use-spiff-business-rule-task
...
import parser from spiff package
2023-03-28 16:02:56 -04:00
e7fef5b6c4
updated sqlalchemy to 2.0 due to safety complaints w/ burnettk
2023-03-28 15:56:00 -04:00
1ee6753c28
Merge remote-tracking branch 'origin/main' into feature/fix_process_instance_rewind
2023-03-28 15:07:36 -04:00
9a3f50d5fc
some more debugging
2023-03-28 15:07:31 -04:00
16b837daca
downgrade setuptools closer to where it was to avoid deprecation warnings
2023-03-28 14:58:16 -04:00
3371148d4a
fix four of five safety issues
2023-03-28 14:51:08 -04:00
141bb4fcb8
kill commented out code
2023-03-28 11:22:42 -04:00
fa5ded0f26
get backend working with new spiff
2023-03-28 10:33:53 -04:00
01f8bc0f87
fix all sonar bugs
2023-03-28 10:05:29 -04:00
68ff38e65c
Merge remote-tracking branch 'origin/main' into feature/fix_process_instance_rewind
2023-03-28 08:27:56 -04:00
fdd6d92506
resolved merge conflicts
2023-03-28 08:24:53 -04:00
3ce25bba7e
some more attempts to get reset working
2023-03-28 08:23:09 -04:00
5a57fc34b9
remove second, conflicting madhurya account
2023-03-28 08:07:54 -04:00
21a97fb4cf
lint
2023-03-28 08:04:42 -04:00
e6cb06c4a3
Merge remote-tracking branch 'origin/main' into feature/fix_process_instance_rewind
2023-03-27 20:27:19 -04:00
151cb13255
task_guid is a str, thanks, typeguard
2023-03-27 20:22:12 -04:00
4a092a8e2a
tests have been broken in ci, and this should fix it
2023-03-27 17:02:29 -04:00
7e32c800ac
import parser from spiff package
2023-03-27 16:13:17 -04:00
2df8d3eabb
Merge remote-tracking branch 'origin/main' into feature/fix_process_instance_rewind
2023-03-27 16:10:26 -04:00
f0681aec28
Handle the multiple single file upload widget case ( #195 )
2023-03-27 16:03:22 -04:00
e54b97ab2e
Merge branch 'main' of github.com:sartography/spiff-arena
2023-03-27 15:42:30 -04:00
6a6a3f0413
moved common admin users to admin user script w/ burnettk
2023-03-27 15:42:26 -04:00
8c481f29fb
Merge pull request #194 from sartography/feature/filter-metadata-columns-by-process-model
...
Feature/filter metadata columns by process model
2023-03-27 12:37:24 -07:00
4d341cf8e4
do not allow uploading a user to keycloak that matches admin user that the script is using w/ burnettk
2023-03-27 14:09:08 -04:00
7b7f9f8e3a
user cleanup
2023-03-27 11:22:53 -04:00
1ae29c1599
process children and tasks of parent subprocesses instead of looking for all tasks with a given state w/ burnettk
2023-03-27 10:37:31 -04:00
a263696758
add test for filtering columns and clarify that we are doing unit tests with api, whoops
2023-03-24 18:11:11 -04:00
54927ef62c
filter report column list by process_model_identifier if any
2023-03-24 17:54:37 -04:00
85626ba399
couple fixes for running a process model from script w/ burnettk
2023-03-24 12:09:27 -04:00
29b33fe2f1
removed debug comment w/ burnettk
2023-03-24 11:11:44 -04:00
af648c9c32
Merge remote-tracking branch 'origin/main' into feature/remove_spif_step_details
2023-03-24 09:10:44 -04:00
0ae74f8f35
removed spiff step details w/ burnettk
2023-03-23 16:33:30 -04:00
94cd732ebd
save timestamps when manually completing a task and some cleanup w/ burnettk
2023-03-23 16:07:25 -04:00
3f49f912ea
pyl passes w/ burnettk
2023-03-23 15:16:39 -04:00
77ae760586
fixed editing task data and skipping tasks, moved task and task data methods from process_api_blueprint to tasks_controller, and updated to favor task_guid over task_id in some places
2023-03-23 14:28:20 -04:00
9b5f4c8243
lint
2023-03-23 14:25:45 -04:00
9e89c13a65
add test user to keycloak
2023-03-23 14:24:41 -04:00
f45f2c1cc6
added link to go back to most recent
2023-03-23 13:55:16 -04:00
46b49bbfe3
Merge remote-tracking branch 'origin/main' into feature/remove_spif_step_details
2023-03-23 13:02:42 -04:00
7a14a58518
commented out reset process code and added comment and raise until we get it actually working and fixed issue with viewing at completed task where it was not including the tasks for the parent bpmn processes
2023-03-23 10:44:09 -04:00
c2612b873f
added check result function when running a process model from the shell script
2023-03-23 07:41:59 -04:00
152be789ec
another take on metrics
2023-03-22 22:40:56 -04:00
bf84d48a69
added script to create and run a process model w/ burnettk
2023-03-22 15:52:00 -04:00
722680a5ac
some more debugging for resetting a process to specific task w/ burnettk
2023-03-22 14:39:04 -04:00
5ddde2aeaa
Merge remote-tracking branch 'origin/main' into feature/remove_spif_step_details
2023-03-22 13:53:51 -04:00
2fe0300b81
do not fail if cannot get a token for a user in login w/ burnettk
2023-03-22 12:22:27 -04:00
61da3d6b6f
updated manual task with subprocess bpmn w/ burnettk
2023-03-22 10:45:40 -04:00
26af07befd
resetting tasks somewhat work
2023-03-22 09:44:13 -04:00
034201b01c
pyl
2023-03-21 13:34:59 -04:00
3bf1c49a75
Merge remote-tracking branch 'origin/main' into feature/remove_spif_step_details
2023-03-21 12:17:52 -04:00
a1f546ba16
add SPIFFWORKFLOW_BACKEND_SENTRY_ENV_IDENTIFIER config
2023-03-21 11:29:14 -04:00
8baa38d22b
use consistent types for tasks in webui instance show page and mark the to task guid task as ready in backend
2023-03-21 10:45:10 -04:00
992648f087
Optimisticly skip locking/background processing ( #190 )
2023-03-21 09:37:10 -04:00
b1e9e8fabe
Merge remote-tracking branch 'origin/main' into feature/remove_spif_step_details
2023-03-21 09:05:03 -04:00
f9a7b3cb71
checking for "falsy" lists in python will return false if the list is empty -- but we want to clear out the columns and filters if they are empty lists.
2023-03-20 17:47:52 -04:00
94caddf9de
send to task guid to signify how far to go with the tasks w/ burnettk
2023-03-20 17:29:53 -04:00
b957954d30
get task data from json data table now w/ burnettk
2023-03-20 17:05:15 -04:00
bc58de809e
use task table for process instance show page. spiff steps are not working yet and neither is data w/ burnettk
2023-03-20 16:51:29 -04:00
9765f74bc0
some more updates w/ burnettk
2023-03-20 12:04:22 -04:00
50e4d27dbd
Merge remote-tracking branch 'origin/main' into feature/remove_spif_step_details
2023-03-20 11:06:02 -04:00
0640836b39
Refresh process_instance after obtaining the background lock ( #189 )
2023-03-20 10:58:43 -04:00
7b3eb4730f
fixed broken test w/ burnettk
2023-03-20 10:55:57 -04:00
7a891c786d
check if process initiator exists before running a process instance report w/ burnettk
2023-03-20 10:53:23 -04:00
4c891903c4
some basic changes to test using tasks instead of spiff step details
2023-03-20 09:49:07 -04:00
50acac8160
some more index updates and a new migration for it w/ burnettk
2023-03-17 16:52:05 -04:00
b6ddf3db3a
added indexes to foreign key fields w/ burnettk
2023-03-17 16:26:35 -04:00
bc00f91570
some updates to db indexes w/ burnettk
2023-03-17 16:15:09 -04:00
3ca165bb94
recreated migrations to remove spiff logging w/ burnettk
2023-03-17 15:50:05 -04:00
f8856db032
removed spiff_logging w/ burnettk
2023-03-17 15:49:16 -04:00
77e97d7a57
tasks can be skipped and manually executed w/ burnettk
2023-03-17 15:35:27 -04:00
6a8676281c
fixed tests
2023-03-17 14:03:21 -04:00
3782864dc9
added event logs for skipping and manually editing a task
2023-03-17 13:51:56 -04:00
88df3bd5c3
added process instance event table
2023-03-17 13:20:06 -04:00
3461056beb
Merge remote-tracking branch 'origin/main' into feature/use_tasks_as_logs
2023-03-17 12:40:26 -04:00
90aed76e21
UAT bug fix: suspended/terminated instances automagically resume ( #186 )
2023-03-17 11:55:11 -04:00
e0dbb6a768
updated log list view in frontend w/ burnettk
2023-03-17 10:30:29 -04:00
363428df09
added bpmn_name columns to definition tables and added test for simple logs as well
2023-03-17 10:00:59 -04:00
3614ec19c6
add user
2023-03-17 09:42:38 -04:00
6bfce59fe3
lint
2023-03-16 22:59:42 -04:00
c4acbab343
fix all deprecation warnings
2023-03-16 22:42:35 -04:00
4b96a0c453
add in missing fields to logs
2023-03-16 17:58:43 -04:00
d3393fc6d0
added bpmn process definition to bpmn process w/ burnettk
2023-03-16 16:59:37 -04:00
d75d66c33f
pyl w/ burnettk
2023-03-16 16:18:02 -04:00
4379919440
add finance.project-lead user
2023-03-16 16:16:02 -04:00
5c0d72ab91
tests are now passing w/ burnettk
2023-03-16 16:14:41 -04:00
ab75215a15
Retry locked user input submissions ( #185 )
2023-03-16 14:38:00 -04:00
80d9fa8ad6
merged in save_to_task_data branch and pyl with some cleanup w/ burnettk
2023-03-16 12:50:52 -04:00
d36256fef7
fix two issues, one where we were not sorting after globbing, and another where we forgot about process groups
2023-03-16 12:34:44 -04:00
c305fa90a8
Merge remote-tracking branch 'origin/main' into feature/save_to_task_data
2023-03-16 12:12:31 -04:00
b0656f961f
use box script engine to save everything into task data for time being w/ burnettk
2023-03-16 11:17:21 -04:00
c565491936
don't overwrite the current user variable (passed as an argument to the function) with the initiator these values should be kept separate.
2023-03-16 11:07:56 -04:00
e3513073e9
some more test stuff w/ burnettk
2023-03-16 10:29:15 -04:00
bbdac3c586
some initial code to use tasks for logs
2023-03-16 09:30:25 -04:00
4ae54958c9
lint
2023-03-16 00:07:39 -04:00
dc355e90e9
try to fix postgres and mysql group by
2023-03-16 00:02:02 -04:00
e305b22b5a
increase line length from 88 to 119 for black w/ burnettk
2023-03-15 16:24:08 -04:00
e8e4eab44b
use main branch of spiffworkflow w/ burnettk
2023-03-15 16:15:15 -04:00
a0eb492cd5
Merge remote-tracking branch 'origin/main' into feature/add_task_definition_to_task
2023-03-15 16:11:57 -04:00
96989c676e
fixed up tests and ran pyl w/ burnettk
2023-03-15 16:10:23 -04:00
bc619af0a0
check data when running main spiff test w/ burnettk
2023-03-15 15:38:58 -04:00
eb763342ce
Merge remote-tracking branch 'origin/main' into feature/remove-loop-reset
2023-03-15 14:14:50 -04:00
3b0135efe9
lint
2023-03-15 14:14:45 -04:00
12f0dc5315
Smaller locking window for the background processor ( #183 )
2023-03-15 12:32:55 -04:00
2e9fa0e4b4
pyl and cleaned up debug code w/ burnettk
2023-03-15 12:15:48 -04:00
14fc7debc1
all tests are passing w/ burnettk
2023-03-15 11:56:00 -04:00
ceca4d1333
unit tests are passing w/ burnettk
2023-03-15 11:25:15 -04:00
7dd1747da7
remove ununsed variable
2023-03-15 11:10:02 -04:00
72d9ef9ad4
Provide more details in process instance locking errors ( #181 )
2023-03-15 10:52:06 -04:00
2ba583577a
Merge branch 'main' into feature/remove-loop-reset
2023-03-15 10:36:11 -04:00
569995aa46
Safe asserts ( #180 )
2023-03-14 20:22:57 -04:00
1f2845962c
exclude connexion logging even in debug mode
2023-03-14 18:10:49 -04:00
a38aa139a6
put back spiff step details for today
2023-03-14 17:54:20 -04:00
40b23c31c7
add list with just one user for bootstrapping
2023-03-14 15:08:10 -04:00
e16bcc055b
Merge pull request #179 from sartography/bug/uat_fixes
...
Bug/uat fixes
2023-03-14 14:40:09 -04:00
d7e7ee823b
Remove nav from task show page
2023-03-14 13:24:12 -04:00
764eb35d1b
Move process instance locking to new queue table ( #177 )
2023-03-14 13:12:01 -04:00
7cd645846f
do not write spiff step details to see how that changes performance
2023-03-14 10:51:12 -04:00
620832e374
oops, meant to use info
2023-03-13 22:37:49 -04:00
8bbacc2259
log connector
2023-03-13 22:25:30 -04:00
90f0b5ff85
remove comment
2023-03-13 17:53:29 -04:00
d35c2a9f2d
pyl w/ burnettk
2023-03-13 17:36:58 -04:00
15784c0ea3
attempt to support on conflict inserts for postgres as well w/ burnettk
2023-03-13 17:35:03 -04:00
2169fc598b
works with mysql currently w/ burnettk
2023-03-13 17:25:21 -04:00
e196295c77
Merge pull request #174 from sartography/bug/filter_on_users
...
Bug/filter on users
2023-03-13 15:35:44 -04:00
6a38328904
avoid additional db calls to get tasks and json data w/ burnettk
2023-03-13 15:23:12 -04:00
80b9d4190a
some updates to comments w/ burnettk
2023-03-13 14:42:39 -04:00
285767bf5a
pyl w/ burnettk
2023-03-13 14:04:03 -04:00
1a25fbff88
our main test is passing w/ burnettk
2023-03-13 13:49:55 -04:00
75910bcb8d
run_pyl
2023-03-13 11:53:42 -04:00
ce3ce4fb45
select intiator in filters when you don't have permission to search users.
2023-03-13 11:50:18 -04:00
bc4a199248
load tasks all at once when instantiating a process instance w/ burnettk
2023-03-13 10:59:18 -04:00
c591dbfefe
no op cipher for testing
2023-03-12 18:20:29 -04:00
812e93047c
fixed tests and added some comments for future fixes we will need with spiff without loop reset
2023-03-11 13:22:30 -05:00
90fa5e50d3
undo much of our performance improvement, though hopefully using children will be more precise
2023-03-10 18:17:25 -05:00
3855f168a4
set permissions does not run without this
2023-03-10 17:58:31 -05:00
2ef0bf0065
added loop to task test bpmn file w/ burnettk
2023-03-10 17:15:27 -05:00
55c7100c50
removed print statement w/ burnettk
2023-03-10 16:56:21 -05:00
7806e6c460
tests are now passing w/ burnettk
2023-03-10 16:52:57 -05:00
e13e703825
check task data on spiff tasks
2023-03-10 13:29:23 -05:00
6d5c03a3d0
moved add_bpmn_process to task_service w/ burnettk
2023-03-10 12:23:27 -05:00
6158733b59
Merge remote-tracking branch 'origin/main' into feature/save_tasks_one_at_a_time
2023-03-10 10:58:41 -05:00
66a6c0449a
added subprocess and call activity to task data bpmn file and the test is passing now
2023-03-10 10:46:40 -05:00
91ddb0cbdd
add keycloak users
2023-03-10 10:27:29 -05:00
8f1975d7e2
Bump SpiffWorkflow ( #171 )
2023-03-10 10:21:07 -05:00
513871ad21
get bpmn process for spiff task by guid or from the process instance
2023-03-09 22:37:45 -05:00
eeadd9296f
Merge remote-tracking branch 'origin/main' into feature/save_tasks_one_at_a_time
2023-03-09 22:07:11 -05:00
83702b6588
update process instance task list
2023-03-09 18:10:24 -05:00
ec52e85f04
added comment
2023-03-09 17:23:08 -05:00
7e44c90fbb
the primary test is passing now but subprocesses and call activities are probably broken w/ burnettk
2023-03-09 17:16:44 -05:00
3879ea4f3a
run_pyl
2023-03-09 16:10:31 -05:00
79a17ec829
Adding a new test for error handing to assure this doesn't break in the future, and cleaning up the message call event.
...
Will also need to update the error handling BPMN process so it provides correlation keys. We should add a task that will
alert you when you create a message object without setting correlation keys - as they are required per the specification.
2023-03-09 15:27:35 -05:00
4ce715fec8
Strategy based engine step execution ( #168 )
2023-03-09 11:38:18 -05:00
2464ad9a26
some updates for cypress pp1 test w/ burnettk
2023-03-09 10:59:20 -05:00
2ecfecb9b4
Merge branch 'main' into feature/remove-loop-reset
2023-03-09 09:55:52 -05:00
abc2e5aac8
Balance lock with unlock ( #169 )
2023-03-09 08:03:18 -05:00
157e0004bd
make logging more verbose in debug mode by making all loggers do something, fix cypress
2023-03-09 00:38:29 -05:00
e1a0d5f9e5
avoid python 3.10 syntax for unions
2023-03-08 17:07:33 -05:00
8fb62ba123
do not remove columns when clicking the filter button w/ burnettk
2023-03-08 16:57:12 -05:00
65aeca98bc
initial changes to remove loop reset with spiff w/ burnettk
2023-03-08 13:06:25 -05:00
d45b9d1ff5
measure decryption time
2023-03-07 23:50:32 -05:00
d13001efff
bump sentry version
2023-03-07 22:56:48 -05:00
cc57e6c97d
added some code get only the most recent tasks for a process and task, get updated times from human tasks instead of the process instance, and show the current value for the notification type w/ burnettk
2023-03-07 17:13:46 -05:00
1febfdd024
Merge pull request #166 from sartography/feature/split_up_bpmn_json
...
Feature/split up bpmn json
2023-03-07 14:11:23 -05:00
9725a45241
minor tweaks to get_token w/ burnettk
2023-03-07 12:14:12 -05:00
4344e015ca
check if aud has any valid value when authing w/ burnettk
2023-03-07 11:58:59 -05:00
0f23a1b4d9
Merge remote-tracking branch 'origin/main' into feature/split_up_bpmn_json
2023-03-07 10:48:37 -05:00
762116f258
Merge pull request #167 from sartography/simple_crypt
...
Encrypt secrets in the db
2023-03-07 10:48:24 -05:00
87bacbdaaf
added some timestamp fields to bpmn process tables w/ burnettk
2023-03-07 10:41:54 -05:00
c1a9168964
Cleanup
2023-03-07 10:00:16 -05:00
0fa44d3d80
Don't double encrypt when updating/add if not exists
2023-03-07 09:53:19 -05:00
adcb5134b6
a little cleanup of comments
2023-03-07 09:28:38 -05:00
32e61027dc
merged in main and resolved conflicts
2023-03-07 09:19:09 -05:00
1cfeb32c3b
move common script errors to script so it can keep the error messaging consistent across scripts
2023-03-07 09:17:32 -05:00
66e254a3b0
fixed mypy issues
2023-03-07 09:05:06 -05:00
d5800c5a40
lint and show version control identifier on process model show
2023-03-06 23:23:10 -05:00
ce5969e9ca
Getting ./bin/pyl to pass
2023-03-06 20:42:25 -05:00
ec53ab8717
Fix secret getting reset when decrypted in get_secret
2023-03-06 20:40:08 -05:00
3cc117dbb6
Getting ./bin/pyl to pass
2023-03-06 19:36:37 -05:00
3361bb0cd2
Fixed tests
2023-03-06 19:27:24 -05:00
6dfb096a5e
Encrypt/decrypt secrets
2023-03-06 19:07:08 -05:00
3a961753db
pyl w/ burnettk
2023-03-06 17:30:35 -05:00
240c2372d2
avoid calling task_definition and bpmn_process_definition more than we need to w/ burnettk
2023-03-06 17:24:01 -05:00
bc225fcea8
Just some minor stuff:
...
1) Don't overwrite the message of all Workflow Task Exceptions to say "Something went wrong"
2) log errors when correlation evaluations fail (just so we are aware something isn't working correctly)
3) Dont make all evaluation fuctions require a current task context to execute -- that should be optional.
2023-03-06 17:07:04 -05:00
94776a78b5
some minor tweaks and turn off debug logging for spiff step details w/ burnettk
2023-03-06 16:16:55 -05:00
f994c2f5d1
Poetry install
2023-03-06 15:43:46 -05:00
9705244f6c
use poetry 1.3.2
2023-03-06 14:41:03 -05:00
af7f58dd1e
fixed pip install command
2023-03-06 14:29:55 -05:00
20e083ddc4
Merge remote-tracking branch 'origin/main' into feature/split_up_bpmn_json
2023-03-06 14:29:44 -05:00
b30ed8f3c1
pyl
2023-03-06 14:28:55 -05:00
24d2dff5e3
pin to specific version of poetry
2023-03-06 14:22:59 -05:00
b27b7346c9
add test users, including for automated pp1 test
2023-03-06 13:11:21 -05:00
628dc14d7c
make sure we set the subprocesses correctly in the bpmn dict w/ burnettk
2023-03-06 13:03:18 -05:00
dfe0280237
Minor fix to avoid an endless set of error messages if your session times out and you are using the builtin openid.
2023-03-06 12:50:18 -05:00
4ee7b299f2
pyl and fixed cypress tests w/ burnettk
2023-03-06 11:59:33 -05:00
96ef81af34
merged in main and resolved conflicts w/ burnettk
2023-03-06 11:15:16 -05:00
e55485bd4a
removed process instance data and serialized bpmn definition models w/ burnettk
2023-03-06 11:13:53 -05:00
6acd47e67e
tests are passing with new db tables w/ burnettk
2023-03-06 11:06:03 -05:00
7c0b7d252e
Couple dependency changes ( #165 )
2023-03-06 10:12:54 -05:00
2cdacfa03b
some stuff is passing but still needs the process_instance_data w/ burnettk
2023-03-03 16:51:24 -05:00
14e12645c4
get longblob on mysql, reset migrations since we are going to do that anyway in hours
2023-03-03 14:04:02 -05:00
4eef585136
recreated migration from new one in main
2023-03-03 13:08:30 -05:00
40a3515d4e
Merge remote-tracking branch 'origin/main' into feature/split_up_bpmn_json
2023-03-03 13:04:26 -05:00
b4546e86e6
Special case file data during user form submission ( #164 )
2023-03-03 12:24:18 -05:00
f7c46cd945
recreated branch migration w/ burnettk
2023-03-03 12:08:36 -05:00
8c60080663
set the collation on the db directly and not in the models w/ burnettk
2023-03-03 12:05:12 -05:00
276e6d5f37
recreate migrations to set case sensitive columns for mysql w/ burnettk
2023-03-03 11:41:34 -05:00
d7f4c8ba95
clean up bpmn process definition save code a bit w/ burnettk
2023-03-03 11:24:28 -05:00
e7950456e9
all tests are passing with new spec tables w/ burnettk
2023-03-03 10:20:26 -05:00
0c6e9a63ba
unit tests are passing with the new spec tables
2023-03-03 10:08:14 -05:00
8d67e8cc87
we can save the top level spec to the database with its tasks w/ burnettk
2023-03-02 17:28:31 -05:00
971de5cb7c
created models to hold the bpmn_json w/ burnettk
2023-03-02 16:31:21 -05:00
6e23a179b7
wait 120 seconds before processing user_input_required process instances w/ burnettk
2023-03-02 12:06:12 -05:00
612d63f141
Merge branch 'main' of github.com:sartography/spiff-arena
2023-03-02 10:43:05 -05:00
5cbffe2e96
allow open id to come in via env
2023-03-02 10:43:02 -05:00
989c0932cd
some pyl issues
2023-03-02 10:06:05 -05:00
cf9b796e1a
avoid creating new processors if it is not necessary
2023-03-02 10:00:08 -05:00
9bc99e2ef7
updates SpiffWorkflow w/ burnettk
2023-03-01 17:25:03 -05:00
64b51a0792
Merge pull request #163 from sartography/feature/process_name_for_log_list
...
prefer the bpmn process name over the identifier on the logs list pag…
2023-03-01 14:21:37 -08:00
695e51a1fb
use workflow_spec to match task_spec naming w/ burnettk
2023-03-01 17:21:24 -05:00
90b1772215
do not require task to be given to evaluate a task unless that script specifically needs it w/ burnettk
2023-03-01 17:18:58 -05:00
afec26fbd5
Bumping spiffworkflow lib changes for messages
2023-03-01 16:40:56 -05:00
716986a483
prefer the bpmn process name over the identifier on the logs list page w/ burnettk
2023-03-01 16:28:42 -05:00
dcb2a23baa
Merge pull request #162 from sartography/feature/move_task_data_into_tables
...
Feature/move bpmn_json data into separate tables
2023-03-01 15:56:51 -05:00
6521998a54
fixed the downgrade in new migration w/ burnettk
2023-03-01 15:54:50 -05:00
59c5ed296d
removed old branch migrations and created single one for this branch w/ burnettk
2023-03-01 15:40:17 -05:00
76e654ca60
remove some debug code w/ burnettk
2023-03-01 15:38:05 -05:00
53486823b6
always save the serialized bpmn definition for now w/ burnettk
2023-03-01 15:01:29 -05:00
be482ea6bc
Don't attempt to gather the augmented methods if no task is provided -- if we aren't working within the context of a task, we are not working in a context where augmented methods can work (at least not all of them). This was causing an error when attepting to use the custom engine to execute extraction expressions on messages.
2023-03-01 13:46:20 -05:00
d1b8de9ea3
pyl
2023-03-01 12:35:08 -05:00
b54ace56a2
fixed get call activity task data w/ burnettk
2023-03-01 12:23:04 -05:00
e2891425fc
store the process instance data id on the process instance and not the other way around w/ burnettk
2023-03-01 11:39:03 -05:00
ab50e7ac03
all backend tests except for report tests are now passing
2023-03-01 10:58:12 -05:00
035475f58f
unit tests are passing except for test_process_instance_report which cannot work currently
2023-03-01 10:36:11 -05:00
6257a402db
save full_bpmn_json in a var
2023-03-01 09:55:20 -05:00
abe21db517
must add data to db
2023-03-01 09:42:41 -05:00
950106fe21
most unit tests are passing now and the use of bpmn_json is almost gone in src
2023-03-01 09:22:38 -05:00
f74ce0f568
some logic to attempt to use the new bpmn json tables w/ burnettk
2023-02-28 17:46:14 -05:00
d5acd5a16d
added new table and some notes on how to get a delta w/ burnettk jbirddog
2023-02-28 16:30:52 -05:00
27f3da2458
added config to turn on sentry profiling w/ burnettk
2023-02-28 11:23:50 -05:00
b00de0d1a7
fixed python 3.9 syntax issue
2023-02-28 08:56:44 -05:00
a5c6d262b8
slam migrations file one last-ish time, increase task_name column length
2023-02-27 22:03:42 -05:00
350daf0b3d
allow task_name to be long
2023-02-27 22:01:08 -05:00
a1ec494ab3
let env var work on windows and fixing typing issue on python 3.9 w/ messaging stuff
2023-02-27 19:16:06 -05:00
45feb38168
recreated all migrations to resolve postgres migration failures w/ burnettk
2023-02-27 17:27:53 -05:00
5a873a9e2d
do not run mysql commands if not doing mysql w/ burnettk
2023-02-27 17:19:03 -05:00
35c93e3f7e
do not return human tasks from errored process instances w/ burnettk
2023-02-27 16:11:26 -05:00
09a46712d4
added debug logging when adding spiff step details w/ burnettk
2023-02-27 15:53:56 -05:00
24839a34dd
Merge branch 'main' of github.com:sartography/spiff-arena into main
2023-02-27 14:40:52 -05:00
43e41fe848
Point to the latest spiffworkflow
2023-02-27 14:40:47 -05:00
7c12709fdd
fixed conflict with db migrations w/ burnettk
2023-02-27 14:33:55 -05:00
dfac872606
Merge remote-tracking branch 'origin/main' into feature/script_get_last_user_completing_task
2023-02-27 14:28:23 -05:00
29ada38904
added script to get process initiator w/ burnettk
2023-02-27 14:28:19 -05:00
e00fbdb490
run_pyl
2023-02-27 14:21:22 -05:00
f16150b02b
Merging main
2023-02-27 14:17:10 -05:00
150b95070c
run_pyl
2023-02-27 14:05:00 -05:00
e060e28c28
Needed an additional check for empty correlation keys - which on a RECEIVE message, should always match anything.
...
When finding messages to match a send, assure they are RECIEVE messages.
Fix some of the json output for messages sent to the front end
2023-02-27 14:01:21 -05:00
6a4dc0f14e
remove unwanted test files w/ burnettk
2023-02-27 12:08:40 -05:00
9f84564457
script to get last user completing a task is working w/ burnettk
2023-02-27 12:08:07 -05:00
e07a122674
Merge remote-tracking branch 'origin/main' into feature/script_get_last_user_completing_task
2023-02-27 10:45:04 -05:00
a766e7d9a6
poetry remove orjson
2023-02-27 09:35:51 -05:00
e9b3ababc1
wip for get_last_user_completing_task script task
2023-02-25 23:31:23 -05:00
f7dc076f75
postgres really will just order however it wants if you do not specify an order_by clause
2023-02-25 22:35:46 -05:00
647d5ee92a
add ppg.ba4.sme and ba5
2023-02-24 23:42:19 -05:00
5eb9da00f1
fix postgres db name and comment out debug job
2023-02-24 16:57:53 -05:00
b71419616d
removed some unused code from task and fixed the logs table a bit w/ burnettk
2023-02-24 16:18:49 -05:00
ff069cb862
run_pyl
2023-02-24 15:02:03 -05:00
425cf3f8c1
skip failing test if postgres and added comment about cause w/ burnettk
2023-02-24 14:57:17 -05:00
0dc2bc3316
# SpiffWorkflow:
...
1) Type Safe checking on correlation properties (no more str())
2) A running workflows Correlations are once again at the key level.
# Backend
1) Both send and receive messages can have correlation_keys - and we compare these to each other to quickly assure a match (if they both exist - otherwise we fall back to comparing the properties on the receive to the sending messages payload)
2) Cleaned up the migrations to just one file
2023-02-24 14:53:22 -05:00
d5712a915c
look users up by service and username instead of service_id since usernames have to be unique anyway w/ burnettk
2023-02-24 10:41:57 -05:00
7a1e712c14
avoid using task-data endpoint for task data and only use it to get tasks based on spiff step instead
2023-02-24 09:21:21 -05:00
4651eaee94
put back the task data code when getting tasks
2023-02-23 18:32:59 -05:00
1f95fe7037
Merge remote-tracking branch 'origin/main' into feature/task_data_api_refactor
2023-02-23 17:10:23 -05:00
d53b79b18a
removed commented out code w/ burnettk
2023-02-23 17:09:33 -05:00
a4c1eb96b5
removed task-data endpoints since we no longer need them w/ burnettk
2023-02-23 17:07:53 -05:00
441bd62652
turn off profiling again
2023-02-23 16:54:38 -05:00
5c43967ee9
add two users and update one
2023-02-23 16:39:30 -05:00
5a3b4b8792
BPMN Parser was returning all retrieval expressions, rather than the ones specific to a correlation property, as was intended.
...
Adding a correlation cache - so we have a reference of all the messages and properties (though still lacking a description of keys)
Adding yet another migration, maybe should squash em.
2023-02-23 16:36:32 -05:00
a9694c7678
added api to get task data and do not return from task data list anymore w/ burnettk
2023-02-23 15:59:19 -05:00
0d468a825a
run_pyl (part 2)
2023-02-23 15:09:22 -05:00
15b00bcceb
Merge branch 'main' of github.com:sartography/spiff-arena
2023-02-23 15:06:27 -05:00
68a5fe3f16
added comment about refactoring getting task data w/ burnettk jbirddog
2023-02-23 15:06:23 -05:00
ab631aab99
lint
2023-02-23 15:01:45 -05:00
973be69df5
add test users
2023-02-23 14:58:14 -05:00
8466d823c2
Adding Migration.
2023-02-23 14:42:00 -05:00
49fb41eff9
remove task size check since it can take a long time to run and we do not do anything with it w/ burnettk jbirddog
2023-02-23 14:41:45 -05:00
7c12dffe41
Merge remote-tracking branch 'origin/main' into feature/message_fixes
2023-02-23 14:26:04 -05:00
0030a46938
run_pyl
2023-02-23 14:17:22 -05:00
0f3ef00d72
BPMN.io -- Just show the message names not the ids - to assure we are only exposing the names.
...
SpiffWorkflow -
- start_messages function should return message names, not ids.
- don't catch external thrown messages within the same workflow process
- add an expected value to the Correlation Property Model so we can use this well defined class as an external communication tool (rather than building an arbitrary dictionary)
- Added a "get_awaiting_correlations" to an event, so we can get a list of the correlation properties related to the workflows currently defined correlation values.
- workflows.waiting_events() function now returns the above awaiting correlations as the value on returned message events
Backend
- Dropping MessageModel and MessageCorrelationProperties - at least for now. We don't need them to send / receive messages though we may eventually want to track the messages and correlations defined across the system - these things (which are ever changing) should not be directly connected to the Messages which may be in flux - and the cross relationships between the tables could cause unexpected and unceissary errors. Commented out the caching logic so we can turn this back on later.
- Slight improvement to API Errors
- MessageInstances are no longer in a many-to-many relationship with Correlations - Each message instance has a unique set of message correlations specific to the instance.
- Message Instances have users, and can be linked through a "counterpart_id" so you can see what send is connected to what recieve.
- Message Correlations are connected to recieving message instances. It is not to a process instance, and not to a message model. They now include the expected value and retrieval expression required to validate an incoming message.
- A process instance is not connected to message correlations.
- Message Instances are not always tied to a process instance (for example, a Send Message from an API)
- API calls to create a message use the same logic as all other message catching code.
- Make use of the new waiting_events() method to check for any new recieve messages in the workflow (much easier than
churning through all of the tasks)
- One giant mother of a migration.
2023-02-23 13:53:03 -05:00
216bd799bf
do not call serialize if we can use the cached bpmn_json instead w/ burnettk
2023-02-23 13:48:27 -05:00
7dd72c72e1
Merge branch 'main' of github.com:sartography/spiff-arena
2023-02-23 11:19:26 -05:00
2bf31fc135
turn on sentry detailed tracing for task-data w/ burnettk
2023-02-23 11:19:22 -05:00
55f3b765ee
update spiff
2023-02-23 11:02:40 -05:00
c65aeafbe3
Merge pull request #145 from sartography/data_size_script
...
Data size script
2023-02-22 17:36:31 -08:00
44f31ffc36
Merge branch 'main' of github.com:sartography/spiff-arena
2023-02-22 15:35:02 -05:00
a3126da7ef
set git user configs explicitly using the env vars w/ burnettk
2023-02-22 15:34:47 -05:00
1a29e123c1
so we do not lose our minds when debugging on a server
2023-02-22 15:16:13 -05:00
9b14510cd1
Merge branch 'main' of github.com:sartography/spiff-arena
2023-02-22 14:42:46 -05:00
c6b45dbdc3
show help text for textareas as well w/ burnettk
2023-02-22 14:42:43 -05:00
9fb490c7f9
why not dict, too
2023-02-22 14:36:26 -05:00
7fe8955adf
Cleanup
2023-02-22 13:42:45 -05:00
7f2d69163e
Getting ./bin/pyl to pass
2023-02-22 13:34:26 -05:00
488abc03ea
Provide info about keys in task data and python env
2023-02-22 13:13:28 -05:00
2afc19175e
Unfactor to fix size calculation/type hint issues
2023-02-22 11:17:23 -05:00
a4c0dd52ae
Getting ./bin/pyl to pass
2023-02-22 11:04:07 -05:00
d5fa8eae21
Adding python env size
2023-02-22 10:55:09 -05:00
2fa4623876
Add cumulative task data size to script
2023-02-22 10:39:35 -05:00
bb6dd35bbd
remove start and end events from simple logs view
2023-02-21 22:43:23 -05:00
54248ca568
copy env so we are doing additive stuff rather than completely rewriting it
2023-02-21 22:00:02 -05:00
012f5c20aa
fix git bash script unbound error w/ burnettk
2023-02-21 17:08:09 -05:00
90de749ab9
more git config updates w/ burnettk
2023-02-21 16:43:52 -05:00
c5d611f03b
disable strict host checking for git commands w/ burnettk
2023-02-21 16:42:11 -05:00
e5b83d0919
fixed tests w/ burnettk
2023-02-21 15:28:54 -05:00
b0d132fc1e
give access to download process data files if a user has access to start a process model w/ burnettk
2023-02-21 15:08:19 -05:00
Jakub Sokołowski
819415d487
backend: create SSH key file when contents provided
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 20:02:16 +01:00
Jakub Sokołowski
56a913e33c
backend: use sensible lock filename for git
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 19:58:39 +01:00
Jakub Sokołowski
1bbf3a264c
backend: specify --rebase when using git pull
...
Otherwise it fails with:
```
Pulling without specifying how to reconcile divergent branches is discouraged.
```
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 19:58:38 +01:00
Jakub Sokołowski
1e8e6a7968
backend: fix use of SSH private key for git ops
...
Primarily this is supposed to fix the `git pull` aciton triggered by
webhooks from GitHub. But in addition to that the point is to simplify
that committing wrapper which has far too much in it.
Instead of passing everything as CLI arguments one should make use of
already supported environment variables and the `env` argument to
`subprocess` functions like `run()`. Writing extra logic in the wrapper
only makes it unnecessarily complicated.
By passing both user, email, and the SSH options in `run_shell_command`
we avoid the need to repeat the same boilerplate to provide Git config
and SSH credentials.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 19:58:36 +01:00
01a95011ad
Look in task data/script engine environment for data, not just workflow data. ( #143 )
2023-02-20 18:12:50 -05:00
790483a421
run_pyl
2023-02-20 12:34:42 -05:00
5f6a61c93f
* SpiffWorkflow event_definitions wanted to return a message event's correlation properties mested within correlation keys. But messages are directly related to properties, not to keys - and it forced a number of conversions that made for tricky code. So Messages now contain a dictionary of correlation properties only.
...
* SpiffWorkflow did not serialize correlations - so they were lost between save and retrieve.
* When comparing Correlation Property values - we are storing these values as strings in the database and can't convert them back to integers later, so I'm changing everying everywhere to compare after conversion to a string. Don't feel great about this one.
* By using an SQL Alchemy join table, there is a lot of db queries we don't need to write.
* A few handy fucntions on db models to make it easier to work with correlations.
* Updated tests because I changed some of the BPMN models we were testing against.
* Database migration to use the new constraint names with the alternate form of the join table between correlation mesages to instance messages.
2023-02-20 11:50:35 -05:00
a600736e67
delint
2023-02-20 10:58:04 -05:00
Jakub Sokołowski
fb024a49f7
backend/git_service: accept webhook test requests
...
https://docs.github.com/en/webhooks-and-events/webhooks/testing-webhooks
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-20 13:11:21 +01:00
Jakub Sokołowski
e47c0752db
backend/git_service: check repo URLs from webhook
...
Since we are cloning a private repo we are using `ssh_url` in our case.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-20 13:02:54 +01:00
d46502cd2b
Allow people to run commands like "flask db upgrade" without setting specific environment variables like FLASK_SESSION_SECRET_KEY everytime - they just need to add in their own /instance/config.py with their local configuration.
2023-02-19 10:37:00 -05:00
2a800e844f
* Re-work message tests so I could wrap my simple head around what was happening - just needed an example that made sense to me.
...
* Clear out complex get_message_instance_receive how that many-to-many works.
* Create decent error messages when correlations fail
* Move correlation checks into the MessageInstance class
* The APIError could bomb out ugly if it hit a workflow exception with not Task Spec.
2023-02-18 13:09:58 -05:00
f2ca47e798
bump spiffworkflow hash
2023-02-17 13:08:45 -05:00
ecbd30af00
failing test.
2023-02-17 12:10:32 -05:00
ef4297331d
Merge branch 'main' into feature/message_fixes
2023-02-17 12:01:38 -05:00
8e257600af
work in progress -
...
* Link between message instance and correlations is now a link table and many-to-many relationships as recommended by SQLAlchemy
* Use the correlation keys, not the process id when accepting api messages.
2023-02-17 10:45:01 -05:00
b22c33e1d6
put the env vars in the env section of the github action configs w/ burnettk
2023-02-16 15:19:01 -05:00
0839214fa5
added test for quickstart guide w/ burnettk
2023-02-16 15:05:55 -05:00
435dc147df
pyl
2023-02-16 14:38:19 -05:00
f5a5059ce0
Merge remote-tracking branch 'origin/main' into feature/support_local_openid_in_cypress_tests
2023-02-16 14:25:51 -05:00
9f3bb283b3
use _GIT_SOURCE_BRANCH instead of _GIT_BRANCH
2023-02-16 14:10:31 -05:00
888547642e
fix unprefixed config
2023-02-16 13:56:48 -05:00
jasquat
burnettk
jasquat
Elizabeth Esswein
Elizabeth Esswein
jbirddog
Kevin Burnett
Dan
Jon Herron
Jakub Sokołowski