Commit Graph

2190 Commits

Author SHA1 Message Date
jbirddog 09e2c3b4a9
Leverage `first_task` in `get_ready_engine_steps` (#1858)
* WIP

* Getting pyl to pass

* WIP
2024-07-02 10:01:11 -07:00
Kevin Burnett 3f5290862f
bump spiff for message pre script fix (#1857)
* bump spiff for message pre script fix

* update wish list

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-07-02 09:41:20 -07:00
Kevin Burnett 2f36a70cfb
group metrics by endpoint instead of path (#1856)
* group metrics by endpoint instead of path

* remove unused lint config files

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-07-02 09:03:08 -07:00
jasquat 7dc15fbebb
queue process instances from the apscheduler instead of running them when using celery (#1855)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-07-02 11:20:29 -04:00
dependabot[bot] d29683bf9e
Bump sqlalchemy from 2.0.27 to 2.0.31 in /spiffworkflow-backend (#1854)
Bumps [sqlalchemy](https://github.com/sqlalchemy/sqlalchemy) from 2.0.27 to 2.0.31.
- [Release notes](https://github.com/sqlalchemy/sqlalchemy/releases)
- [Changelog](https://github.com/sqlalchemy/sqlalchemy/blob/main/CHANGES.rst)
- [Commits](https://github.com/sqlalchemy/sqlalchemy/commits)

---
updated-dependencies:
- dependency-name: sqlalchemy
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-02 15:18:30 +00:00
jasquat 25947a71ab
bp-message-log-improvement (#1850)
* updated logging for messages from the background processor to hopefully make it easier to debug

* minor tweaks to message log

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-07-02 10:29:21 -04:00
jasquat 352c04f62a
updated SpiffWorkflow for mi task performance improvements w/ burnettk (#1847)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-07-01 13:32:10 -07:00
jasquat c0e072a2e2
Mi large data debug bpm only (#1846)
* some debug code to help track down slow processing times for mi tasks with larget data sets w/ burnettk

* use mapping cache for task models and bpmn processes and some linting cleanup

* some minor bugfixes w/ burnettk

* assign the correct bpmn process to the given guid w/ burnettk

* fixed data migration tests w/ burnettk

* unit tests are passing w/ burnettk

* integration tets are passing w/ burnettk

* some cleanup while code reviewing w/ burnettk

* some more cleanup w/ burnettk

* pass new args to TaskService in data migration w/ burnettk

* fixed broken test w/ burnettk

* allow running acceptance tests without keycloak w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-07-01 16:05:51 -04:00
burnettk 6db4ab669f
only create group if not exists 2024-07-01 15:10:18 -04:00
dependabot[bot] cb41f952d6
Bump flask-marshmallow from 1.2.0 to 1.2.1 in /spiffworkflow-backend (#1845)
Bumps [flask-marshmallow](https://github.com/marshmallow-code/flask-marshmallow) from 1.2.0 to 1.2.1.
- [Release notes](https://github.com/marshmallow-code/flask-marshmallow/releases)
- [Changelog](https://github.com/marshmallow-code/flask-marshmallow/blob/dev/CHANGELOG.rst)
- [Commits](https://github.com/marshmallow-code/flask-marshmallow/compare/1.2.0...1.2.1)

---
updated-dependencies:
- dependency-name: flask-marshmallow
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-01 15:21:47 +00:00
Kevin Burnett 30ff5dce08
update security lib for release without stdout (#1840)
* update security for release without stdout

* might as well try to let postgres pass consistently

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-28 09:27:10 -07:00
dependabot[bot] 986a28f5e4
Bump coverage from 7.5.3 to 7.5.4 in /spiffworkflow-backend (#1837)
Bumps [coverage](https://github.com/nedbat/coveragepy) from 7.5.3 to 7.5.4.
- [Release notes](https://github.com/nedbat/coveragepy/releases)
- [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst)
- [Commits](https://github.com/nedbat/coveragepy/compare/7.5.3...7.5.4)

---
updated-dependencies:
- dependency-name: coverage
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-28 14:31:05 +00:00
jasquat 90216288c5
set-keys-on-message-start (#1835)
* set the correlations on the bpmn process instance when creating a process instance for a message start event w/ burnettk

* downgrade security to avoid unwanted print statements w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-27 13:33:51 -07:00
dependabot[bot] 07b89eaf0f
Bump jsonschema from 4.21.1 to 4.22.0 in /spiffworkflow-backend (#1833)
Bumps [jsonschema](https://github.com/python-jsonschema/jsonschema) from 4.21.1 to 4.22.0.
- [Release notes](https://github.com/python-jsonschema/jsonschema/releases)
- [Changelog](https://github.com/python-jsonschema/jsonschema/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/python-jsonschema/jsonschema/compare/v4.21.1...v4.22.0)

---
updated-dependencies:
- dependency-name: jsonschema
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-27 15:06:18 +00:00
jbirddog e68c626418
Set proccess_instance_id when creating a new thread (#1831) 2024-06-27 10:43:46 -04:00
jasquat bcb124813d
Pi summary field (#1830)
* added summary column to process instance w/ burnettk

* minor fix for summary report w/ burnettk

* force pi summary to 255 characters max w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-26 13:09:06 -07:00
jasquat 1d79d77686
Celery avoid requeueing (#1828)
* some debug code and potential fixes to avoid requeueing future tasks w/ burnettk

* actually insert the queued time into the future task table w/ burnettk

* fixed tests w/ burnettk

* handle missing process instances better from celery worker and updated some comments w/ burnettk

* added comment w/ burnettk

* minor fixes w/ burnettk

* added test for should_schedule_waiting_timer_events w/ burnettk

* added test to ensure we do not queue recently queued tasks again w/ burnettk

* remove traceback code

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-26 10:48:28 -07:00
dependabot[bot] e0b4a48905
Bump setuptools from 69.2.0 to 70.1.1 in /spiffworkflow-backend (#1827)
Bumps [setuptools](https://github.com/pypa/setuptools) from 69.2.0 to 70.1.1.
- [Release notes](https://github.com/pypa/setuptools/releases)
- [Changelog](https://github.com/pypa/setuptools/blob/main/NEWS.rst)
- [Commits](https://github.com/pypa/setuptools/compare/v69.2.0...v70.1.1)

---
updated-dependencies:
- dependency-name: setuptools
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-06-26 10:39:55 -07:00
pixeebot[bot] 26149ae339
Sandbox Process Creation (#1799)
* Sandbox Process Creation

* lib already in backend

* update security

* no need to test with newlines, hopefully, since they are not allowed by security lib

* typing things

---------

Co-authored-by: pixeebot[bot] <104101892+pixeebot[bot]@users.noreply.github.com>
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-25 16:24:41 -07:00
dependabot[bot] 79c9d78f6d
Bump mypy from 1.10.0 to 1.10.1 in /spiffworkflow-backend (#1820)
Bumps [mypy](https://github.com/python/mypy) from 1.10.0 to 1.10.1.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](https://github.com/python/mypy/compare/v1.10.0...v1.10.1)

---
updated-dependencies:
- dependency-name: mypy
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-06-25 14:41:41 -07:00
Kevin Burnett ce6dc339c8
avoid prompt to save if no save button (#1806)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-25 07:36:49 -07:00
jasquat 5e3831f4d6
message-model-perm-check (#1805)
* check if user has permissions to messages before attempting call w/ burnettk

* fixed variable typo w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-24 12:36:07 -07:00
dependabot[bot] 8968d87399
Bump restrictedpython from 7.0 to 7.1 in /spiffworkflow-backend (#1802)
Bumps [restrictedpython](https://github.com/zopefoundation/RestrictedPython) from 7.0 to 7.1.
- [Changelog](https://github.com/zopefoundation/RestrictedPython/blob/master/CHANGES.rst)
- [Commits](https://github.com/zopefoundation/RestrictedPython/compare/7.0...7.1)

---
updated-dependencies:
- dependency-name: restrictedpython
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-24 14:38:44 +00:00
jasquat d2e005022b
use the greedy strategy when running messages from the background processor w/ burnettk (#1798)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-21 16:22:42 -04:00
Kevin Burnett 6ab89dab40
default to local openid instead of keycloak container dependency (#1794)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-21 08:38:52 -07:00
dependabot[bot] 0f7113486c
Bump typing-extensions from 4.10.0 to 4.12.2 in /spiffworkflow-backend (#1788)
Bumps [typing-extensions](https://github.com/python/typing_extensions) from 4.10.0 to 4.12.2.
- [Release notes](https://github.com/python/typing_extensions/releases)
- [Changelog](https://github.com/python/typing_extensions/blob/main/CHANGELOG.md)
- [Commits](https://github.com/python/typing_extensions/compare/4.10.0...4.12.2)

---
updated-dependencies:
- dependency-name: typing-extensions
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-21 14:42:17 +00:00
jasquat 4dbcd8a655
improved-celery-logging (#1785)
* updated logging for celery workers w/ burnettk

* fixed indentation error

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-21 09:51:36 -04:00
burnettk 278fa239f4
poet lock no update 2024-06-20 15:44:00 -04:00
jasquat eed946260c
Test migration change (#1784)
* added tests to ensure migrations do not change w/ burnettk

* fixed tests w/ burnettk

* pyl w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-20 12:38:59 -07:00
Kevin Burnett 0f31260570
Scrap openai lib (#1782)
* scrap openai lib

* iterate

* bring down temperature and top_p

* remove lib

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-20 11:58:00 -07:00
burnettk 49c1584b9c
bump requests to fix safety 2024-06-20 14:46:21 -04:00
dependabot[bot] 79bef27b3b
Bump safety from 3.2.1 to 3.2.3 in /spiffworkflow-backend (#1780)
Bumps [safety](https://github.com/pyupio/safety) from 3.2.1 to 3.2.3.
- [Release notes](https://github.com/pyupio/safety/releases)
- [Changelog](https://github.com/pyupio/safety/blob/main/CHANGELOG.md)
- [Commits](https://github.com/pyupio/safety/compare/3.2.1...3.2.3)

---
updated-dependencies:
- dependency-name: safety
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
2024-06-20 11:42:59 -07:00
jasquat c050d194dc
Merge branch 'main' of github.com:sartography/spiff-arena 2024-06-20 13:39:12 -04:00
jasquat b62da219df
updated serializer version to reflect version 5 data migration 2024-06-20 13:39:08 -04:00
Kevin Burnett 29c3018ae0
bump lib to omit default on inclusive gw with matched conditions (#1781)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-20 10:10:41 -07:00
jbirddog ad0cf83cb6
Support non task data environment, step 1 (#1745) 2024-06-20 07:56:49 -04:00
dependabot[bot] d13420666a
Bump types-requests in /spiffworkflow-backend (#1772)
Bumps [types-requests](https://github.com/python/typeshed) from 2.32.0.20240521 to 2.32.0.20240602.
- [Commits](https://github.com/python/typeshed/commits)

---
updated-dependencies:
- dependency-name: types-requests
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-19 18:26:37 +00:00
Kevin Burnett e4aac94a4e
Fix gunicorn and wait for schema issues (#1771)
* fix gunicorn and wait_for_db_schema_migrations

* avoid bad gunicorn version

* actually check that request succeeded

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-19 10:59:27 -07:00
Kevin Burnett 15628278d2
protect future_task foreign key add operation from running when bad data (#1770)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-19 08:38:01 -07:00
dependabot[bot] 07485b6a51
Bump types-dateparser in /spiffworkflow-backend (#1766)
Bumps [types-dateparser](https://github.com/python/typeshed) from 1.1.4.20240106 to 1.2.0.20240420.
- [Commits](https://github.com/python/typeshed/commits)

---
updated-dependencies:
- dependency-name: types-dateparser
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-19 14:47:37 +00:00
Kevin Burnett bcf13bd46a
schedule waiting timer events after saving tasks because foreign keys (#1762)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-18 14:37:26 -07:00
jasquat 6fad14ae6f
do not try to queue task if the pi cannot be found and delete future tasks if parent task deleted w/ burnettk (#1761)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-18 13:54:09 -07:00
jasquat 95ed415bab
wait_for_db script executable and fixed package lock file w/ burnettk 2024-06-18 15:52:22 -04:00
pixeebot[bot] f487f905a5
Sandbox URL Creation (#1739)
* Sandbox URL Creation

* add security lib to correct location w/ burnettk

---------

Co-authored-by: pixeebot[bot] <104101892+pixeebot[bot]@users.noreply.github.com>
Co-authored-by: Kevin Burnett <18027+burnettk@users.noreply.github.com>
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-18 12:38:17 -07:00
Ayoub Ait Lachgar 81f2f6191b
Feature/message editor improved UI (#1754)
* retrieval_expressions should be a string and not an array in this context w/ burnettk

* Improve message editor ui

* Check if CorrelationProperties arent synced

* Merge Imporoved UI for messages

* some linting fixes

* more linting

* some updates for linting and updated bpmn-js-spiffworkflow w/ burnettk

* removed unused console.log w/ burnettk

* fix language w/ burnettk

---------

Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-18 15:15:25 -04:00
jasquat 9957fc144a
update the hash column in json data table on duplicate entry w/ burnettk (#1750)
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-18 12:08:44 -07:00
Kevin Burnett 0bccdb7cba
No auth for metrics (#1757)
* config scope

* no auth for metrics

* Update spiffworkflow-backend/src/spiffworkflow_backend/services/authorization_service.py

Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>

---------

Co-authored-by: burnettk <burnettk@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-18 14:23:26 -04:00
Kevin Burnett 538fbf261c
config scope (#1755)
Co-authored-by: burnettk <burnettk@users.noreply.github.com>
2024-06-18 14:21:26 -04:00
dependabot[bot] b97cf0be9f
Bump openai from 1.12.0 to 1.34.0 in /spiffworkflow-backend (#1760)
Bumps [openai](https://github.com/openai/openai-python) from 1.12.0 to 1.34.0.
- [Release notes](https://github.com/openai/openai-python/releases)
- [Changelog](https://github.com/openai/openai-python/blob/main/CHANGELOG.md)
- [Commits](https://github.com/openai/openai-python/compare/v1.12.0...v1.34.0)

---
updated-dependencies:
- dependency-name: openai
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-18 18:12:49 +00:00
dependabot[bot] 54fc875e59
Bump mypy from 1.9.0 to 1.10.0 in /spiffworkflow-backend (#1729)
* Bump mypy from 1.9.0 to 1.10.0 in /spiffworkflow-backend

Bumps [mypy](https://github.com/python/mypy) from 1.9.0 to 1.10.0.
- [Changelog](https://github.com/python/mypy/blob/master/CHANGELOG.md)
- [Commits](https://github.com/python/mypy/compare/1.9.0...v1.10.0)

---
updated-dependencies:
- dependency-name: mypy
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

* fixed mypy issue w/ burnettk

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: jasquat <jasquat@users.noreply.github.com>
2024-06-17 13:34:44 -07:00