Commit Graph

872 Commits

Author SHA1 Message Date
Churikova Tetiana 5da40ca412
removed web allow permissions test
Signed-off-by: Andrey Shovkoplyas <motor4ik@gmail.com>
2019-12-11 16:34:37 +01:00
Andrey Shovkoplyas e7122dc86a
[#9575] Make sure status supports EIP 1102 and EIP 1193 2019-12-11 16:17:52 +01:00
Roman Volosovskyi beed1a60ee
[#9573] Fix some password saving bugs 2019-12-11 12:15:25 +02:00
Churikova Tetiana 4a40b6f033
add junitxml report back
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-12-10 19:48:36 +01:00
Andrea Maria Piana 54cf783d5b
Move group chats to status-go
This commit completely remove transit for group chats. All the
processing is now done in status-go.
Also introuduces parsing and handling of mentions, needed so that system
messages can be easily built in status-go.

Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-12-10 16:18:26 +01:00
Churikova Tetiana 53523430cc
Formatted text in 'From' field
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-12-09 17:19:32 +01:00
Roman Volosovskyi 91b931c3b4
Replace address with keyUid in accounts db
Account's address was used as a primary key in accounts db and as a
deterministic id of an account in some API calls. Also it was used as a
part of the name of the account specific database. This revealed some
extra information about the account and wasn't necessary.
At first the hash of the address was planned to be used as a
deterministic id, but we already have a keyUid which is calculated as
sha256 hash of account's public key and has similar properties:
- it is deterministic
- doesn't reveal accounts public key or address in plain
2019-12-09 11:57:44 +02:00
Churikova Tetiana 9abb1ef488
another tiny fixes to e2e
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-12-06 16:50:17 +01:00
Churikova Tetiana 21d24e7eef
waiting for allow_button until checking absense
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-12-06 10:57:38 +01:00
Andrea Maria Piana 78d694f52f
Move message processing to status-go and introduce protobuf
This commit moves all the processing of messages to status-go.

Messages are going arrive to status-react already saved an processed.

Receiving/sending/retrieving from db is now using the same identical
structure. The only processing left in status-react is to mark the
messages as seen and update the unviewed count locally (only
status-react knows whether the count should be updated).

Partially remove commands as well as won't be used anymore.

Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-12-05 17:30:30 +01:00
Serhy 0b2490d20e
Fix wallet tests
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-12-05 11:14:46 +01:00
acolytec3 2fda266f07
Add ENS name resolution to EIP681 support
Signed-off-by: Andrey Shovkoplyas <motor4ik@gmail.com>
2019-12-05 10:48:05 +01:00
yenda 94c7953f30
remove commands before replacement by gui commands
Signed-off-by: yenda <eric@status.im>
2019-12-03 15:07:56 +01:00
Serhy 0b802ec456
Update e2e test to expect changes
Signed-off-by: Andrey Shovkoplyas <motor4ik@gmail.com>
2019-12-03 13:10:56 +01:00
Serhy 577e699405
Upgrade to pytest 5.3.1
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-12-02 12:55:50 +02:00
Serhy 13a619502c
Fixing wallet send tx tests
Signed-off-by: Serhy <sergii@status.im>
2019-11-29 19:43:59 +02:00
Churikova Tetiana 34b356866b
fixed several e2e
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-11-29 11:30:40 +01:00
yenda 572e028f32
fix 9394 select mailserver based on ping
- if not mailserver was actively selected by user,
use rpc call to get latency for known mailservers
and use the best one
- this happens when `set-current-mailserver` is called which happens
in `change-mailserver` when user unpins his preferred mailserver and when
there's been too many failed attemps to fetch messages or to connect to
then current mailserverm as well as when user logs in.

Signed-off-by: yenda <eric@status.im>
2019-11-28 23:31:39 +01:00
Churikova Tetiana eecf53d11f
more wait for lets_go_button
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-11-25 17:46:33 +01:00
Andrey Shovkoplyas bf5416b629
remove statusbar and add safeview for android
Signed-off-by: Andrey Shovkoplyas <motor4ik@gmail.com>
2019-11-25 14:42:09 +01:00
Churikova Tetiana 47d22305db
test_set_primary_ens_custom_domain
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-11-25 11:36:49 +01:00
acolytec3 76296870d1
Truncate decimal values beyond 6 decimal places in signing sheet
Signed-off-by: Andrey Shovkoplyas <motor4ik@gmail.com>
2019-11-21 19:05:36 +01:00
Churikova Tetiana 0b1da0e118
markdown support test + waits
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-11-21 12:01:57 +01:00
Serhy 84325fc528
Fix invite friends test
Signed-off-by: Serhy <sergii@status.im>
2019-11-21 12:47:34 +02:00
Andrea Maria Piana ddbfc78e08
[Fixes: #9492] Consider system messages always in their own group
System messages should always display the user picture, and should never
be grouped.

Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-11-20 12:25:50 +01:00
Churikova Tetiana 40ca4af6a6
align e2e with accessibility-ids
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-11-18 13:11:52 +01:00
Serhy 6aa225192f
Test can cancel quote message
Signed-off-by: Serhy <sergii@status.im>
2019-11-18 12:25:28 +02:00
Andrea Maria Piana 9a9c0ce526
Render markdown
Fixes: https://github.com/status-im/trailofbits-audit/issues/47
Fixes: https://github.com/status-im/trailofbits-audit/issues/46
Fixes: https://github.com/status-im/trailofbits-audit/issues/44
Fixes: https://github.com/status-im/security-reports/issues/13
Fixes: https://github.com/status-im/security-reports/issues/5
Fixes: https://github.com/status-im/status-react/issues/8995

This commits re-introduce rendering of markdown text and implent a few
changes:

1) Parsing of the message content is now in status-go, this includes
markdown, line-count, and rtl. Parsing is not nested, as there's some
rendering degradation involved as we nest components, unclear exactly if
it's react-native or clojure, haven't looked too deeply into it.
2) Emojii type messages are not parsed on the sending side, not the
receiving one, using the appropriate content-type
3) Fixes a few issues with chat input rendering, currrently we use
`chats/current-chat` subscription which is very heavy and should not be
used unless necessary, and means that
any change to chat will trigger a re-render, which caused re-rendering
of input container on each received message. Also to note that
input-container is fairly heavy to render, and it's rendered twice at
each keypress on input.

The inline markdow supported is:

*italic* or _italic_
**bold** or __bold__
`inline code`
http://test.com links
\#status-tag

The block markdown supported is:

\# Headers
```
code blocks
```
> Quotereply

The styling is very basic at the moment, but can be improved.
Adding other markdown (photo,mentions) is straightforward and should
come at little performance cost (unless the component to render is
heavy, i.e a photo for example).

There are some behavioral changes with this commit:

1) Links are only parsed if starting with http:// or https://, meaning that
blah.com won't be parsed, nor www.test.com. This behavior is consistent
with discord for example and allows faster parsing at little expense to
ser experience imo. Fixes a few security issues as well.

2) Content is not anymore capped (regression), that's due to the fact that
before we only rendered text and react-native allowed us easily to limit
the number of lines, but adding markdown support means that this
strategy is not viable anymore. Performance of rendering don't see to be
very much impacted by this, I would re-introduce it if necessary, but
I'd rather do that in a separate PR.

Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-11-15 10:23:25 +01:00
Churikova Tetiana 3127f2fcb2
Reworked test_ens
Signed-off-by: Andrey Shovkoplyas <motor4ik@gmail.com>
2019-11-14 12:04:26 +01:00
Churikova Tetiana 2ed62e53eb
added waits
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-11-12 12:44:51 +01:00
Andrea Maria Piana 13b01ce879
Fix replies, clear-history, logout bug
Fixes #9433 : this was due to the fact that `.-response-to` was
returning nil, because of the dash in the name, instead in this cases
`(aget .. "response-to")` should be used.

Fixes #9431 : This was a left-over from the move from message-groups to
message-list, and the code was not updated.

Fixes #9430 #9429 Both of these were due to the same issue, cofx were
wrongly passed to the function resulting in the db being updated but the
fxs being discarded.

There's still a separate issue that might result in messages not being
saved on logout, because of a race condition (if you logout while is
fetching messages, some of the message might not be saved). I will
address that separately as we might be able to just save messages as
they come in status-go, rather then having to pass them to status-react
and back to status-go for saving.

Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-11-12 11:27:26 +01:00
Andrea Maria Piana 2bb7c70216
[Fixes: #1520] Enable ens
Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-11-08 13:03:42 +01:00
Churikova Tetiana 9205a147a2
tiny fix to test_send_funds_between_accounts_in_multiaccount_instance
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-11-07 16:26:37 +01:00
Churikova Tetiana 9311fee2ae
wallet update balance and fix failures
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-11-07 14:40:12 +01:00
Andrea Maria Piana 5fe385c225
Parse messages in status-go
This commit enables parsing of messages in status-go.
Currently only a few messages are supported in status-protocol-go.
For now we only enable Message types.
Status-react will conditionally use the parsed version if present.
Eventually this can be moved to a separate signal/different structure,
but for the time being is best to validate with the minimum amount of
changes.

The next step would be handle validation and processing of the field in
status-go, so we can skip saving the message from status-react.

This commit should improve performance of receiving messages from a
chat, although haven't had time to validate that.

Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-11-06 19:30:47 +01:00
Andrea Maria Piana 9a2e1e97db
[Fixes: #9400] Fix last-group
The from parameter was left out, tests did not pick it up as they were
not running, probably I have wrongly rebased the code and did not
include the new namespace in runner.cljs

Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-11-06 17:47:28 +01:00
Churikova Tetiana 2e8e1a35ad
adjust tests to eth.fleet
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-11-05 12:17:47 +01:00
Andrea Maria Piana 1c63c782a4
Dont use network info but only rely on peers count for mailservers
Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-11-05 11:50:54 +01:00
Andrea Maria Piana 5eb314db58
Use staging fleet and upgrade status-go
Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-11-04 15:07:12 +01:00
Andrea Maria Piana c69863cda2
Fix message ordering and improve performance rec. messages
This commit does a few things:

==== Ordering of messages ====

Change the ordering of messages from a mixture of timestamp/clock-value to use
only clock-value.

Datemarks are now not used for sorting anymore, which means that the
order of messages is always causally related (not the case before, as we
were breaking this property by sorting by datemark), but datemark
calculation is unreliable (a reply to a message might have a timestamp <
then the message that is replied to).
So for timestamp calculation we
naively group them ignoring "out-of-order timestamp" messages, although
there's much to improve.
It fixes an issue whereby the user would change their time and the
message will be displayed in the past, although it is still possible to
craft a message with a lower clock value and order it in the past
(there's no way we can prevent this to some extent, but there are ways
to mitigate, but outside the scope of this PR).

==== Performance of receiving messages ====

The app would freeze on pulling messages from a mailserver (100 or so).
This is due to the JS Thread being hogged by CPU calculation, coupled
with the fact that we always tried to process messages all in one go.

This strategy can't scale, and given x is big enough (200,300,1000) the
UI will freeze.

Instead, each message is now processed separately, and we leave a gap
between processing each message for the UI to respond to user input
(otherwise the app freezes again).
Pulling messages will be longer overall, but the app will be usuable
while this happen (albeit it might slow down).
Other strategies are possible (calculate off-db and do a big swap,
avoiding many re-renders etc), but this is the reccommended strategy by
re-frame author (Solving the CPU Hog problem), so sounds like a safe
base point.

The underlying data structure for holding messages was also changed, we
used an immutable Red and Black Tree, same as a sorted map for clojure, but we use
a js library as is twice as performing then clojure sorted map.

We also don't sort messages again each time we receive them O(nlogn), but we
insert them in order O(logn).

Other data structures considered but discarded:
1) Plain vector, but performance prepending/insertion in the middle
(both O(n)) were not great, as not really suited for these operations.

2) Linked list, appealing as append/prepend is O(1), while insertion is
O(n). This is probably acceptable as messages tend to come in order
(from the db, so adding N messages is O(n)), or the network (most of
them prepends, or close to the head), while mailserver would not follow this path.
An implementation of a linked list was built, which performed roughtly the
same as a clojure sorted-map (although faster append/prepend), but not
worth the complexity of having our own implementation.

3) Clojure sorted-map, probably the most versatile, performance were
acceptable, but nowhere near the javascript implementation we decided on

4) Priority map, much slower than a sorted map (twice as slow)

5) Mutable sorted map, js implementation, (bintrees), not explored this very much, but from
just a quick benchmark, performance were much worse that clojure
immutable sorted map

Given that each message is now processed separately, saving the chat /
messages is also debounced to avoid spamming status-go with network
requests. This is a temporary measure for now until that's done directly
in status-go, without having to ping-pong with status-react.

Next steps performance wise is to move stuff to status-go, parsing of
transit, validation, which is heavy, at which point we can re-consider
performance and how to handle messages.

Fixes also an issue with the last message in the chat, we were using the
last message in the chat list, which might not necessarely be the last
message the chat has seen, in case messages were not loaded and a more
recent message is the database (say you fetch historical messages for
1-to-1 A, you don't have any messages in 1-to-1 chat B loaded, you receive an
historical message for chat B, it sets it as last message).

Also use clj beans instead of js->clj for type conversion

Signed-off-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2019-11-01 23:59:26 +01:00
Serhy e579412334
E2e check if seedphrase in new acc is true
Signed-off-by: Serhy <sergii@status.im>
2019-11-01 19:04:11 +02:00
yenda 3528dd809a
fix fleet settings not being saved to node config
Signed-off-by: yenda <eric@status.im>
2019-11-01 11:56:11 +01:00
Serhy c7cc80bc60
Followup e2e fix after PN remove
Signed-off-by: Serhy <sergii@status.im>
2019-10-30 21:34:53 +02:00
Churikova Tetiana bba6d735c3
Remove Myabe later after deleting PN
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-10-30 09:19:07 +01:00
Churikova Tetiana bada7c4dd4
added more waiting to some elements
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-10-29 18:23:38 +01:00
Serhy 5b742155d0
Soft errors handing separated per test
Signed-off-by: Serhy <sergii@status.im>
2019-10-29 16:07:27 +02:00
yenda 7bb45fdd8f
remove firebase
Signed-off-by: yenda <eric@status.im>
2019-10-29 15:03:58 +01:00
Serhy eb00df147d
E2E transaction appears in history
Signed-off-by: Serhy <sergii@status.im>
2019-10-28 10:04:45 +02:00
Churikova Tetiana 5561aff955
e2e account settings
Signed-off-by: Churikova Tetiana <churikova.tm@gmail.com>
2019-10-28 09:02:20 +01:00
Serhy 8ac531ed9c
Add unblock user test
Signed-off-by: Serhy <sergii@status.im>
2019-10-24 19:29:02 +03:00