Welcome to the Dash Forum!

Please sign up to discuss the most innovative cryptocurrency!

DashRadar development thread

Discussion in 'Projects' started by Antti Kaikkonen, Jun 20, 2017.

  1. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    Oh sorry about that. I just moved to a diffent city so I couln't work for 2 days.. I will fix asap.

    Edit: It got stuck at block 905186 which has 4785 transactions. I probably need to change the code to save in a single database transaction one transaction at a time instead of one block at a time. Meanwhile I'm trying to give the database more memory to work with to get it rolling again.
     
    #91 Antti Kaikkonen, Jul 19, 2018
    Last edited: Jul 19, 2018
    • Like Like x 1
  2. UdjinM6

    UdjinM6 Official Dash Dev
    Dash Core Team Moderator

    Joined:
    May 20, 2014
    Messages:
    3,613
    Likes Received:
    3,525
    Trophy Points:
    1,183
    np :) you got hit with an improvised community driven stress test which brought down some nodes in our insight cluster for some time too (not to mention poloniex and shapeshift :D)
     
  3. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    The issue was that determining the transaction type (privatesend, create denomination, mixing, ..) was too slow. I optimized the code and it seems to be working fine now. Just processed a 1.91 MB block without an issue. The block explorer should catch up withing an hour or two.
     
    • Like Like x 1
  4. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    Update
    • Block explorer
      • InstantSend icon is now displayed for InstantSend transactions in the block explorer
      • Added a summary of the last 24 hours to the front page of the block explorer
        • Number of transactions
        • Number of InstantSend transactions
        • Number of PrivateSend transactions
        • Hashrate
      • Changed the recent blocks table to also display date instead of only time, because viewing old blocks is possible.
      • Added PrivateSend analysis page. Link available from the transaction page of a PrivateSend transaction.
        • Example 1, Example 2
        • Currently I'm running the analysis on my own computer. When I'm running it, the analysis should be available a few minutes after the PrivateSend transaction is confirmed, but I won't be able to run it 24/7 currently.
        • Todo: Add explanation, add basic transaction info, create analysis where PrivateSend transactions are tracked back to guesstimated wallets instead of create denominations transactions (group together create denominations transactions belonging in the same wallet)
    • Backend
      • Updated to Dash Core v0.12.3
      • Updated to the latest insight-api. Also wrote a tutorial on how to install it.
      • InstantSend locks are stored in the database
      • Had to do some performance optimizations thanks to the recent stress test by the dash community
        • Now able to handle ~2mb blocks with ease
        • Initial sync time should also be greatly reduced
    Source code of the PrivateSend analysis program: https://github.com/Antti-Kaikkonen/PrivateSendAnalysis.

    As recommended to me by Dash Watch, I also added an analytics software matomo to the site. It's open source and self hosted (unlike something like google analytics), so no data is provided to third parties. I may, however, share some statistics here and with the Dash Watch team. So far only 60 unique visitors since I installed it in July 11th.

    There is currently an issue with the search functionality of the block explorer because of this bug.
     
    • Like Like x 1
  5. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    Search functionality is now again working properly in the block explorer. Also updated the privatesend analysis page with loading indicators, basic transaction details and visual improvements.

    Currently working on changing the privatesend analysis by combining create denominations transactions originating from the same wallet. Soon the privatesend analysis page will show guesstimated wallets (based on the multi-input heuristic) instead of create denominations transactions.

    I also want to inform everyone that I will keep working on the ongoing proposal in August so that I can finish the remaining proposal objectives.
     
    • Like Like x 3
  6. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    Update:
    Changed the PrivateSend analysis page to use guesstimated wallets as mixing sources. New analysis is available in https://dashradar.com/explorer/privatesend/[txid]. Old analysis is still available in https://dashradar.com/explorer/privatesend-old/[txid]. The new analysis typically has less mixing sources and higher percentages because it combines create denominations transactions belonging in the same wallet. To get a list of example analysis pages you can run this query. It fetches privatesend transactions between blocks 850000 and 855000 because the old analysis isn't available for recent transactions.

    I want to emphasize that it's not possible for someone to determine the number of rounds used by just analyzing the blockchain. Different inputs can even use a different number if you interrupt the mixing process. So the results are more like leads rather than something conclusive.
     
    #96 Antti Kaikkonen, Aug 7, 2018
    Last edited: Aug 7, 2018
    • Like Like x 2
  7. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    I found a bug which caused mixing transactions to affect the guesstimated wallets feature although mixing transactions should have been ignored.

    I'm going to remove all of the guesstimated wallets and then recompute them. This will cause a few hours of downtime. Edit: Done

    I will also need to recompute the PrivateSend analysis results which were using the guesstimated wallets feature.
     
    #97 Antti Kaikkonen, Aug 7, 2018
    Last edited: Aug 8, 2018
    • Useful Useful x 2
  8. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    I found another bug where a trasaction included in an orphaned block re-appearing in the mempool caused the transaction to be duplicated. This has so far happened to only 1 transaction but it already scewed the average transaction fee chart for August 8th. Currently reprocessing the data and I will edit this post when fixed. Edit: done
     
    #98 Antti Kaikkonen, Aug 10, 2018
    Last edited: Aug 12, 2018
  9. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    • Like Like x 1
  10. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    • Like Like x 2
  11. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    Here is the number of unique visitors for July, August and September
    dashradar unique visutors.png

    I'm using an open-source self hosted analytics software called Matomo, so that your information is not leaked to Google or other third parties.
     
    • Like Like x 1
  12. jeffh

    jeffh Member

    Joined:
    May 8, 2017
    Messages:
    107
    Likes Received:
    44
    Trophy Points:
    78
    @Antti Kaikkonen If you want to pull more information about the masternodes here, feel free to run a query against this data from Dash Intel:

    https://api.dashintel.org/dash_masternode_insights. We have some additional information that we're pulling from paid API queries and saving in our database that you might find useful. Keep in mind, I ignore non-ENABLED masternodes in most cases.
     
    • Like Like x 1
    • Winner Winner x 1
  13. colofi

    colofi New Member

    Joined:
    Sep 29, 2018
    Messages:
    10
    Likes Received:
    0
    Trophy Points:
    1
    #103 colofi, Oct 11, 2018
    Last edited: Oct 11, 2018
  14. jeffh

    jeffh Member

    Joined:
    May 8, 2017
    Messages:
    107
    Likes Received:
    44
    Trophy Points:
    78
    @colofi this was some testing done by @DeltaEngine for a stress test a few months ago and then more recently in preparation for a network stress-test (theoretical max tx/s to beat any production blockchain record) scheduled to happen around the 12.4 launch.
     
    • Like Like x 1
  15. Antti Kaikkonen

    Antti Kaikkonen Active Member

    Joined:
    Jun 20, 2017
    Messages:
    194
    Likes Received:
    139
    Trophy Points:
    103
    Nodes page added to dashradar: https://dashradar.com/nodes

    There is still some things that could be added/improved:
    • Make the map size dynamic depending on screen resolution
    • Add an option to filter active/inactive nodes in the "All nodes" tab
    • (Individual node page by clicking the ip address)
    • (Add historical charts for country/version/organization distribution)
    • (Add link to collateral txid/address for masternodes)
    • (Show voting data for masternodes)
     
    • Like Like x 1

Share This Page