Millions of Pageviews
How to manage a Matomo with millions of pageviews per month? -- Watch live at https://live.matomocamp.org/URWXGR

    Millions of Pageviews

    Lukas (MatomoCamp) created this room.

    This is the start of export of Millions of Pageviews. Exported by Lukas (@lukas:lw1.at) at 2021/11/29.


    Topic: How to manage a Matomo with millions of pageviews per month? -- Watch live at https://live.matomocamp.org/URWXGR

  2. Lukas (MatomoCamp) joined the room
  3. Lukas (MatomoCamp) set the main address for this room to #millions-of-pageviews:matomocamp.org.
  4. Lukas (MatomoCamp) made the room public to whoever knows the link.
  5. Lukas (MatomoCamp) made future room history visible to anyone.
  6. Lukas (MatomoCamp) changed the room name to Millions of Pageviews.
  7. Lukas (MatomoCamp) changed the topic to "How to manage a Matomo with millions of pageviews per month? -- Watch live at https://live.matomocamp.org/URWXGR".
  8. Lukas (MatomoCamp) invited Lukas
  9. Lukas (MatomoCamp) invited Markus
  10. Lukas (MatomoCamp) invited silva.arapi
  11. Avatar
    Lukas joined the room
  12. Lukas (MatomoCamp) changed the power level of @lukas:lw1.at from Default to Admin.
  13. Markus joined the room
  14. Avatar
    Lukas changed the power level of @markus:matomocamp.org from Default to Moderator.
  15. Avatar
    silva.arapi joined the room
  16. Avatar
    Lukas changed the power level of @silva.arapi:matrix.org from Default to Moderator.
  18. Avatar
    Tomas Persson joined the room
  20. Peter Boehlke joined the room
  22. Avatar
    Lukas invited Jorge Powers
  23. markus changed their display name to Markus
  24. peterbo changed their display name to peter.boehlke
  25. peter.boehlke changed their display name to Peter Boehlke
  27. Avatar
    Jorge Powers joined the room
  28. Avatar
    tomper00 changed their display name to Tomas Persson
  29. Avatar
    Tomas Persson set a profile picture
  30. Avatar
    Jorge Carvajal Powers changed their display name to Jorge Powers
  31. Avatar
    Jorge Powers set a profile picture
  32. Avatar
    ronanchardonneau joined the room
  33. Avatar
    alfonso.aponte joined the room
  34. Avatar
    Valentin Baraise joined the room
  35. lrm joined the room
  36. maxwalter joined the room
  37. robertolopez joined the room
  38. Avatar
    Stefan Giehl joined the room
  39. saqib16 joined the room
  40. Mikael Jonsson (datamicke) joined the room
  41. niklasternstedt joined the room
  42. Avatar
    putte joined the room
  43. Avatar
    ronan_hello joined the room
  44. Toni Barberà Melià joined the room
  45. Mikael Jonsson (datamicke)
    I'm having problem to connect. Is it just me?
  46. Valentin Baraise
    Avatar
    We are waiting for the speaker to be ready
    (edited)
  47. niklasternstedt
    Same for me
  48. ronanchardonneau
    Avatar
    me too
  49. Lukas
    Avatar
    The stream is intentionally not yet online
  50. ronanchardonneau
    Avatar
    the speaker Jorge is having technical issues
  51. niklasternstedt
    It says the media could not be loaded
  52. saqib16
    same here It says the media could not be loaded
  53. maxwalter
    I also get an error message in the video player
  54. Lukas
    Avatar
    The error message is just because we are preparing yet. The stream will start soon
  55. Avatar
    Elisa de Castro Guerra joined the room
  56. Avatar
    Marcus Österberg joined the room
  57. Lukas
    Avatar
    It should be live now
  58. Valentin Baraise
    Avatar
    you can refresh
  59. maxwalter
    It is working now!
  60. Avatar
    Marcus Österberg set a profile picture
  61. silva.arapi
    Avatar
    All good now, feel free to share your questions here for Jorge
  62. Avatar
    Stefan Koning joined the room
  63. ronanchardonneau
    Avatar
    the sound is getting better and better
  64. Avatar
    stefan_koning changed their display name to Stefan Koning
  65. Avatar
    Stefan Koning set a profile picture
  66. Avatar
    Tassoman joined the room
  67. Tassoman
    Avatar
    Only me is buffering?
  68. Marcus Österberg
    Avatar
    No buffering here, but sound is lagging.
  69. niklasternstedt
    No, for me as well, especcially the sound is lagging.
  70. Mikael Jonsson (datamicke)
    try to change the videoquality to lower.
  71. ronanchardonneau
    Avatar
    so from my understanding Kubernetes has been the key to the project here. https://en.wikipedia.org/wiki/Kubernetes
  72. Lukas
    Avatar
    At least for me the stream is working fine
  73. Åsa Sohlén joined the room
  74. Tassoman
    Avatar
    I'm fine now with 720p thanks!
  75. maxwalter
    Now i also got buffering issues but it works better when i lower the quality
  76. ronanchardonneau
    Avatar
    i am getting them too, but still hearable
  77. niklasternstedt

    In reply to this message

    Even the sound?
  78. ronanchardonneau
    Avatar
    and understandable
  79. Lukas
    Avatar
    The sound issues are unfortunately also in our conferencing tool
  80. Tomas Persson
    Avatar
    Yes changing quality to 720 helped a lot
  81. Valentin Baraise
    Avatar
    Thanks for contributing to OpenSource with this repo !
  82. ronanchardonneau
    Avatar
    This question is for the speaker. Have you ever use the Matomo fake visitor plugin in order to have enough data within your Matomo data in order to make some crash test? Do you have any feedback you could give us in order to make some crash test with an empty Matomo database? the idea would be to educate ourselves about system administration. Thank you
  83. Avatar
    Morten Bjerregaard joined the room
  84. Valentin Baraise
    Avatar
    That's a lot of load !
    (edited)
  85. robertolopez
    With million of page views, how big is your database ? Have you ever met issues regarding the size of your db and the archive proess?
  86. ronanchardonneau
    Avatar
    Hi robertolopez nice to see you here, feel free to ask as many questions as you can to Jorge. We have until 12:00.
  87. Tomas Persson
    Avatar
    Our biggest db is around 800 GB and yes this affects archiving
  88. Valentin Baraise
    Avatar
    How long do you keep data for 800Gb of data?
  89. Marcus Österberg
    Avatar
    Question to the speaker: Perhaps I missed the number of events at Skatteverket. The figures you showed were pageviews, right?
  90. maxwalter
    Is MariaDB not supported in Matomo or is it not recommended for large installations of Matomo?
  91. Tomas Persson
    Avatar
    delete_logs_older_than setting is set to 400 days
  92. Marcus Österberg: yes that was pageviews only!
  93. ronanchardonneau
    Avatar
    Thank you Jorge for answering my question.
  94. Marcus Österberg
    Avatar

    In reply to this message

    Interesting! I would've guessed the seasonality would be even larger around April.
  95. Mikael Jonsson (datamicke)
    Have you done perfomancetesting/loadtesting be done by external company, same as webpagetesting?
  96. robertolopez
    Jorge Powers: thank you for your answers...
  97. Valentin Baraise
    Avatar
    Thank you !
  98. maxwalter
    Jorge Powers: Thank you for the answer!
  99. Stefan Koning
    Avatar
    Thanks!
  100. lrm
    Thank you!
  101. Morten Bjerregaard
    Avatar
    Thank you!
  102. alfonso.aponte
    Avatar
    Great session Jorge
  103. maxwalter
    Thank you for the presentation Jorge Powers !
  104. Marcus Österberg
    Avatar
    Thanks!
  105. robertolopez
    👍️ thank you !!
  106. Lukas
    Avatar
    This chat room will stay open for the whole MatomoCamp. So if you still have questions to Jorge Powers or Tomas Persson, you can still ask them here.
  107. Åsa Sohlén
    Thanks!
  108. Lukas
    Avatar
    And if you want to give them feedback for the talk, you can contact them directly or post them at https://schedule.matomocamp.org/matomocamp-2021/talk/URWXGR/feedback/
  109. Jorge Powers
    Avatar

    In reply to this message

    No, we test ourselves.

  110. In reply to this message

    Here's the link to the issue: https://issues.matomo.org/14858

  111. In reply to this message

    We rotate the logs, so it's steadily around 800GB-1TB I would say. We have probably peaked at 1.3TB.
  112. alteria joined the room
  113. Morten Bjerregaard
    Avatar
    Thanks :-)
  114. Alexandra Girel joined the room
  115. Alexandra Girel left the room
  116. Avatar
    Elisa de Castro Guerra left the room
  117. datamicke changed their display name to Mikael Jonsson (datamicke)