Time left until the start of the population and housing census

For developers

Statistics Estonia wishes to make the movement and reporting of data more automatic in order to decrease the data submission burden of enterprises. We have prepared guidelines for those who wish to start using the statistical database API or integrate their software with Reporting 3.0, a project created to decrease administrative burden by making it more convenient to submit data required by the state.

How to use statistical database API

Instructions for using database API in analytics software:

Aruandlus 3.0

How to start the automation of reporting as a Reporting 3.0 project

Step 1: Starting the project and forming the team
  1. Required roles:
    • project administrator (product manager of payroll and HRM module in the first stage)
    • solution architect (data model, data compilation)
    • technical expert (data exchange, interfacing, troubleshooting)
  2. The project must have the management’s approval and support.
Step 2: Studying the data model
  1. Reviewing the required data items (input data and taxonomy: https://www.stat.ee/et/aruandlus-30). The first stage concerns data on wages and salaries and employees. It has four sections and 32 data fields (incl. 13 classifications):
    • accrued labour costs (Statistics Estonia’s need)
    • labour taxes (Annexes 1 and 2 of Form TSD) (Tax and Customs Board’s need)
    • data from employment register (Tax and Customs Board’s need)
    • additional statistics block (Statistics Estonia’s need)
  2. Linking data fields (incl. classifications) with employee record
  3. Linking data fields (incl. classifications) with wages event

Contact person at Statistics Estonia: Mare Kusma (mare.kusma [at] stat.ee)

Step 3: Describing the user story for data exchange
  1. Writing the user story (discussion of menus and journeys)
  2. Generating necessary screenshots:
    • linking classifications
    • requesting missing data fields (section 4)
    • planning the data exchange logic (display of periods, recipient selection (a separate file must be sent to each institution), log of sent files, warnings, troubleshooting):
      • classification checks
      • display logic for new classification elements
      • detecting discontinued classifications and used data elements; logic for making changes
Step 4: Planning the business software architecture
  1. Classification queries and buffering; notification of item value changes (the institutions managing classifications notify of changes at least once a year)
  2. Developing a data exchange architecture that can also accommodate data exchange in later stages, that allows simultaneous data transmission to all institutions and that ensures timeliness of data
  3. Definition of the necessary technical data fields (Security Server address etc.) in the settings module of the business software
  4. Data grouping at minimum level for data exchange; saving the data
  5. Assigning the rights to begin data exchange
  6. Defining the detail level of logs
Step 5: Joining X-tee
  1. Setting up or renting infrastructure (e.g. Telia, Andmevara)
  2. Joining X-tee, if not yet signed up (you can join at https://www.x-tee.ee/home)
  3. Adding a Security Server (for test or development server and for production server)
  4. Applying for certificates (RIA)
  5. Registration of subsystem (RIHA)

X-tee manual: https://moodle.ria.ee/course/view.php?id=10

Step 6: Creating a data transmission test file
  1. Getting to know XBRL GL (see also Valdek Järvpõld's presentation at the XBRL GL information seminar – in Estonian)
  2. Creating XML-format and XBRL GL standard files (one for the Estonian Tax and Customs Board, one for Statistics Estonia) and sending the files to the test environment. The rule for file creation is a file per enterprise per month.
  3. A sample file is available at https://www.stat.ee/et/vajalikud-materjalid-tarkvaraarendajale

Reporting 3.0 seminar materials – 17 Aug 2020 (in Estonian)

Reporting 3.0 seminar materials – 17 Feb 2020 (in Estonian)

Contact person at Statistics Estonia: Andres Kukke (andres.kukke [at] stat.ee)

​Step 7: Testing data exchange
  1. Prior notification (date and time, responsible contact persons)
  2. Preparation of test data
  3. Testing (X-tee environment “ee-dev”):

Contact person at Statistics Estonia: Andres Kukke (andres.kukke@stat.ee)

Step 8: Communication
  1. Prior notification (to agree a date and time)
  2. Preparing test data, sending data to the test environment (X-tee environment “ee-test”)
  3. Checking reference sums
  4. Troubleshooting

Contact person at Statistics Estonia: Andres Kukke (andres.kukke [at] stat.ee)

Step 9: Training
  1. Preparation of user instructions (preferably as a video tutorial)
  2. Information and training for in-house customer support
Step 10: Live
  1. Selecting the first test group
  2. Directing X-tee to the production environment (x-tee environment “ee”)
  3. Help during first data submission (data submission deadline: 18th day of the month)
  4. After-action review

Guide to setting up automated reporting (in Estonian)