{"id":195,"date":"2023-10-30T09:27:16","date_gmt":"2023-10-30T09:27:16","guid":{"rendered":"https:\/\/famconme.project.tuwien.ac.at\/?p=195"},"modified":"2023-10-30T09:27:16","modified_gmt":"2023-10-30T09:27:16","slug":"making-data-cleaning-happen","status":"publish","type":"post","link":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/","title":{"rendered":"Making Data Cleaning Happen"},"content":{"rendered":"\n<p>Beyond preparing the report on the project for the European Union, I have spent the last month thinking about the necessary steps to clean the real-world study data. Data cleaning is a first step in a chain of tasks which need to be finished in order to preprocess the data for further analysis.<\/p>\n\n\n\n<p>Cleaning the data will involve both, manual and algorithmic work both of which I will be doing simultaneously throughout the upcoming months. One very good example for this is partitioning the data such that we know which portion of the data was collected for which level of familiarity. While there are algorithmic approaches such as map matching to help in this, the quality of the location data is weak at times and, hence, manual annotation is needed.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Beyond preparing the report on the project for the European Union, I have spent the last month thinking about the necessary steps to clean the real-world study data. Data cleaning is a first step in a chain of tasks which need to be finished in order to preprocess the data for further analysis. Cleaning the [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"post_formats":[],"class_list":["post-195","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v24.9 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Making Data Cleaning Happen - Familiarity is Key! Conceptualizing and Behaviourally Measuring Familiarity In-Situ<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Making Data Cleaning Happen - Familiarity is Key! Conceptualizing and Behaviourally Measuring Familiarity In-Situ\" \/>\n<meta property=\"og:description\" content=\"Beyond preparing the report on the project for the European Union, I have spent the last month thinking about the necessary steps to clean the real-world study data. Data cleaning is a first step in a chain of tasks which need to be finished in order to preprocess the data for further analysis. Cleaning the [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/\" \/>\n<meta property=\"og:site_name\" content=\"Familiarity is Key! Conceptualizing and Behaviourally Measuring Familiarity In-Situ\" \/>\n<meta property=\"article:published_time\" content=\"2023-10-30T09:27:16+00:00\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/\",\"url\":\"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/\",\"name\":\"Making Data Cleaning Happen - Familiarity is Key! Conceptualizing and Behaviourally Measuring Familiarity In-Situ\",\"isPartOf\":{\"@id\":\"https:\/\/famconme.project.tuwien.ac.at\/#website\"},\"datePublished\":\"2023-10-30T09:27:16+00:00\",\"author\":{\"@id\":\"https:\/\/famconme.project.tuwien.ac.at\/#\/schema\/person\/de1d137a62ec4c407000831ebf427913\"},\"breadcrumb\":{\"@id\":\"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/#breadcrumb\"},\"inLanguage\":\"en-AU\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/famconme.project.tuwien.ac.at\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Making Data Cleaning Happen\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/famconme.project.tuwien.ac.at\/#website\",\"url\":\"https:\/\/famconme.project.tuwien.ac.at\/\",\"name\":\"Familiarity is Key! Conceptualizing and Behaviourally Measuring Familiarity In-Situ\",\"description\":\"A Marie Sk\u0142odowska-Curie Global Fellowship Project (H2020) conducted at TU Wien and UC Santa Barbara\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/famconme.project.tuwien.ac.at\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-AU\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/famconme.project.tuwien.ac.at\/#\/schema\/person\/de1d137a62ec4c407000831ebf427913\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/famconme.project.tuwien.ac.at\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/325c7c2e05711fd9a4ca1f26f8c7e9deddb4c01d25a1d3e609a307c838cb3db2?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/325c7c2e05711fd9a4ca1f26f8c7e9deddb4c01d25a1d3e609a307c838cb3db2?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/famconme.project.tuwien.ac.at\"],\"url\":\"https:\/\/famconme.project.tuwien.ac.at\/index.php\/author\/markuskattenbeck_0l4yjjri\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Making Data Cleaning Happen - Familiarity is Key! Conceptualizing and Behaviourally Measuring Familiarity In-Situ","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/","og_locale":"en_US","og_type":"article","og_title":"Making Data Cleaning Happen - Familiarity is Key! Conceptualizing and Behaviourally Measuring Familiarity In-Situ","og_description":"Beyond preparing the report on the project for the European Union, I have spent the last month thinking about the necessary steps to clean the real-world study data. Data cleaning is a first step in a chain of tasks which need to be finished in order to preprocess the data for further analysis. Cleaning the [&hellip;]","og_url":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/","og_site_name":"Familiarity is Key! Conceptualizing and Behaviourally Measuring Familiarity In-Situ","article_published_time":"2023-10-30T09:27:16+00:00","author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/","url":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/","name":"Making Data Cleaning Happen - Familiarity is Key! Conceptualizing and Behaviourally Measuring Familiarity In-Situ","isPartOf":{"@id":"https:\/\/famconme.project.tuwien.ac.at\/#website"},"datePublished":"2023-10-30T09:27:16+00:00","author":{"@id":"https:\/\/famconme.project.tuwien.ac.at\/#\/schema\/person\/de1d137a62ec4c407000831ebf427913"},"breadcrumb":{"@id":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/#breadcrumb"},"inLanguage":"en-AU","potentialAction":[{"@type":"ReadAction","target":["https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/2023\/10\/30\/making-data-cleaning-happen\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/famconme.project.tuwien.ac.at\/"},{"@type":"ListItem","position":2,"name":"Making Data Cleaning Happen"}]},{"@type":"WebSite","@id":"https:\/\/famconme.project.tuwien.ac.at\/#website","url":"https:\/\/famconme.project.tuwien.ac.at\/","name":"Familiarity is Key! Conceptualizing and Behaviourally Measuring Familiarity In-Situ","description":"A Marie Sk\u0142odowska-Curie Global Fellowship Project (H2020) conducted at TU Wien and UC Santa Barbara","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/famconme.project.tuwien.ac.at\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-AU"},{"@type":"Person","@id":"https:\/\/famconme.project.tuwien.ac.at\/#\/schema\/person\/de1d137a62ec4c407000831ebf427913","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/famconme.project.tuwien.ac.at\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/325c7c2e05711fd9a4ca1f26f8c7e9deddb4c01d25a1d3e609a307c838cb3db2?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/325c7c2e05711fd9a4ca1f26f8c7e9deddb4c01d25a1d3e609a307c838cb3db2?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/famconme.project.tuwien.ac.at"],"url":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/author\/markuskattenbeck_0l4yjjri\/"}]}},"guten_post_layout_featured_media_urls":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false,"guten_post_layout_landscape_large":false,"guten_post_layout_portrait_large":false,"guten_post_layout_square_large":false,"guten_post_layout_landscape":false,"guten_post_layout_portrait":false,"guten_post_layout_square":false,"sciencexlite-blog-thumb":false},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/posts\/195","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/comments?post=195"}],"version-history":[{"count":1,"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/posts\/195\/revisions"}],"predecessor-version":[{"id":196,"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/posts\/195\/revisions\/196"}],"wp:attachment":[{"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/media?parent=195"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/categories?post=195"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/tags?post=195"},{"taxonomy":"post_format","embeddable":true,"href":"https:\/\/famconme.project.tuwien.ac.at\/index.php\/wp-json\/wp\/v2\/post_formats?post=195"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}