<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	
	>
<channel>
	<title>
	Comments on: Cleaning Inaccurate Data	</title>
	<atom:link href="https://www.elearningworld.org/post-14-cleaning-inaccurate-data/feed/" rel="self" type="application/rss+xml" />
	<link>https://www.elearningworld.org/post-14-cleaning-inaccurate-data/</link>
	<description>For the online learning world</description>
	<lastBuildDate>Sun, 24 Sep 2023 19:43:17 +0000</lastBuildDate>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=6.9.4</generator>
	<item>
		<title>
		By: Jeff Mitchell		</title>
		<link>https://www.elearningworld.org/post-14-cleaning-inaccurate-data/#comment-1660</link>

		<dc:creator><![CDATA[Jeff Mitchell]]></dc:creator>
		<pubDate>Sun, 24 Sep 2023 19:43:17 +0000</pubDate>
		<guid isPermaLink="false">https://www.elearningworld.org/?p=13117#comment-1660</guid>

					<description><![CDATA[In reply to &lt;a href=&quot;https://www.elearningworld.org/post-14-cleaning-inaccurate-data/#comment-1659&quot;&gt;Nor Hazirah Binti Mohd Zaki&lt;/a&gt;.

Hello, often it is better to have no data than to have incorrect data. If an email address was wrong, say missing the &#039;@&#039; symbol, and you guessed what it was, you could be sending communications to the wrong person. If you are making decisions based on your data, the wrong data can cause you to make a poor decision. Removing the inaccurate data by setting it to blank means that it will not impact any further analysis you do on the data, such as calculating averages or finding the max value. It is also a good idea to remove these data points when you are trying to do trend analysis as they can disguise the true trend.

You can also set the value to something that represents an &#039;unknown&#039;. In python this could be np.nan or NaT for time data. For text it could be the empty string, or you could use None. This tells you that you have missing data rather than a data point of 0.

When performing the analysis you would normally remove the blank entries and then complete your analysis. This is often better than setting a numeric value to zero. If you want to know how many of each item you have in bands of 5 (0-5, 6-10, 11-15...) you would not want a lot of 0&#039;s representing missing or inaccurate data. So it would be better to remove them first. If you are confident that you can use the average or mean in place of the value, you can do so, but if this does not make sense for your data it is much better to mark it as blank and remove that data point from your analysis. You can always have an &#039;Unknown&#039; category with the number of blanks when you do your analysis.]]></description>
			<content:encoded><![CDATA[<p>In reply to <a href="https://www.elearningworld.org/post-14-cleaning-inaccurate-data/#comment-1659">Nor Hazirah Binti Mohd Zaki</a>.</p>
<p>Hello, often it is better to have no data than to have incorrect data. If an email address was wrong, say missing the &#8216;@&#8217; symbol, and you guessed what it was, you could be sending communications to the wrong person. If you are making decisions based on your data, the wrong data can cause you to make a poor decision. Removing the inaccurate data by setting it to blank means that it will not impact any further analysis you do on the data, such as calculating averages or finding the max value. It is also a good idea to remove these data points when you are trying to do trend analysis as they can disguise the true trend.</p>
<p>You can also set the value to something that represents an &#8216;unknown&#8217;. In python this could be np.nan or NaT for time data. For text it could be the empty string, or you could use None. This tells you that you have missing data rather than a data point of 0.</p>
<p>When performing the analysis you would normally remove the blank entries and then complete your analysis. This is often better than setting a numeric value to zero. If you want to know how many of each item you have in bands of 5 (0-5, 6-10, 11-15&#8230;) you would not want a lot of 0&#8217;s representing missing or inaccurate data. So it would be better to remove them first. If you are confident that you can use the average or mean in place of the value, you can do so, but if this does not make sense for your data it is much better to mark it as blank and remove that data point from your analysis. You can always have an &#8216;Unknown&#8217; category with the number of blanks when you do your analysis.</p>
]]></content:encoded>
		
			</item>
		<item>
		<title>
		By: Nor Hazirah Binti Mohd Zaki		</title>
		<link>https://www.elearningworld.org/post-14-cleaning-inaccurate-data/#comment-1659</link>

		<dc:creator><![CDATA[Nor Hazirah Binti Mohd Zaki]]></dc:creator>
		<pubDate>Sun, 24 Sep 2023 08:43:18 +0000</pubDate>
		<guid isPermaLink="false">https://www.elearningworld.org/?p=13117#comment-1659</guid>

					<description><![CDATA[Hi Jeff, I have a question regarding the inaccurate value data. Why it is much better to leave it blank and how we will interpret the blank data?]]></description>
			<content:encoded><![CDATA[<p>Hi Jeff, I have a question regarding the inaccurate value data. Why it is much better to leave it blank and how we will interpret the blank data?</p>
]]></content:encoded>
		
			</item>
		<item>
		<title>
		By: Anonymous		</title>
		<link>https://www.elearningworld.org/post-14-cleaning-inaccurate-data/#comment-1658</link>

		<dc:creator><![CDATA[Anonymous]]></dc:creator>
		<pubDate>Sun, 24 Sep 2023 08:40:28 +0000</pubDate>
		<guid isPermaLink="false">https://www.elearningworld.org/?p=13117#comment-1658</guid>

					<description><![CDATA[Hello, I want to ask regarding the value of inaccurate data, why would leaving it blank much be better? and how would we interpret or analyze the blank data.]]></description>
			<content:encoded><![CDATA[<p>Hello, I want to ask regarding the value of inaccurate data, why would leaving it blank much be better? and how would we interpret or analyze the blank data.</p>
]]></content:encoded>
		
			</item>
		<item>
		<title>
		By: ElearningWorld Admin		</title>
		<link>https://www.elearningworld.org/post-14-cleaning-inaccurate-data/#comment-1388</link>

		<dc:creator><![CDATA[ElearningWorld Admin]]></dc:creator>
		<pubDate>Sun, 08 Aug 2021 01:02:15 +0000</pubDate>
		<guid isPermaLink="false">https://www.elearningworld.org/?p=13117#comment-1388</guid>

					<description><![CDATA[Great post Jeff !
I love the way you are using Excel, something that everyone has (or an equivalent) to review the data
- and it&#039;s surprising how much ever a visual check can reveal :-)]]></description>
			<content:encoded><![CDATA[<p>Great post Jeff !<br />
I love the way you are using Excel, something that everyone has (or an equivalent) to review the data<br />
&#8211; and it&#8217;s surprising how much ever a visual check can reveal 🙂</p>
]]></content:encoded>
		
			</item>
	</channel>
</rss>
