Explain the major components of a data warehouse architecture, including the various forms of data transformations needed to prepare data for a data warehouse. Also, describe in your own words current key trends in data warehousing.

Final Portfolio Project

Final Portfolio Project (submission in Week 15)

Class, the final project is due next week (week 15). Please use this week to get a start on this final project. Start working on a draft that you can continue to work on into next week for submission in Week 15 (nothing is submitted to Week 14).

Final Project Prompt:

The final portfolio project is a three- part activity. You will respond to three separate prompts but prepare your paper as one research paper. Be sure to include at least one UC library source per prompt, in addition to your textbook (which means you’ll have at least 4 sources cited).

Start your paper with an introductory paragraph.

Prompt 1 “Data Warehouse Architecture” (2-3 pages): Explain the major components of a data warehouse architecture, including the various forms of data transformations needed to prepare data for a data warehouse. Also, describe in your own words current key trends in data warehousing.

Prompt 2 “Big Data” (1-2 pages): Describe your understanding of big data and give an example of how you’ve seen big data used either personally or professionally. In your view, what demands is big data placing on organizations and data management technology?

Prompt 3 “Green Computing” (1-2 pages): One of our topics in Chapter 13 surrounds IT Green Computing. The need for green computing is becoming more obvious considering the amount of power needed to drive our computers, servers, routers, switches, and data centers. Discuss ways in which organizations can make their data centers “green”. In your discussion, find an example of an organization that has already implemented IT green computing strategies successfully. Discuss that organization and share your link. You can find examples in the UC Library.

Complete the Routed Events exercise in Chapter 14 to work with events. Provide a screenshot of the code as well as the output for all three exercises.

Manipulating Properties

Using Visual Studio 2015

  • In Chapter 14, use the Add Controls to a Window exercise to add buttons to an interface using the design tool and XAML. Book is attached
  • Then go to the Manipulating Properties exercise and apply changes.
  • Complete the Routed Events exercise in Chapter 14 to work with events.
  • Provide a screenshot of the code as well as the output for all three exercises.

Contrast external outputs with internal outputs produced by a system. Remember to consider differences in external and internal users. What are the drawbacks of electronic and Web-based output?

Review Questions

Answer the following review questions from the textbook:

  • Chapter 11
    • Review Questions 1, 2, 4, and 7 (page 328)
  • Chapter 12
    • Review Questions 1, 3, 6, and 7 (pages 356-357)

Your answers should be written in a professional manner (as if you were preparing a summary for a corporate executive). In other words, do not simply provide “bullet point” items, but carefully describe the related concepts in paragraph form. Your submissions will be evaluated on both technical correctness and adherence to professional communication standards.

Review Questions Chapter 11

1. List six objectives an analyst pursues in designing system output.

2. Contrast external outputs with internal outputs produced by a system. Remember to consider differences in external and internal users.

4. What are the drawbacks of electronic and Web-based output?

7. What kind of output is desirable if many readers will be reading, storing, and reviewing output over a period of years?

Review Questions Chapter 12

1. What are the design objectives for paper input forms, input screens, and Web-based fill-in forms?

3. What is proper form flow?

6. What is a specialty form? What are some disadvantages of using specialty forms?

7. List the four guidelines for good display design.

Develop a model for the total profits (Revenues minus Costs) and represent it on an Excel spreadsheet. Consider demands as units sold. Create columns for price, demand, revenue, costs, and profits. Use a table and a graph with $ on the y-axis and Demand on the x-axis to find the price at which profit is maximized.

Individual Lab 8

Instructions

  1. Build the model for profit model for gaming mouse in R.
  2. Answer questions 1-16 to the Rmd model.

Model

A manufacturer of wireless gaming mouse is preparing to set the price on a new model. Demand (D) is thought to depend on the price (P) and is represented by the model:

D = 2500 – 3P

The accounting department estimates that the total costs (C) can be represented by

C = 6000 + 4D

Develop a model for the total profits (Revenues minus Costs) and represent it on an Excel spreadsheet. Consider demands as units sold. Create columns for price, demand, revenue, costs, and profits. Use a table and a graph with $ on the y-axis and Demand on the x-axis to find the price at which profit is maximized.

 

Questions to Answer

  1. When the price for the gaming mouse is set to $100, what is the corresponding prediction for demand?
  2. When the price for the gaming mouse is set to $100, what is the corresponding projected revenue?
  3. When the price for the gaming mouse is set to $100, what are the corresponding costs?
  4. When the price for the gaming mouse is set to $100, what are the corresponding projected profits?
  5. Build a column in Excel for Price and consider price in $10 increments from $50 to $600. (This means your column should have $50, $60, $70, $80, etc. all the way to $600.) At what price for the gaming mouse is projected demand minimized?
  6. At what price for the gaming mouse is projected demand maximized?
  7. At what price for the gaming mouse is projected profit maximized?
  8. At what price for the gaming mouse is projected revenue maximized?
  9. True/False: Costs are projected to increase as the price for gaming mouse goes up.
  10. True/False: The lower the price for the gaming mouse, the higher the projected demands.

Additional Questions to Include in Rmd file

  1. Graph Profits on your chart; include the series using a line or scatterplot.
  2. Graph Revenues on your chart; include the series using a line or scatterplot. 13. Graph Costs on your chart; include the series using a line or scatterplot.
  3. Include an x-axis label on your chart.
  4. Include a y-axis label on your chart.
  5. Include a title on your chart.

Explain why decision trees, one of the oldest methodologies in ML, are vital to sound ML learning algorithms. What is Dimensionality Reduction and why is it used in ML? What are Outliers and why is there detection and handling vital in ML algorithms and processes?

Assignment #2: Critical Substantive Concepts of Machine Learning

Please complete the Module 2 readings before completing the assignment. Make sure that all responses are in your own words. Plagiarizing/copying and pasting from the Internet are against University policy.

1. In a 50+ word response, explain why Occam’s Razor is a vital principle in Machine Learning if your ML application is used for safety critical applications.

2. Explain briefly how bayesian methods are utilized in ML. (50 words)

3. Define and compare to each other: Ranking, Regression, Classification.

4. Explain why decision trees, one of the oldest methodologies in ML, are vital to sound ML learning algorithms.

5. What is Dimensionality Reduction and why is it used in ML?

6. What are Outliers and why is there detection and handling vital in ML algorithms and processes?

7. The text makes a vital declaration “Data starts to drive the operation; it is not the programmers anymore but the data itself that defines what to do next.” Why is this statement profound and how does it form the basis for using machine learning?

8. List and describe the Marr “Three Levels of Analysis”. How do these map to machine learning principles?

9. In machine learning, how do we model uncertainty? Why is this central in many machine learning algorithms?

10. Why is model selection vital in developing a ML solution? Give 2 examples of models used in ML.

11. Describe parametric estimation and non-parametric estimation. How are these used in ML?

12. Why in ML is our aim to fit a model to the data?

Respond in a Word document, all in your own words, and upload to Canvas.

Module 2 Readings

For the Module 2 readings, like in Module 1, we are focusing on the basic substantive concepts of Machine Learning as a subset discipline of Artificial Intelligence.

The Alpaydin MIT book is a great introduction to the topic, and over this and next Module we will be reading the book and highlighting the various components of machine learning. When reading the book, note the various components of ML: algorithms, data structures, mathematics, applications, etc. See how they are all related and are ultimately organized into a viable ML process, set of algorithms, and product in order to solve a specific problem.

Remember, in computer science our goal is to solve problems, whether they are mathematical, scientific, medical, business or related to another discipline.

Also remember Occam’s Razer when dealing with creating ML solutions. The simplist solutions are usually the best. (Especially when complexity increases software risk!!!). The brief overview is to remind you of this vital universal engineering (and life) principle.

The Brighterion white paper goes over the intersection between AI and ML. In this directed study we will read many white papers, as our goal with ML is to develop solutions to problems for industry. As a computer science and AI professional we must keep up with industry and its developments as well as the companies that are leading the AI/ML edge.

1. Read Alpaydin text: Pages 1-84

2. Read the Brighteron White paper on AI/ML

https://brighterion.com/wp-content/uploads/2019/05/Artificial-Intelligence-And-Machine-Learning-The-Next-Generation.pdf

Links to an external site.

3. Read the brief explanation of Occam’s Razor.

https://www.britannica.com/topic/Occams-razor

Links to an external site.

What is Occam’s razor? Why is it vital in Machine learning and Artificial Intelligence? What can happen if you do not follow Occam’s Razon while solving a complex problem?

MachinL-md2

Module 2 DQ 1

Read the brief reading on Occam’s Razor and answer the following questions:

  1. What is Occam’s razor?
  2. Why is it vital in Machine learning and Artificial Intelligence?
  3. What can happen if you do not follow Occam’s Razon while solving a complex problem?

Module 2 DQ 2

Read the Brighterion white paper, then answer the following:

  1. What is Smart Agent Technology and how does it use Machine learning and AI?
  2. List and describe 3 of the Smart Agent tools.
  3. How do you think smart agents can be used in a cyber security scenario?

Describe what is cloud computing? What types of application security solutions would you use for a cloud environment? Be specific.

Cloud computing application security

Describe what is cloud computing? What types of application security solutions would you use for a cloud environment? Be specific.

Create a word count style MapReduce program (CLOUD COMPUTING).

Create a word count style MapReduce program (CLOUD COMPUTING).

In this assignment, you are creating a wordcount style MapReduce program that runs on Cloudera Hortonworks Data Platform (HDP) or AWS Elastic MapReduce (EMR).

  1. Download Elon Musk’s twists from the attachment.
  2. Develop your MapReduce program with default FileInputFormat or your version of CSVInputFormat (10 Bonus points for creating the CSVInputFormat).
  3. You can choose to use either Hadoop MapReduce or Spark framework.
  4. Your program should:
  5. Counting the users that Elon ”@” in this twists
  6. Counting the topic that Elon referred to in his twists (#).
  7. Test the program on your local computer with IntelliJ IDE.
  8. Run the program on HDP or EMR.

Would benchmark datasets and task libraries help standardize evaluation? How useful can researchers make automated testing against requirements documents? How many users are needed to generate valid recommendations?

Research Project: Evaluation and User Experience

INTRODUCTION

Researchers can contribute their experience with experimentation to develop improved techniques for interface evaluation and the user experience. Guidance in conducting pilot studies, acceptance tests, surveys, interviews, and discussions would benefit large-scale development groups, but additional attention needs to be given to smaller projects and incremental-type changes. Strategies are needed to cope with evaluation for the numerous specific populations of users and the diverse forms of disabilities that users may have. In this project 2, you are the Experts in helping design and constructing psychological tests which can help in preparing validated and reliable test instruments for subjective evaluation of the varying types of interfaces, from small mobile devices to very large displays, including specialized interfaces such as gaming. Such standardized tests would allow independent groups to compare the acceptability of interfaces.

SCOPE: You are working for an Independent company and you are tasked to design an evaluation instrument tool used to profile users’ skill levels with interfaces that would be helpful in job-placement and training programs.

STEP ONE (1) Use PowerPoint (MS Suite Products or suitable Tool) to design (draw) your HCI Interface, design an Evaluation Instrument Test Tool to validate an interface for a small mobile device or a very large display to include specialized interfaces such as gaming. Please show in your design how you would incorporate quality features e.g., usability, universality, and usefulness using an AI and/or Machine Learning approach.

OBJECTIVE: This project 2 should show how do you best incorporate and evaluate qualitative data and dimensions such as fun, pleasure, joy, affect, challenge, or realism.

STEP TWO: Answer each of the following question to include why as it relates to Evaluations and the Users Experience.

  • Would benchmark datasets and task libraries help standardize evaluation?
  • How useful can researchers make automated testing against requirements documents?
  • How many users are needed to generate valid recommendations?
  • How can we better explain the differences between users’ perceptions of a task and the objective measures?
  • How do we select the best measure for a task?
  • How can life-critical applications for experienced professionals be tested reliably?
  • Is there a single usability metric that can be used and compared across types of interfaces?
  • Can we combine performance data and subjective data and create a single meaningful result?
  • Is there a scorecard that can be used to aid in the interpretation of usability results?
  • Is there a theory to explain and understand the relationship between measures?

How useful can researchers make automated testing against requirements documents? How many users are needed to generate valid recommendations? How can we better explain the differences between users’ perceptions of a task and the objective measures?

Human computer Interaction

INTRODUCTION

Researchers can contribute their experience with experimentation to develop improved techniques for interface evaluation and the user experience. Guidance in conducting pilot studies, acceptance tests, surveys, interviews, and discussions would benefit large-scale development groups, but additional attention needs to be given to smaller projects and incremental-type changes. Strategies are needed to cope with evaluation for the numerous specific populations of users and the diverse forms of disabilities that users may have. In this project 2, you are the Experts in helping design and constructing psychological tests which can help in preparing validated and reliable test instruments for subjective evaluation of the varying types of interfaces, from small mobile devices to very large displays, including specialized interfaces such as gaming. Such standardized tests would allow independent groups to compare the acceptability of interfaces.

SCOPE: You are working for an Independent company and you are tasked to design an evaluation instrument tool used to profile users’ skill levels with interfaces that would be helpful in job-placement and training programs.

STEP ONE (1) Use PowerPoint (MS Suite Products or suitable Tool) to design (draw) your HCI Interface, design an Evaluation Instrument Test Tool to validate an interface for a small mobile device or a very large display to include specialized interfaces such as gaming. Please show in your design how you would incorporate quality features e.g., usability, universality, and usefulness using an AI and/or Machine Learning approach.

OBJECTIVE: This project 2 should show how do you best incorporate and evaluate qualitative data and dimensions such as fun, pleasure, joy, affect, challenge, or realism.

STEP TWO: Answer each of the following question to include why as it relates to Evaluations and the Users Experience.

  • Would benchmark datasets and task libraries help standardize evaluation?
  • How useful can researchers make automated testing against requirements documents?
  • How many users are needed to generate valid recommendations?
  • How can we better explain the differences between users’ perceptions of a task and the objective measures?
  • How do we select the best measure for a task?
  • How can life-critical applications for experienced professionals be tested reliably?
  • Is there a single usability metric that can be used and compared across types of interfaces?
  • Can we combine performance data and subjective data and create a single meaningful result?
  • Is there a scorecard that can be used to aid in the interpretation of usability results?
  • Is there a theory to explain and understand the relationship between measures?